Staff AI Engineer
Harnham
Remote · New York · Posted October 29, 2026
Just laid off? Start here: a plan for the first weeks
See every open role at Harnham
More in New York job market · All Staff AI Engineer jobs (58) · Technology & Software · Data & Analytics jobs
More roles at Harnham
- Senior Software Engineer · San Francisco, CA
- Principal Software Engineer, AI · Boston, MA
- AI and Data Engineering Lead
- Senior Data Platform Engineer · Los Angeles, CA
- Senior Data Architect · Los Angeles, CA
- Forward Deployed Engineer – AI · Washington, DC
Similar jobs
- Applied AI Engineer — Conversational Agents (Senior/Staff) · Revin · New York, NY
- AI Product Engineer · August · New York, NY
- Lead AI Platform Engineer · OUTFRONT Media · New York, NY
- Scala Senior Machine Learning Infrastructure Engineer, ML Enablement · Etsy · Brooklyn, NY
- Director, AI Enablement · Zebra Technologies · Holtsville, NY
- Data & AI Engineer · Carlyle · New York, NY
Data & Analytics jobs in the rankings
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,713 openings)
- Best cities for data and analytics pay after cost of living #1 Foster ($232k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (711 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
How AI is used in this kind of work
Among computer and information research scientists, AI is already used for a large share of the tasks. Measured exposure for computer and information research scientists: 34% (high).
Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.
Skills this job asks for
Say which you have and which you want to build. We use it to match you to jobs like this one.
About the job
To Apply for this Job Click Here
Location: Remote (United States, Eastern or Central time zones preferred) Travel: Approximately 10-20% travel for client meetings and team collaboration Compensation: Base salary range of $160,000-$185,000
Overview
A technology consulting organisation is seeking a senior AI engineering leader to design, develop, and deploy large-scale AI applications for enterprise clients. This role is suited to an experienced engineer who enjoys owning end-to-end solution architecture, guiding technical direction, and delivering production-ready AI systems with a focus on scalability, security, reliability, and operational excellence. The successful candidate will work across generative AI, agent-based architectures, cloud-native platforms, and machine learning systems while collaborating with engineering teams and client stakeholders.
Key Responsibilities
Architect and implement advanced AI solutions, including agent-based systems, reasoning workflows, tool integration, and multi-agent environments.
Design and optimise Retrieval-Augmented Generation (RAG) platforms leveraging embeddings, vector databases, search, ranking, and knowledge retrieval strategies.
Build and integrate cloud-based AI applications using managed services, serverless technologies, event-driven architectures, APIs, and data platforms.
Establish evaluation, monitoring, observability, and testing frameworks for production LLM applications.
Develop backend services and APIs using modern programming languages and cloud-native design patterns.
Lead technical architecture discussions and provide guidance to engineering teams across AI initiatives.
Mentor developers and contribute to engineering best practices, standards, and solution design reviews.
Improve system resilience through fault-tolerant architectures, monitoring, fallback strategies, and operational excellence practices.
Partner with business and technical stakeholders to deliver scalable AI solutions aligned with client objectives.
Required Qualifications
5+ years of software engineering experience with demonstrated success delivering production AI, machine learning, or generative AI solutions.
Strong experience building agentic AI systems, LLM orchestration frameworks, tool/function calling, and RAG architectures.
Deep expertise with AWS services, including:
Amazon Bedrock
SageMaker
Lambda
DynamoDB
S3
Event-driven services and workflow orchestration technologies
Proficiency in Python and Node.js, including API development and cloud-native application design.
Experience implementing AI observability, evaluation methodologies, prompt engineering, and production monitoring practices.
Hands-on experience with containerisation technologies such as Docker.
Strong understanding of distributed systems, scalability, and modern software architecture principles.
Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent professional experience).
Preferred Qualifications
Experience designing enterprise-scale AI platforms for multiple business stakeholders or client environments.
Prior consulting, professional services, or client-facing delivery experience.
Experience leading technical teams, mentoring engineers, and influencing architecture decisions.
Familiarity with AI monitoring and evaluation platforms such as LangFuse, LangSmith, or similar tooling.
To Apply for this Job Click Here