← Search all jobs

Staff AI Engineer

Harnham

Remote · New York · Posted October 29, 2026

Just laid off? Start here: a plan for the first weeks

See every open role at Harnham

More in New York job market · All Staff AI Engineer jobs (58) · Technology & Software · Data & Analytics jobs

More roles at Harnham

Similar jobs

Data & Analytics jobs in the rankings

How AI is used in this kind of work

Among computer and information research scientists, AI is already used for a large share of the tasks. Measured exposure for computer and information research scientists: 34% (high).

Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.

Check how this applies to your own job

Skills this job asks for

Say which you have and which you want to build. We use it to match you to jobs like this one.

  • Python
  • AWS
  • Machine learning
  • Docker
  • Node.js

About the job

To Apply for this Job Click Here

Location: Remote (United States, Eastern or Central time zones preferred) Travel: Approximately 10-20% travel for client meetings and team collaboration Compensation: Base salary range of $160,000-$185,000

Overview

A technology consulting organisation is seeking a senior AI engineering leader to design, develop, and deploy large-scale AI applications for enterprise clients. This role is suited to an experienced engineer who enjoys owning end-to-end solution architecture, guiding technical direction, and delivering production-ready AI systems with a focus on scalability, security, reliability, and operational excellence. The successful candidate will work across generative AI, agent-based architectures, cloud-native platforms, and machine learning systems while collaborating with engineering teams and client stakeholders.

Key Responsibilities

Architect and implement advanced AI solutions, including agent-based systems, reasoning workflows, tool integration, and multi-agent environments.

Design and optimise Retrieval-Augmented Generation (RAG) platforms leveraging embeddings, vector databases, search, ranking, and knowledge retrieval strategies.

Build and integrate cloud-based AI applications using managed services, serverless technologies, event-driven architectures, APIs, and data platforms.

Establish evaluation, monitoring, observability, and testing frameworks for production LLM applications.

Develop backend services and APIs using modern programming languages and cloud-native design patterns.

Lead technical architecture discussions and provide guidance to engineering teams across AI initiatives.

Mentor developers and contribute to engineering best practices, standards, and solution design reviews.

Improve system resilience through fault-tolerant architectures, monitoring, fallback strategies, and operational excellence practices.

Partner with business and technical stakeholders to deliver scalable AI solutions aligned with client objectives.

Required Qualifications

5+ years of software engineering experience with demonstrated success delivering production AI, machine learning, or generative AI solutions.

Strong experience building agentic AI systems, LLM orchestration frameworks, tool/function calling, and RAG architectures.

Deep expertise with AWS services, including:

Amazon Bedrock

SageMaker

Lambda

DynamoDB

S3

Event-driven services and workflow orchestration technologies

Proficiency in Python and Node.js, including API development and cloud-native application design.

Experience implementing AI observability, evaluation methodologies, prompt engineering, and production monitoring practices.

Hands-on experience with containerisation technologies such as Docker.

Strong understanding of distributed systems, scalability, and modern software architecture principles.

Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent professional experience).

Preferred Qualifications

Experience designing enterprise-scale AI platforms for multiple business stakeholders or client environments.

Prior consulting, professional services, or client-facing delivery experience.

Experience leading technical teams, mentoring engineers, and influencing architecture decisions.

Familiarity with AI monitoring and evaluation platforms such as LangFuse, LangSmith, or similar tooling.

To Apply for this Job Click Here