← Search all jobs

Full Stack Engineer (AI Evaluation Data Startup)

ScrumAID

San Francisco, CA · Posted November 1, 2026

Just laid off? Start here: a plan for the first weeks

More in California job market · All Full Stack Engineer jobs (52) · Technology & Software · Data & Analytics jobs

Similar jobs

Where San Francisco, CA ranks

Where San Francisco, CA placed in our monthly rankings, month by month. Each month stays online at its own address.

How AI is used in this kind of work

Among software developers, AI is already used for some of the tasks. Measured exposure for software developers: 29% (some).

Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.

Check how this applies to your own job

Skills this job asks for

Say which you have and which you want to build. We use it to match you to jobs like this one.

  • Python
  • Kubernetes
  • React
  • Kafka
  • Node.js

About the job

A fast-growing startup that supplies data and evaluation infrastructure to frontier AI labs needs a generalist engineer. The scope is deliberately wide, and the person who joins will take full ownership of projects instead of working a narrow lane.

What the work looks like

Prototype reinforcement-learning environments based on published research

Launch distributed experiments on Kubernetes

Keep web dashboards dependable and build streaming pipelines for annotator analytics

Design scalable APIs and platforms that combine automation with human review

Partner with research, product and design colleagues to ship quickly, and take part in code and design reviews

Work directly with researchers at AI labs who rely on the platform

Who fits

Two to five years as a full stack engineer, with a history of building things from start to finish

Strength across Next.js/React, Node.js or Python, and Kubernetes

Familiarity with Kafka, Redis or Elasticsearch is a plus

Experience at a high-growth startup

Poise in a client-facing setting with technical researchers

A strong bias toward taking ownership

On-site in the San Francisco Bay Area, in the office five days a week with flexible hours. Visa transfers are considered.