Backend Engineer, Agent Platform (Vertical SaaS AI)
ScrumAID
San Jose, CA · Posted November 1, 2026
Just laid off? Start here: a plan for the first weeks
More in California job market · All Backend Engineer jobs (47) · Technology & Software · Data & Analytics jobs
Similar jobs
- Production Master Data Engineer · Anduril Industries · Costa Mesa, CA
- Operations Data Analyst · Pacific Gas & Electric · Oakland, CA
- Program Manager-AI Adoption · Loma Linda University Health · Loma Linda, CA
- Software Engineer, Applied ML · Apple · Cupertino, CA
- AI Software Engineer - Calendar Intelligence · Apple · Cupertino, CA
- Data Analytics Developer II · California State University · CA
Where San Jose, CA ranks
Where San Jose, CA placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Best cities for marketing pay after cost of living$204k · of 16
- #1Best cities for aerospace and defense pay after cost of living$187k · of 19
- #2Best cities for security pay after cost of living$220k · of 10
- #3Best cities for technology pay after cost of living$205k · of 80
- #5Best cities for technology jobs1,449 openings · of 100
- #5Cities with the most jobs that do not need a four-year degree in the West Coast162 jobs · of 47
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,713 openings)
- Best cities for data and analytics pay after cost of living #1 Foster ($232k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (711 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
About the job
A vertical software company is building a large-scale platform that puts autonomous AI agents to work inside an industry, and its agent platform team needs a backend engineer at the mid or senior level. The system has to stay dependable at scale, so the team wants someone who cares about product impact as much as system design.
What you’ll own
Runtime services for agents, covering orchestration, tool invocation, retries, idempotency, rate limits and state handling
Dependable, versioned APIs for internal and external consumers, plus webhook and event hooks and adapters for partner systems
Data models that hold agent state, past workflow runs, access rules and tenant separation
Integrations such as OAuth flows, sync engines and connectors, built with good monitoring and graceful handling of failures
Throughput, latency, queues, caching and inference spend, plus guardrails against runaway tasks
Reliability practice (SLIs and SLOs, distributed tracing, timeouts, circuit breakers, incident response) and higher engineering standards through testing, runbooks, postmortems and mentoring
What you bring
Three or more years of backend engineering, with exposure to AI or conversational agents
Strong distributed-systems fundamentals: concurrency, queues and workers, caching, production operations
Recent hands-on experience shipping LLM agents with tool calling and multi-step orchestration, improved through evals, prompt iteration or fine-tuning
Experience scaling production AI/ML platforms in a fast-paced startup
Daily use of AI coding assistants, and the ability to explain how they speed up your work
Comfort with ambiguity and a proactive, autonomous working style
Hybrid in the South Bay Area, three days a week in the office. Visa transfers are welcome.