Staff Backend Engineer (Healthcare Voice AI)
ScrumAID
San Jose, CA · Posted November 1, 2026
Just laid off? Start here: a plan for the first weeks
More in California job market · Technology & Software · Data & Analytics jobs
More roles at ScrumAID
- Community and Field Marketing Lead (B2B Software Startup) · San Francisco, CA
- Applied AI Research Scientist, Continual Learning (Physical-World AI) · San Francisco, CA
- Staff Software Engineer (Clinical Trial AI) · San Francisco, CA
- Forward Deployed Infrastructure Engineer (Document AI) · San Francisco, CA
- Post-Training Research Engineer (Applied AI Agents Startup) · San Jose, CA
- Additive Manufacturing Manager (Thermal Hardware Startup) · Washington, DC
Similar jobs
- Staff Software Engineer, Imitation Learning - Behavior Planning, Embodied AI · General Motors · Sunnyvale, CA
- Lead Software Engineer, AI Workflow Generation (Agentforce Operations) · Salesforce · San Francisco, CA
- Senior Software Engineer, AI Compute Scheduling · Nvidia · Santa Clara, CA
- Senior AI Systems Engineer, Chip Design · Nvidia · Santa Clara, CA
- Senior Data Scientist, Marketplace Economics · Roblox · San Mateo, CA
- Lead Data Analyst · Childrens Institute · Los Angeles, CA
Where San Jose, CA ranks
Where San Jose, CA placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Best cities for marketing pay after cost of living$204k · of 16
- #1Best cities for aerospace and defense pay after cost of living$187k · of 19
- #2Best cities for security pay after cost of living$220k · of 10
- #3Best cities for technology pay after cost of living$205k · of 80
- #5Best cities for technology jobs1,449 openings · of 100
- #5Cities with the most jobs that do not need a four-year degree in the West Coast162 jobs · of 47
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,713 openings)
- Best cities for data and analytics pay after cost of living #1 Foster ($232k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (711 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
Skills this job asks for
Say which you have and which you want to build. We use it to match you to jobs like this one.
About the job
A well-funded healthcare technology company is building AI products that listen to clinical conversations through phone and browser apps. It needs a staff-level backend engineer to make long-running, compute-intensive audio and inference pipelines dependable in an early, build-from-nothing setting.
The work
Design, build and run the backend for the company’s audio products, including ingestion of lengthy recordings, media handling, and both live and asynchronous streaming
Own orchestration of multi-step inference pipelines covering transcription, speaker separation, LLMs, clinical extraction and summarization, handling scheduling, queues, retries, timeouts, dead letters, idempotency and replay
Collaborate with clinical, security, AI, product and mobile colleagues so workflows stay reliable on weak networks and offline
Set service-level objectives and instrument workflows thoroughly with structured logs, metrics, tracing, dashboards and alerts
Drive incident response and postmortems until recurring failures disappear
Shape the APIs, data models, deployment pipelines and cloud infrastructure while balancing reliability, latency and cost, and mentor other engineers
Profile
Seven to fifteen years in backend, platform or infrastructure roles (eight or more is typical)
Production distributed systems built and operated at scale
Python or a comparable modern backend language
Currently or recently a staff engineer or tech lead, with a record of measurably improving reliability
Exposure to speech, audio or live-streaming systems, or a healthcare background, is a plus
Hybrid in the South Bay or the San Francisco Bay Area, with at least three days on-site. Visa transfers are considered.