AI Agent Engineer, Evaluation and Reliability (Semiconductor AI)
ScrumAID
San Jose, CA · Posted November 1, 2026
Just laid off? Start here: a plan for the first weeks
More in California job market · Technology & Software · Data & Analytics jobs
More roles at ScrumAID
- Senior Software Engineer (Contract AI Agents) · New York, NY
- Founding Product Designer (Insurance AI Startup) · New York, NY
- Electrical and Computer Engineer (Space Compute Startup) · Los Angeles, CA
- AI Application Security Engineer (Enterprise AI for Regulated Industries) · San Francisco, CA
- Full-Stack Product Engineer, AI Agents (Agentic AI Startup) · New York, NY
- Principal Compliance Lead (Defense Manufacturing Roll-Up) · Los Angeles, CA
Similar jobs
- Sr. Data & AI Application Engineer · Xoriant · San Jose, CA
- Research Scientist - Machine Learning · Extropic · San Francisco, CA
- Senior AI/ML Engineer · Condor Software · San Francisco, CA
- AI Engineer · Intellipro Group · Palo Alto, CA
- Senior Staff Engineer, Machine Learning Engineering ( Agentic AI SW ) · Qualcomm · San Diego, CA
- Sr Engineer, Machine Learning Engineering (ML Apps) · Qualcomm Technologies · San Diego, CA
Where San Jose, CA ranks
Where San Jose, CA placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Best cities for marketing pay after cost of living$204k · of 16
- #1Best cities for aerospace and defense pay after cost of living$187k · of 19
- #2Best cities for security pay after cost of living$220k · of 10
- #3Best cities for technology pay after cost of living$205k · of 80
- #5Best cities for technology jobs1,449 openings · of 100
- #5Cities with the most jobs that do not need a four-year degree in the West Coast162 jobs · of 47
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,713 openings)
- Best cities for data and analytics pay after cost of living #1 Foster ($232k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (711 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
How AI is used in this kind of work
Among computer and information research scientists, AI is already used for a large share of the tasks. Measured exposure for computer and information research scientists: 34% (high).
Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.
Skills this job asks for
Say which you have and which you want to build. We use it to match you to jobs like this one.
About the job
A fast-growing AI company that builds software agents for semiconductor and hardware engineering is hiring engineers to make those agents stronger, more dependable and cheaper to run. The role blends talking with customers, designing evaluations, applied research and production engineering, alongside software engineers, researchers and hardware specialists.
Your focus
Identify where agents fail, then build and execute evals that improve quality, reliability and efficiency
Create new agent capabilities: interfaces to tools, handling of context, memory, and orchestration across several steps or several agents
Examine run traces and test outcomes to pinpoint slowdowns, and distinguish true progress from benchmark noise
Talk with customers and subject specialists about their needs, then ship and maintain solutions through to completion
Turn experiments that work into solid, maintainable software in production
Profile
Five to fifteen years of software engineering, including work on large-scale agent systems
Strong production skills in Python and TypeScript
Working knowledge of current language models, agent frameworks and typical ML workflows
Experience with LLM agent orchestration, tools, memory and tracing
Communicates well, shows sound judgment about customers and can isolate the core of vague technical problems
Self-directed with strong ownership and product sense
Bonus: interest in chip design or systems that span hardware and software
On-site in the South Bay Area (Silicon Valley). Not able to offer visa sponsorship or transfers.