← Search all jobs

Lead Software Engineer

Searchability

New York · Posted October 14, 2026

Just laid off? Start here: a plan for the first weeks

See every open role at Searchability

More in New York job market · Lead Software Engineer jobs in New York (18) · All Lead Software Engineer jobs (255) · Technology & Software · Engineering jobs

More roles at Searchability

Similar jobs

Engineering jobs in the rankings

How AI is used in this kind of work

Among software developers, AI is already used for some of the tasks. Measured exposure for software developers: 29% (some).

Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.

Check how this applies to your own job

Skills this job asks for

Say which you have and which you want to build. We use it to match you to jobs like this one.

About the job

Lead Rust Engineer

NYC Start-up changing the way LLM’s are utilized!

Up to $300k + Equity

On-Site – New York

Rust, Machine Learning, Reinforcement Learning, LLM

ABOUT THE CLIENT

A New York based start-up who are changing the way LLMs are utilized and scaled! They’re building a world class ML infrastructure product that is already changing the way businesses incorporate ML.

The product has applications across a multitude of industries to drive their LLM’s to rapidly improve their capabilities.

THE LEAD RUST ENGINEER

We’re hiring a founding engineer with deep systems chops (Rust especially) to help build a fast, flexible model gateway at the heart of our AI infrastructure. Most of your work will be open source, with projects ranging from inference-time optimization to real-time experimentation tools. You’ll have the freedom to dive deep into what you already know or pick up entirely new skills as we scale. If building core ML infrastructure in the open sounds like your kind of challenge, we’d love to talk.

SKILLS:

RUST

SYSTEMS ENGINEERING

PhD Education

ML

LLM

TO BE CONSIDERED:

Please either apply by clicking online or emailing me directly james.roberts@searchability.com. I can make myself available outside of normal working hours to suit between 7am until 8pm. If unavailable, please leave a message and either myself or one of my colleagues will respond. By applying for this role, you give express consent for us to process and submit (subject to required skills) your application to our client in conjunction with this vacancy only. Also feel free to follow me on twitter @searchablejim or connect with me on LinkedIn! I look forward to hearing from you.

KEY SKILLS

RUST , SYSTEMS ENGINEERING , ML , MACHINE LEARNING / MLOPS / LLM / LARGE LANGUAGE MODELS