Senior Product Engineer (Backend)

Permanent employee, Full-time · Berlin, Germany, Barcelona, Spain

TL;DR

We’re hiring a Senior Product Engineer (Backend) to help scale the deepset AI Platform, our LLM-powered enterprise product. You’ll own features end to end, build systems that process millions of documents, and contribute to our open-source framework, Haystack. If you enjoy solving complex challenges with real impact, this role’s for you.

Why deepset

At deepset, we’re on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We’re remote-first, flexible, and built on a culture of trust and ownership. You’ll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.

What you will do

Design and build a scalable AI platform that helps users solve real business problems with LLMs
Develop infrastructure to support thousands of LLM applications, processing millions of documents and handling 100s of user requests per second
Own backend features end to end—from architecture and CI/CD to testing, monitoring, and customer feedback
Collaborate with the Open Source team to improve and contribute to Haystack
Partner with the infrastructure team on performance, observability, and debugging
Help resolve high-priority production issues with customer-facing impact
Improve reliability by maintaining strong debugging tools and processes
Mentor other engineers and support their technical growth

Requirements

5+ years of backend development experience, ideally in Python
Strong knowledge of REST APIs, SQL databases, CI/CD, Kubernetes, and cloud services
Experience with Infrastructure-as-Code tools (e.g., Terraform or Crossplane)
Proven ability to write clean, testable, observable, and maintainable code
Skilled at fast troubleshooting in high-pressure, cross-functional settings
Comfortable dealing with customer-facing production issues
Proactive, collaborative, and aligned with team-wide decisions

Nice to have

Experience in early-stage or high-growth startups
Familiarity with open-source development
Background in NLP, machine learning, or LLM technologies
Exposure to building or scaling B2B SaaS products

Benefits

Remote-first setup with flexible hours & tech of your choice
30 days vacation + extra days for family sick leave
Competitive salary & stock options for every team member
Monthly sports & mental health support allowance with Oliva
Annual learning & development budget
Monthly team socials & in-person meetups
Dog-friendly Berlin HQ

Apply for this job

About us

Founded in 2018, deepset builds open and enterprise-grade tools that help teams build AI with purpose. From Haystack, our open-source framework, to the deepset AI Platform, we give developers and organizations the building blocks to solve complex, high impact challenges with AI – with full control, transparency, and sovereignty. Backed by GV and Balderton, we’re growing the world’s production AI community and customer base solving challenges too critical to get wrong.

Apply for this job

Your application!

We appreciate your interest in the deepset GmbH. Please fill in the following short form. Should you have any difficulties in uploading your files, please contact us by mail at careers@deepset.ai .