Senior DevOps Engineer

Permanent employee, Full-time · Berlin, Germany, Barcelona, Spain

TL;DR

We’re hiring a Senior DevOps Engineer to build and scale the infrastructure behind the deepset AI Platform. You’ll own CI/CD, automate deployments, and improve performance across both cloud and on-prem environments. You’ll work closely with engineering teams on reliability, monitoring, security, and debugging to ensure the platform is fast, stable, and ready for real-world enterprise use.

Why deepset

At deepset, we’re on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We’re remote-first, flexible, and built on a culture of trust and ownership. You’ll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.

What you will do

Solve performance and scalability challenges for LLM-powered enterprise apps
Own and evolve CI/CD pipelines and automation for smooth deployments
Define and maintain monitoring and alerting strategies for production health
Work cross-functionally on firefighting, GitHub workflows, and system debugging
Configure infrastructure for both SaaS and on-prem enterprise deployments
Collaborate with customer infrastructure teams and internal stakeholders
Drive best practices for security, scalability, and system reliability

Requirements

5+ years managing large-scale production infrastructure
Strong experience with service-oriented architecture design
Proficient in AWS, Kubernetes, GitOps (ArgoCD), and CI/CD practices
Hands-on with Infrastructure as Code (Terraform, Crossplane preferred)
Experience supporting customer-hosted deployments (private cloud/on-prem)
Solid troubleshooting skills, ownership mindset, and pragmatic approach
Interest in Machine Learning / LLMs—or motivation to learn quickly

Nice to have

Exposure to multi-region infrastructure or high-security environments
Experience in AI/ML platforms, or data-heavy backend systems
Contributions to DevOps tooling or open-source infrastructure projects
Background supporting B2B SaaS or enterprise products

Benefits

Remote-first setup with flexible hours & tech of your choice
30 days vacation + extra days for family sick leave
Competitive salary & stock options for every team member
Monthly sports & mental health support allowance with Oliva
Annual learning & development budget
Monthly team socials & in-person meetups
Dog-friendly Berlin HQ

Apply for this job

About us

Founded in 2018, deepset builds open and enterprise-grade tools that help teams build AI with purpose. From Haystack, our open-source framework, to the deepset AI Platform, we give developers and organizations the building blocks to solve complex, high impact challenges with AI – with full control, transparency, and sovereignty. Backed by GV and Balderton, we’re growing the world’s production AI community and customer base solving challenges too critical to get wrong.

Apply for this job

Your application!

We appreciate your interest in the deepset GmbH. Please fill in the following short form. Should you have any difficulties in uploading your files, please contact us by mail at careers@deepset.ai .