Senior Solution Engineer

Permanent employee, Full-time · Germany Berlin

TL;DR

As a Solution Engineer at deepset, you will apply cutting-edge NLP techniques to real-world enterprise problems. You will develop deep expertise across the full spectrum of NLP methods within Haystack including dense retrieval, Question Answering, generative QA, Summarization, RAG pipelines, and more and use deepset Cloud, our SaaS platform, to streamline workflows and transform customer data into actionable intelligence.


You will collaborate closely with our open-source and product teams to shape the best solutions for each engagement. This role sits at the intersection of professional services consultant, senior AI/NLP engineer, and trusted technical advisor.


Exemplary engagement: You will partner with data scientists from a leading aerospace corporation to enhance search functionality across pilot manuals. This means understanding their data and domain, evaluating methods (DPR, QA, TableQA) against their requirements, designing annotation workflows for expert labellers, continuously analysing incoming labels, training and iterating models, and driving step-by-step performance improvements until production targets are met.

Why deepset

deepset is the company behind Haystack, the leading open-source framework for building production-ready LLM applications, and deepset Cloud, the enterprise platform that brings AI-powered search and retrieval to the world's most demanding organisations. We sit at the intersection of cutting-edge AI research and real-world enterprise deployment — and we're growing fast.


Our Solution Engineers are the bridge between deepset's powerful AI technology and the customers who need it most. This is not a traditional sales-support role: you will be a trusted technical advisor, a hands-on builder, and a strategic partner to enterprise clients across the DACH region and beyond.

What you will do

Customer Delivery & Solution Design

  • Show customers how to search for and extract information using Haystack and deepset Cloud, growing NLP awareness within their organisation

  • Understand each customer's domain data, use case, needs, and processes to craft the optimal solution and drive improvements to Haystack/deepset Cloud

  • Be the outward face to the customer: communicate to define goals and timelines, and report results throughout the engagement

  • Rapidly prototype cutting-edge NLP methods — dense retrieval (DPR), Question Answering, generative QA, TableQA, Summarization — and evaluate them against real customer data


Model Development & Data Engineering

  • Lead end-to-end technical delivery of AI solutions using Haystack, PEFT, Hugging Face Transformers, and deepset Cloud

  • Design annotation workflows for expert labellers and continuously analyse incoming labels to drive model improvement

  • Train and fine-tune large language models through large-scale data curation and optimisation to meet production performance targets

  • Contribute NLP/RAG-related improvements upstream to Haystack and other open-source libraries


Customer Success & Enablement

  • Partner directly with customer data scientists and engineering teams, guiding them from prototype through to production

  • Run technical workshops and enablement sessions; help customers build internal capabilities around Haystack and NLP best practices

  • Act as the internal voice of the customer, feeding domain knowledge and product feedback to our open-source and product teams

  • Track performance metrics and communicate progress clearly to both technical and non-technical stakeholders


Growth & Community

  • Define and pursue the skills needed to grow into an expert or team lead role as deepset scales

  • Contribute to deepset's technical blog, conference talks, and Haystack community presence

  • Work with Account Executives and the Product team to translate customer insights into roadmap decisions

Requirements
  • Fluency in German (C1/C2 or native) and strong professional English — you will operate in both languages daily

  • 5+ years of industry experience applying data science or NLP methods to real-world data

  • University degree in Computer Science or a comparable qualification

  • Proficiency in Python and strong working knowledge of ML/DL/NLP methods and recent model architectures (Transformers, LLMs, retrieval models)

  • Hands-on experience with Haystack, Hugging Face Transformers, PEFT, or comparable NLP frameworks

  • Experience managing customer-facing projects: defining scope, setting timelines, communicating results

  • Excellent communication skills with both technical (data scientist, ML engineer) and non-technical (business, C-suite) stakeholders

  • An intense desire to learn and a track record of rapidly acquiring new skills

Nice to have
  • Data science consulting experience and/or hands-on experience with data annotation workflows

  • Experience with deepset Cloud or other enterprise NLP/search platforms

  • Familiarity with dense retrieval (DPR), Question Answering, generative QA, TableQA, and Summarization methods

  • Understanding of RAG architectures and vector databases (e.g. Weaviate, Pinecone, OpenSearch)

  • Experience with model fine-tuning via PEFT (LoRA, QLoRA) and large-scale data curation

  • Contributions to open-source NLP libraries or a public technical profile (blog, talks, GitHub)

  • Aspiration to grow into a senior expert or team lead position as the Solutions team scales

Benefits

Compensation

Competitive salary + equity (ESOP). We benchmark against above  European AI companies.

Flexibility

Remote-first culture with optional access to Munich and Berlin offices. Flexible working hours.

Impact

Work on the frontier of enterprise AI. Your solutions will go into production at household-name companies.

Growth

Learning budget, conference attendance, access to the best minds in open-source NLP and LLMs.

Culture

Transparent, low-ego team. English as the working language, diverse and international colleagues.

Benefits

30 days PTO, company offsites, home office setup budget, and more.

About us

Founded in 2018, deepset builds open and enterprise-grade tools that help teams build AI with purpose. From Haystack, our open-source framework, to the Haystack Enterprise Platform, we give developers and organizations the building blocks to solve complex, high impact challenges with AI with full control, transparency, and sovereignty. Backed by GV and Balderton, we’re growing the world’s production AI community and customer base solving challenges too critical to get wrong. 

Visit us to learn more: deepset Website | Haystack Website | GitHub Linkedin | X deepset (Twitter) | X haystack (Twitter)
Your application!
We appreciate your interest in the deepset GmbH. Please fill in the following short form. Should you have any difficulties in uploading your files, please contact us by mail at careers@deepset.ai .
Uploading document. Please wait.
Please add all mandatory information with a * to send your application.