About the Role

Job Title: MLOps Engineer
Location: On-site in Düsseldorf or remote in Germany
Employment Type: Full-time
Department: Engineering

Responsibilities

• Build & Operate LLM Infrastructure: Design and maintain scalable LLM-serving systems using Kubernetes and KubeRay.
• Automate & Optimize: Automate deployments, rollbacks, and scaling of LLMs while optimizing resource usage and performance.
• Enhance Observability: Ensure robust monitoring, logging, and alerting for LLM operations (Prometheus, Grafana, etc.).
• Support AI Teams: Empower ML and product engineers with self-service pipelines and scalable infrastructure.
• Prioritize Security: Enforce secure deployments, compliance practices, and robust incident response strategies.
• Improve Documentation: Create and maintain technical documentation to streamline knowledge sharing and onboarding.
• Drive Innovation: Evaluate, adopt, and integrate the latest MLOps and LLM-serving technologies.
• Reduce SRE Toil: Eliminate repetitive tasks and improve operational efficiency across the platform.

Growth Potential

At Cognigy, we are committed to your professional growth. This role offers significant opportunities for career development, including access to ongoing training and involvement in high-impact projects.

Requirements

• Hands-on experience running production ML or LLM workloads in Kubernetes.
• Familiarity with distributed ML frameworks such as KubeRay, Ray Serve, or similar.
• Deep understanding of Kubernetes internals, especially GPU scheduling, autoscaling, and multi-tenant environments.
• Proficiency with CI/CD systems for ML models and versioned deployment strategies.
• Strong experience with cloud platforms (AWS, GCP, or Azure), networking, and security best practices.
• Skilled in monitoring and observability for ML workloads (e.g., Prometheus, Grafana).
• Passion for automation, performance tuning, and cost optimization for LLM workloads.
• Clear communicator and proactive team player who thrives in fast-paced, cross-functional environments.
• MLOps or DevOps certifications (nice to have).

Benefits

Life at Cognigy - What we offer you:

• Attractive and performance-oriented salary.
• Company Pension Scheme.
• 25 days paid leave, plus 5 floating days, plus public holidays.
• Unique opportunity to help build and shape the company, with little hierarchy.
• Flexible working options.
• Colleague recognition, reward, and celebration events.
• Global Employee Assistance Program.
• ClassPass membership, giving access to a variety of fitness and wellness experiences.
• Ongoing learning and development opportunities, including Udemy.
• One paid ‘Giving Back Day' each year for volunteering for a charity or community activity of your choice.
• Subscription to the Calm app for you plus five friends/family members.

Equal Opportunity Employer Statement

Cognigy does not discriminate on the basis of race, sex, color, religion, age, national origin, marital status, disability, veteran status, genetic information, sexual orientation, gender identity, or any other reason prohibited by law in the provision of employment opportunities and benefits.