Overview

As a Distributed Systems Engineer, you will design, implement, and optimize scalable systems that power modern AI and machine learning applications. You will work closely with engineering teams to build robust infrastructure, ensuring system reliability and performance.

Your Responsibilities

• Design

  • Design and develop distributed systems and tools in Python and C++.
  • Write shell scripts, build Docker containers, set up training/inference clusters, and automate the training/inference pipeline.
  • Write communication layers and connectors between different ML-related microservices/components.

• Optimization

  • Optimize system performance and scalability.
  • Debug and resolve complex distributed system issues.
  • Implement fault-tolerant and high-availability features.
  • Collaborate with cross-functional teams to integrate distributed systems into larger platforms.

Qualifications

• Education and Experience

  • Bachelor’s or Master’s degree in Computer Science from a reputable university, graduating with a GPA of 1.7 or better (German scale).
  • OR minimum one year of full-time working experience with asynchronous, parallel ML serving frameworks such as Torchserve, vLLM, LMDeploy, NVIDIA Triton.
  • OR extraordinary GitHub repository with at least 10 stars.
  • Experience in designing and deploying distributed systems.
  • Experience with training ML/LLMs models in distributed settings.

• Skills

  • Proficiency in Python and Pytorch.
  • Proficiency in bash scripting, Docker building, and ML orchestration tools such as Kubernetes, Kserve, Slurm, Torch Distributed.
  • Proficiency working with cloud-based ML platforms such as AWS Sagemaker, GCP VertexAI, as well as other cloud services such as storage and Docker registry.
  • Proficiency working with distributed communication systems such as MPI, NCCL, as well as general-purpose communication systems such as RabbitMQ, MQTT.
  • Strong understanding of networking, concurrency, and multithreading.

What We Offer

• Wellpass (gym membership)
• Free meals at the workplace
• Flexible working hours
• A motivated team and an open corporate culture
• Competitive compensation and excellent career development opportunities