About the Company

Company Name: WRITER
Location: London, England, United Kingdom
Employment Type: Full-time
Remote: Yes

About the Role

Job Title: Platform Engineer, MLOps

Responsibilities

• Collaborate with AI/ML engineers and researchers to design and deploy a CI/CD pipeline for safe and reproducible experiments.
• Set up and manage monitoring, logging, and alerting systems for extensive training runs and client-facing APIs.
• Ensure training environments are consistently available across multiple clusters.
• Develop and manage containerization and orchestration systems using tools like Docker and Kubernetes.
• Operate and oversee large Kubernetes clusters with GPU workloads.
• Improve reliability, quality, and time-to-market of software solutions.
• Measure and optimize system performance to enhance capabilities and innovate for continual improvement.

Qualifications

Required Experience:

• Model training
• Huggingface Transformers
• Pytorch
• vLLM
• TensorRT
• Infrastructure as code tools like Terraform
• Scripting languages such as Python or Bash
• Cloud platforms (Google Cloud, AWS, or Azure)
• Git and GitHub workflows
• Tracing and Monitoring
• Familiarity with high-performance, large-scale ML systems

Desired Skills:

• Proactive in identifying problems, performance bottlenecks, and areas for improvement.
• Strong troubleshooting skills for complex systems.
• Comfortable with ambiguity and rapid change.

Preferred Skills and Experience

• Familiarity with monitoring tools such as Prometheus, Grafana, or similar.
• 5+ years of experience building core infrastructure.
• Experience running inference clusters at scale.
• Experience operating orchestration systems like Kubernetes at scale.

Benefits & Perks (UK Full-time Employees)

• Generous PTO, plus company holidays.
• Comprehensive medical and dental insurance.
• Paid parental leave for all parents (12 weeks).
• Fertility and family planning support.
• Early-detection cancer testing through Galleri.