About Modular At Modular, we’re on a mission to revolutionize AI infrastructure by systematically rebuilding the AI software stack from the ground up. Our team, made up of industry leaders and experts, is building cutting-edge, modular infrastructure that simplifies AI development and deployment. By rethinking the complexities of AI systems, we’re empowering everyone to unlock AI’s full potential and tackle some of the world’s most pressing challenges.

If you’re passionate about shaping the future of AI and creating tools that make a real difference in people’s lives, we want you on our team. You can read about our culture and careers to understand how we work and what we value.

What You Will Work On As an intern in the Models team you will implement cutting-edge AI models and architectures using Python on top of our MAX framework. You'll work on accelerating popular models that will be showcased on builds.modular.com. Your role involves translating state-of-the-art generative AI models into efficient, production-ready implementations. You’ll work together with our optimization team to help ensuring optimal performance through hardware acceleration and advanced optimizations.

LOCATION: Candidates based in the United States are welcome to apply. To support growth and collaboration, all interns will work in a hybrid capacity at our Los Altos, CA office (minimum 2 days per week on-site) with relocation assistance provided for out-of-state candidates.

What You Will Learn You will gain expertise in modern generative AI architectures and their implementation. Working with MAX will teach you how to optimize AI models for production environments, debug complex model behaviors, and leverage hardware acceleration effectively. Our model code is publicly available on Github, allowing you to showcase your work while developing a thorough understanding of model acceleration techniques and performance optimization strategies.

What You Bring To The Table

• 2025 graduate or currently pursuing a Bachelor's or Master's degree in Computer/Information Science, Mathematics, or an adjacent field; exceptional self-taught candidates with equivalent experience will also be considered
• Strong Python programming expertise
• Advanced debugging capabilities
• Understanding of generative AI principles and architectures
• Ability to translate AI research, or an existing implementation in another framework, into code.

Helpful, But Not Required

• Experience with PyTorch
• Experience with LLMs and their underlying transformer architecture.
• Familiarity with Hugging Face ecosystem
• Background in model implementation/acceleration

What Modular Brings To The Table

• Amazing Team. We are a progressive and agile team with some of the industry’s best engineering and product leaders.
• Competitive Compensation. We offer very strong compensation packages, including stock options. We want people to be focused on their best work and believe in tailoring compensation plans to meet the needs of our workforce.
• Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA.

Working at Modular will enable you to grow quickly as you work alongside incredibly motivated and talented people who have high standards, possess a growth mindset, and a purpose to truly change the world.

The estimated base hourly range for this role is $47.00 - $57.00 USD .

The hourly rate for the successful applicant will depend on a variety of permissible, non-discriminatory job-related factors, which include but are not limited to education, training, work experience, business needs, or market demands. This range may be modified in the future.

For candidates who fall outside of the listed requirements, we nevertheless encourage you to apply as we may have openings that are lower/higher level than the ones advertised.