Staff Engineer — API Core Platform About The Role Together AI is seeking an experienced Backend Engineer to found Together’s API Platform team within the Production Foundations organization. In this role, you will define, build, and scale the core systems and architecture that power Together’s mission-critical APIs — including public customer APIs used directly by customers and via SDKs, CLIs, as well as the client APIs powering Together’s Cloud UI.

In the near term, you will improve and standardize the backend API layer within our primary Next.js monolith, raising the bar on reliability, performance, and consistency. In parallel, you will design and lead the evolution toward scalable, purpose-built next-gen API platform solutions optimized for different Public API and Client API use cases and traffic patterns — defining the long-term architecture and driving its incremental rollout.

This is a deeply hands-on role for an engineer who thrives on writing critical-path code and building platforms that unify engineering efforts across teams. You will work across backend systems, infrastructure layers, identity and access flows, and developer tooling to establish a cohesive API strategy that supports Together’s rapidly growing AI Cloud.

Responsibilities

• Design and drive the evolution of Together’s API platform, defining how APIs are built, versioned, secured, tested, and operated across the company

Required Qualifications

• 8+ years of experience building and operating large-scale, distributed backend systems in production environments
• Proven experience building or significantly evolving an API platform used by multiple teams or customer-facing products
• Expert-level proficiency in one or more of Golang, TypeScript, C++, or Java
• Deep expertise in API performance and scalability, including caching strategies, rate limiting, parallelization, fan-out control, and graceful degradation
• Strong experience designing and implementing production-grade authentication and authorization systems for customer-facing APIs

Nice to Have

• Experience with GraphQL or schema-based API federation systems
• Experience evolving APIs from monoliths to modular, platform-oriented architectures
• Experience designing and operating API schema generation and validation systems
• Experience building developer-facing SDKs or command-line tools
• Experience designing and operating multi-region, globally distributed API systems

About Together AI Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $240,000 - $275,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy