We are seeking a Python-based platform engineer to design and build a containerized API layer that abstracts and governs interactions with engines such as Apache Spark through a well-defined API contract. This role focuses on building platform capabilities, not simply consuming existing data tools-enabling consistent, secure, and scalable access to Spark and non-Spark based data pipelines.

The ideal candidate has strong experience developing production-grade APIs in Python that interface with data frameworks or pipeline orchestration systems, packaging services using containers ( Docker/Kubernetes ), and operating them as reusable platform services. A proven background in CI/CD automation using GitHub Actions is required, along with solid software engineering practices around testing, versioning, and deployment.

This role is suited for engineers who have built data or compute platforms, service layers, or internal frameworks-translating complex data pipeline capabilities into stable, contract-driven APIs for broad enterprise use.

Tech Skills

• Experience building control planes
• Design patterns
• Modular containerized services
• Asynchronous processing
• Job-based work queue execution
• Immutability and idempotency
• Metadata management
• Policy enforcement
• Semantic modeling
• Observability and telemetry
• Side effect capability injection

Testing

• Functional testing
• Behavioral testing

Languages

• Python

Frameworks and Platforms

• FastAPI
• ARQ
• Kubernetes
• Pytest

Skills Equal opportunity Employer: Mphasis is an equal opportunity/affirmative action employer. We provide equal employment opportunities to applicants and existing associates and evaluate qualified candidates without regard to race, gender, national origin, ancestry, age, color, religious creed, marital status, genetic information, sexual orientation, gender identity, gender expression, sex (including pregnancy, breast feeding and related medical conditions), mental or physical disability, medical conditions military and veteran status or any other status or condition protected by applicable federal, state, or local laws, governmental regulations and executive orders.

VEVRAA Federal Contractor.

We request Priority Protected Veteran & Disabled Referrals for all of our locations within the state.

PDN-a18ddd3b-29a7-4332-9b57-43d36060ffbb