Senior Director of Compiler Engineering
Bangalore
We are seeking a Director of Compiler Engineering to lead the design, development, and delivery of the next-generation AI compiler and software stack powering our custom inference accelerators. This role combines deep compiler expertise, hands-on technical leadership, and organizational ownership across compiler, runtime, and QA teams to enable cutting-edge model deployment and performance.
Key Responsibilities
- Technical Leadership: Define the compiler roadmap and architecture, driving innovation in graph compilation, lowering flows, and performance optimization.
- New Model Enablement: Own end-to-end bring-up for new model families (e.g., Llama, MoE) from FX capture through runtime execution.
- Frontend & IR Development:
- Oversee development of modules such as llama.py, ensuring alignment with compiler FX expectations.
- Lead FX graph transformations and lowering to EAI primitive dialect (pattern library).
- Kernel & Ops Development: Direct kernel library integration, new kernel creation, and custom NPU RV ops to extend hardware capabilities.
- Feature Ownership: Deliver compiler support for advanced features like device-to-device (D2D) communication and attention optimizations.
- Cross-Team Collaboration: Partner with hardware, quantization, runtime teams to ensure feature completeness and performance parity across new models.
- Quality & Execution:
- Establish robust QA, validation, and regression testing for compiler releases.
- Ensure timely, high-quality software delivery with focus on reliability and maintainability.
- People Management: Build, mentor, and scale a high-performing team of compiler and software engineers.
Qualifications
- 15+ years in compiler or systems software development, with 8+ years leading engineering teams.
- Expertise in AI/ML graph compilers (e.g., Torch-MLIR, TVM, XLA, Torch-FX).
- Strong understanding of neural network architectures, quantization, and hardware acceleration.
- Proven success driving complex, cross-functional software initiatives from design to release.
- Experience with MLIR/LLVM, hardware-software co-design, and open-source compiler contributions.
- Exceptional leadership, communication, and collaboration skills.
Contact:
Uday
Mulya Technologies
muday_bhaskar@yahoo.com
"Mining The Knowledge Community"
