Senior Director of Compiler Engineering

Bangalore

We are seeking a Director of Compiler Engineering to lead the design, development, and delivery of the next-generation AI compiler and software stack powering our custom inference accelerators. This role combines deep compiler expertise, hands-on technical leadership, and organizational ownership across compiler, runtime, and QA teams to enable cutting-edge model deployment and performance.

Key Responsibilities

• Technical Leadership: Define the compiler roadmap and architecture, driving innovation in graph compilation, lowering flows, and performance optimization.
• New Model Enablement: Own end-to-end bring-up for new model families (e.g., Llama, MoE) from FX capture through runtime execution.
• Frontend & IR Development:
• Oversee development of modules such as llama.py, ensuring alignment with compiler FX expectations.
• Lead FX graph transformations and lowering to EAI primitive dialect (pattern library).
• Kernel & Ops Development: Direct kernel library integration, new kernel creation, and custom NPU RV ops to extend hardware capabilities.
• Feature Ownership: Deliver compiler support for advanced features like device-to-device (D2D) communication and attention optimizations.
• Cross-Team Collaboration: Partner with hardware, quantization, runtime teams to ensure feature completeness and performance parity across new models.
• Quality & Execution:
• Establish robust QA, validation, and regression testing for compiler releases.
• Ensure timely, high-quality software delivery with focus on reliability and maintainability.
• People Management: Build, mentor, and scale a high-performing team of compiler and software engineers.

Qualifications

• 15+ years in compiler or systems software development, with 8+ years leading engineering teams.
• Expertise in AI/ML graph compilers (e.g., Torch-MLIR, TVM, XLA, Torch-FX).
• Strong understanding of neural network architectures, quantization, and hardware acceleration.
• Proven success driving complex, cross-functional software initiatives from design to release.
• Experience with MLIR/LLVM, hardware-software co-design, and open-source compiler contributions.
• Exceptional leadership, communication, and collaboration skills.

Contact:

Uday

Mulya Technologies

muday_bhaskar@yahoo.com

"Mining The Knowledge Community"