About Deccan AI

Deccan AI is a high-growth, venture-backed AI model training and evaluation company headquartered in the Bay Area. Founded by alumni of IIT Bombay, IIM Ahmedabad, and ex-Google , we partner with the world’s top AI frontier labs including Google DeepMind, Snowflake , and several cutting-edge research groups. We are backed by Prosus Ventures , and our India office is based in Hyderabad.

We’re not just participating in the AI race we’re building the infrastructure that powers it.

With 1M+ global experts, advanced automation, and vertically integrated platforms, we deliver the gold-standard data that world-class AI models rely on. The AI data annotation market is exploding set to quadruple by 2032. The opportunity? Massive, and you can help define the future

**.

Backgrou**

ndThe ML Researcher plays a critical role in keeping the organization at the forefront of AI innovation through deep, end-to-end research. This role is focused on identifying emerging research directions, designing novel AI benchmarks, and creating high-quality evaluation datasets aligned with both cutting-edge research and organizational prioritie

s.The ML Researcher bridges the gap between theoretical research and practical application by translating insights from the latest AI papers into actionable benchmarks and evaluation frameworks. The role emphasizes deep research, synthesis of academic and industry findings, and the design of solutions that meaningfully advance AI systems—particularly in agent frameworks, machine learning models, and emerging AI paradigm

**s.

Purpose of the R**

oleThe primary objective of the ML Researcher is to conduct comprehensive AI research and desi gn novel, scalable, and real-world–relevant benchmarks and evaluation datas ets. The role aims to push beyond existing evaluation practices by defining new criteria that better measure the capabilities and limitations of modern AI syste

ms.

Role Over

viewWe are looking for an ML Researcher focused on human alignment and real-world usability evalua tion of AI systems. This role designs benchmarks and datasets to assess how well models align with human intent, preferences, safety norms, and day-to-day task expectati

ons.Key Responsibili

• tiesResearch human-aligned AI, instruction-following, preference modeling, and behavioral consiste
• ncy.Des ign novel benchm arks evaluating helpfulness, harmlessness, honesty, and intent alignm
• ent.Propose evaluation datasets reflecting real-world, everyday human ta
• sks.Define alignment-focused metrics (preference match, deviation, refusal quality, et
• c.).Produce clear benchmark and evaluation documentation for implementation te

ams.Delivera

• blesHuman-alignment benchmark propo
• salsEvaluation datasets for everyday task scena
• riosAlignment metric definitions and testing guidel

inesRequired Sk

• illsStrong grounding in AI safety, alignment, RLHF conc
• eptsResearch experience in NLP, agents, or human-centere
• d AIExcellent documentation and research synthesis sk

ills