Summary:
We are seeking a Principal or Senior AI Scientist to join our AI Evaluation Unit. As part of our team, you will play a vital role in designing and delivering efficient and pragmatic research studies and product evaluations for our clients, enabling them to better understand AI product performance and risk/benefit profiles. Your role will involve collaborating with cross-functional teams, including software developers, AI engineers, regulators, healthcare professionals, as well as sales and marketing professionals.

Responsibilities

• Lead AI evaluation studies to assess performance, safety, and real-world impact of healthcare AI solutions.
• Develop and refine assessment frameworks to support provider organizations in AI adoption.
• Collaborate with cross-functional teams, including AI engineers, regulators, and healthcare professionals, to ensure rigorous evaluations.
• Analyze healthcare datasets to assess AI reliability, robustness, and bias.
• Translate technical findings into clear, actionable insights for clients and stakeholders.
• Stay informed on regulatory and industry developments to align AI assessments with best practices.
• Support business development by advising on AI evaluation strategies and engaging with clients.

Qualifications & Experience

• Registered healthcare professional.
• Chief Investigator or PI experience in delivering academic evaluations of medical AI technology.
• Strong knowledge of AI model assessment techniques, bias detection, and explainability.
• Familiarity with healthcare regulatory requirements (MHRA, FDA, etc.).
• Proficiency in data analysis and programming (Python, SQL) is preferred.
• Experience working with healthcare data (EHR, imaging, genomics).
• Strong communication skills to translate technical findings for diverse stakeholders.
• Ability to manage multiple projects part-time while balancing clinical commitments.

Principal Level: Expected to lead evaluations, shape strategy, and drive innovation in AI assessment.
Senior Level: Focused on delivering high-quality evaluations and contributing to methodology development.

Benefits

• Flexible remote working (in the UK), with monthly get-togethers for the entire company.
• Competitive salary package.
• Participation in shared company bonus scheme.
• Health and wellbeing package.
• Professional development opportunities, including academic publishing and conferences.
• 28 days holiday (+ 8 statutory bank holidays).

Our Interview Process

We try to conclude the interview process within a few hours, and you can expect sessions covering these topics:

• Scientific: evaluation design, statistical methods, clinical trial methods, “ground truth”, proxy measures, digital biomarkers.
• Culture and leadership: focused on expectations of the role, personal qualities, handling difficult situations, and how you work with others.
• Product and domain: AI product architectures, common failure modes, clinical workflows, working with healthcare professionals, and healthcare IT.

How to Apply

Send your CV and a short note (or video!) telling us why you’d be excited to work with Newton’s Tree to info@newtonstree.com. Bonus points if you share a piece of content you’ve made or a project you’ve led.

No recruiters or agencies, please.