Position: AI and Machine Learning Research Evaluator

Type: Contract Compensation: $105/hour Location: Remote Commitment: Flexible hours Role Responsibilities

• Critically review machine learning papers for methodological soundness, novelty, and clarity.
• Inspect Python source code and experimental logs to validate reported metrics against underlying data.
• Conduct literature reviews using tools such as Google Scholar or Semantic Scholar to identify prior work, detect plagiarism, and assess research originality.
• Provide structured feedback on "human-quality" research assessments and potential ethical or safety-related concerns.
• Submit non-identifying background details (e.g., affiliation, highest degree, publication links) to establish evaluator credibility for the study.

Qualifications Must-Have

• Strong academic or professional background in artificial intelligence, machine learning, or related research domains.
• Experience interpreting and analyzing ML papers; familiarity with top-tier venues (e.g., NeurIPS, ICLR, ICML) is preferred but not required.
• Ability to read and evaluate Python code, experimental pipelines, and quantitative logs.
• Demonstrated experience with academic literature review tools.
• High attention to detail and ability to assess complex technical arguments.

Application Process (Takes 20–30 mins to complete)

• Submit your resume or CV to begin.
• Complete a brief form outlining your technical background and relevant publications.
• Additional screening questions or sample evaluations may be requested to confirm expertise.

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
• For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. ,