Physician MD/DO – Medical AI Evaluation

About the Role

This platform acts as a link between domain experts and the growing requirements of artificial intelligence. By pairing skilled contributors with tech innovators, the organization supports initiatives focused on enhancing AI safety, performance, and logical reasoning. This position allows medical experts to shape the caliber of clinical AI through expert assessments and authentic scenarios, which verify the dependability of health-focused model results. In this capacity as a Physician focused on medical AI assessment, you will apply your professional knowledge to initiatives demanding high levels of diagnostic insight and clinical accuracy. Operating within a cooperative structure featuring strict peer assessment, you will ensure that clinical logic and data precision align with high-level standards. This role is suited for seasoned physicians seeking to utilize their medical expertise in a remote and flexible setting, aiding technological progress while moving away from clinical patient interactions.

Requirements

• You must hold a valid medical degree, either an MD or DO, and be a practicing physician living outside of the US.
• You are required to maintain an unrestricted US medical license, which will be subject to verification upon hiring and every month following.
• You must have finished residency and obtained board certification; individuals at the attending level with recent direct patient care experience are preferred.
• Expertise in internal, emergency, family, or hospital medicine is necessary to provide the multi-system treatment and diagnostic knowledge required for these assessments.
• You must exhibit advanced clinical reasoning capabilities, such as the capacity to utilize evidence-based standards and handle intricate management procedures.
• Proficiency in English at a C1 level or above is required for writing, and you must provide your CV in English.
• This position is unavailable to non-physician clinicians, medical students, or graduates who are not licensed.

Responsibilities

• You will assess clinical vignettes from electronic health records, including the corresponding questions and answers, to verify they are accurate and thorough.
• Your primary tasks involve grading benchmark items for the quality of clinical reasoning, evaluating the validity of proposed answers, and spotting potential distractors or traps.
• You will confirm that sequences of reasoning are logically consistent and grounded in the data provided in every vignette.
• When needed, you will refine reasoning traces and draft brief, precise rationales to back your assessments.
• The workflow includes involvement in a three-blind-read method, followed by physician-managed adjudication to reach final conclusions.
• You are required to finish all project certifications, follow defined project schedules, and satisfy the specific quality standards outlined for every assignment.

Benefits & Perks

• This position provides substantial flexibility, with a workload between 10 and 20 hours per week and the option to work remotely on your own schedule.
• You will have no direct interaction with patients and will face zero malpractice risks.
• Pay includes a $50 introductory bonus upon the acceptance of your initial production task, alongside extra incentives for superior performance.
• Assignments involving adjudication and QA are paid at a premium compared to standard assessment work.