Physician Reviewer, Medical AI Evaluation

About the Role

This platform serves as a bridge connecting expert contributors and domain specialists with artificial intelligence evaluation and training initiatives led by major technology firms. By vetting subject-matter experts, the organization facilitates the creation of high-quality data, safety testing, and real-world scenario development to enhance AI functionality. This Physician Reviewer position allows medical practitioners to leverage their clinical knowledge for the advancement of complex machine learning systems, entirely independent of direct patient treatment. The position centers on the assessment of intricate electronic health record summaries and related diagnostic exercises. Physicians are essential to verifying the precision and dependability of these models by engaging in organized review workflows, such as adjudication and independent blind evaluations. This remote, project-based role is structured for flexibility, enabling medical professionals to integrate contributions alongside their active clinical work from any international location.

Requirements

• You must possess an MD or DO degree and maintain an active, unrestricted medical license in the United States.
• You are required to have finished a residency program or hold current board certification.
• You must be currently practicing medicine and residing outside of the United States.
• You need significant experience in patient care, ideally at the attending physician level in fields like hospital, emergency, family, or internal medicine.
• You should exhibit excellent clinical reasoning abilities, specifically in performing differential diagnoses and utilizing evidence-based clinical practices.
• You are required to have English proficiency at a C1 level or better and provide a resume written in English.
• Previous involvement in clinical content review, medical annotation, or medical AI testing is viewed as a beneficial qualification.

Responsibilities

• Assess clinical electronic health record snippets, which include related inquiries, potential responses, and deceptive distractor options.
• Analyze diagnosis and treatment activities covering various physiological systems, such as the nervous, cardiovascular, musculoskeletal, hematologic, respiratory, reproductive, integumentary, and digestive systems.
• Rate vignettes based on their completeness, accuracy, and suitability for evaluation, while gauging the quality of misleading answer choices.
• Judge the logical consistency of reasoning chains by comparing them against documented facts and verified reasoning paths.
• Draft brief and clear explanations to justify your assessment findings.
• Engage in a formal review process that includes blind reads and expert adjudication to ensure work meets defined quality benchmarks and project deadlines.

Benefits & Perks

• You will benefit from a adaptable work schedule involving an estimated workload of 10 to 20 hours weekly during active projects.
• Payment is structured per task, with an average rate of $35 per hour and increased pay for adjudication and quality control activities.
• You will be eligible for a $50 bonus upon the successful approval of your initial production task.
• Opportunities exist for additional incentives based on the consistent delivery of high-quality work.
• This is a fully remote position that involves zero direct patient interaction and eliminates malpractice liability.