Physician, MD/DO – Medical AI Evaluation

About the Role

This platform links specialized professionals with initiatives focused on training and assessing artificial intelligence for major tech firms. As a subject-matter expert, you will assist in enhancing the safety and logical functions of AI models by applying your medical background. The role involves a marketplace-based system for vetting contributors to ensure expert-level clinical knowledge is used for data generation and complex scenario evaluation. You will influence how clinical data is interpreted by AI in practical applications. Working remotely, you will evaluate model performance, detect clinical errors, and confirm the efficacy of these systems. This is a flexible, part-time, project-based engagement for experienced physicians aiming to leverage their clinical skills outside of traditional patient care settings, joining a community dedicated to improving healthcare technology reliability.

Requirements

• You must be a currently practicing physician with an MD or DO qualification.
• You must reside outside of the United States.
• You are required to hold an active, unrestricted US medical license, which is subject to monthly verification.
• You should hold board certification or have finished residency, with preference given to those having recent attending-level patient care experience.
• You must possess extensive diagnostic and treatment knowledge across various specialties, including hospital, emergency, family, or internal medicine.
• You are expected to show high-level clinical reasoning, including the ability to utilize evidence-based standards and perform differential diagnoses.
• You must be proficient in written English at a C1 level or higher, and your submitted CV must be in English.
• You are required to successfully complete all necessary project qualification steps.
• This role is not open to medical students, individuals without a clinical background, non-physician clinicians, or unlicensed graduates.

Responsibilities

• Review clinical electronic health record vignettes, evaluating the questions, suggested responses, and potential pitfalls.
• Analyze various medical cases across multiple body systems, such as musculoskeletal, cardiovascular, reproductive, and respiratory health.
• Evaluate the precision and comprehensiveness of vignettes, confirming if the details support an accurate diagnosis and reviewing the quality of logical reasoning.
• Correct reasoning paths, compose brief justifications for your evaluations, and ensure AI-generated results remain faithful to the original data.
• Participate in a workflow that includes three independent blind readings and physician-led adjudication.
• Verify and improve AI system outputs to meet project deadlines and the specific requirements defined by technology partners.

Benefits & Perks

• Enjoy a flexible schedule that lets you control your remote workload.
• Receive compensation per task, equating to roughly $35 hourly, with bonus incentives for top-tier performance and elevated pay for adjudication and quality assurance work.
• Get a one-time $50 reward for onboarding upon the approval of your initial production task.
• This work is purely administrative with no patient interaction or malpractice risk, offering a safe way to complement your regular medical practice.