Job Description
In this hourly, remote contractor role, you will review AI-generated medical responses and/or generate expert healthcare content, evaluating reasoning quality and step-by-step clinical problem-solving while providing precise written feedback. You will assess solutions for accuracy, clarity, and adherence to the prompt; identify errors in clinical methodology or conceptual understanding; fact-check medical information; write high-quality explanations and model solutions that demonstrate correct reasoning; and rate and compare multiple responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the worldโs largest AI companies and foundation-model labs. Your healthcare expertise directly helps improve the worldโs premier AI models by making their clinical and public-health reasoning more accurate, reliable, and clearly explained.
Key Responsibilities:
โข Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects.
โข Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance.
โข Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases.
Your Profile:
โข Bachelorโs degree (or higher) in Medicine (MD/DO), Nursing, Public Health (MPH), Health Sciences, or Allied Health, with strong grounding in Epidemiology, Clinical Medicine, Healthcare Systems, and Patient Care.
โข 5+ years of professional experience in Nursing, Public Health, Health Sciences, or Allied Health.
โข Confident in clinical reasoning (differential diagnosis, risk stratification, red-flag recognition) and explaining why a conclusion follows from the evidence.
โข Strong understanding of disease processes, patient care concepts, public health principles, healthcare systems, and medical terminology.
โข Exceptional attention to detail when fact-checking medical content and identifying unsafe assumptions, missing contraindications, or misinterpretation of tests; Minimum C1 English proficiency.
โข Comfortable evaluating answers for internal consistency (timelines, physiology, dosing logic), appropriateness for setting (ED vs outpatient), and patient safety implications.
โข Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
โข Previous experience with AI data training/annotation, clinical documentation review, utilization review, or healthcare editorial QA is strongly preferred.
Ready to Apply?
Don't miss this opportunity! Apply now and join our team.
Job Details
Posted Date:
December 24, 2025
Job Type:
Healthcare
Location:
Tarboro, North Carolina, United States
Company:
SuperAnnotate
Ready to Apply?
Don't miss this opportunity! Apply now and join our team.