Freelance Healthcare Expert AI Evaluator

Uber AI Solutions is Uber's marketplace connecting skilled freelancers with Generative AI researchers and product teams working on cutting-edge AI systems. We partner with independent contractors to support large-scale model evaluation, alignment, and quality initiatives.

As a Freelance Healthcare Expert, you will pair genuine clinical expertise with hands-on GenAI-evaluation experience to design challenging, realistic prompts backed by source documents such as published clinical practice guidelines, payer coverage policies, drug monographs, and de-identified clinical documentation. You will then probe where the model breaks, and encode expert judgment into precise, gradable rubrics and a canonical 'golden' answer. You own an end-to-end evaluation task from prompt design through reviewer sign-off.

This is hands-on analytical work — evaluating clinical reasoning against source documents and deriving determinations, not delivering care. No patient care is provided, no clinical advice is given, and no protected health information is handled. All source materials are published or de-identified.

What you'll work on

• Apply your clinical expertise to help create and evaluate complex AI prompts and responses.
• Conceptualize and draft realistic, multi-step prompts that mirror real clinical assignments and require guideline application, cross-referencing, and reconciliation across multiple source documents.
• Identify and document genuine model failures by writing specific, objective, and actionable explanations.
• Build comprehensive evaluation rubrics that trace each required input through dependent criteria and carefully separate extraction from determination.
• Produce fully correct, deliverable-quality golden responses that satisfy all criteria using standard clinical documentation conventions.
• Complete our onboarding process and strictly follow the disciplined authoring and review workflow for each task.
• Closely follow guidelines, run AI quality checks on your own work, and resolve any issues in the feedback loop before final submission.

Engagement details

• Location: Remote (United States)
• Engagement Type: 1099 Freelance / Independent Contractor, through the Uber AI Solutions platform
• Engagement Duration: Approximately 40 hours over 1-2 weeks

Who we're looking for

• Active US clinical license (MD, DO, RN, NP, PA, or PharmD) or Ph.D. from an accredited institution.
• 5+ years of post-licensure experience in clinical practice, medical research, or healthcare compliance.
• Demonstrated ability to read primary source documents (clinical practice guidelines, payer coverage policies, drug monographs, clinical literature) and apply them to patient scenarios across multi-document sets.
• Familiar with guideline applicability criteria, coverage and medical necessity determination, and clinical documentation standards.
• Comfortable working independently on detail-oriented tasks.
• Strong analytical and written communication skills.
• Prior hands-on experience with GenAI / LLM evaluation and prompt engineering, rubric or golden-answer authoring, data annotation, RLHF, red-teaming, or model quality assessment.
• Experience in clinical documentation improvement (CDI), prior authorization review, or utilization management.
• Health informatics background or medical coding credential (CPC, CCS, or CDIP).

Why this matters

Your expertise will help improve how AI systems handle complex healthcare topics, making outputs more accurate, reliable, and better aligned with real-world clinical reasoning.