Job Summary

Join Mercor, a company at the forefront of AI technology, as a Healthcare AI Evaluator in a remote role. Partners include Benchmark, General Catalyst, and more.

Detailed Job Offer

Mercor is on the lookout for a dedicated Healthcare AI Evaluator to work remotely. The candidate will contribute to evaluating AI models within healthcare contexts, ensuring their responses are accurate, thorough, and suitable for real-world application.

Tasks and Responsibilities

• Draft and refine prompts to guide AI model behavior in healthcare scenarios.
• Evaluate model-generated responses for accuracy, reasoning, clarity, and completeness.
• Perform fact-checking of medical claims using authoritative sources.
• Annotate responses to showcase strengths and areas for improvement.
• Assess tone and suitability of AI responses for healthcare use.

Requirements

• 5+ years of healthcare experience with a relevant degree (MD, DO, RN, etc.).
• Expertise in healthcare sub-domains such as Clinical Care or Public Health.
• Proficient in using large language models (LLMs).
• Excellent written communication skills.
• Attention to detail in clinical reasoning and explanation evaluation.

Contact and Application

Please upload your resume and complete an AI-based interview to apply. For further assistance, email us at support@mercor.com.