Home
SME Careers by SuperAnnotate

Healthcare Specialist, Rubric Design

  • Pay: $100 / hour
  • Contract: Contract
  • Who can apply: United States
  • Posted Sep 29, 2026

In short

Earn 100 USD per hour working remotely as a healthcare expert. You'll help make top AI models smarter and safer by testing them with questions only real specialists can answer. It's a great fit if your clinical or professional background is solid and you want flexible freelance work.

What you will do

  • Write tough, expert-level healthcare questions that expose where AI models fall short.
  • Build detailed scoring rubrics that spell out what a strong, accurate, safe answer must include.
  • Check AI answers for factual errors, weak reasoning, overconfidence and missing points.
  • Review rubrics written by other healthcare pros and give clear, precise written feedback.
  • Write gold-standard reference answers that show what expert-level work looks like.

What you need to apply

  • A professional degree, license or recognized credential in medicine, dentistry, pharmacy, nursing or another healthcare field.
  • At least 3 years of professional or clinical experience.
  • English at C1 level or above.
  • A clearly defined specialty, and the skill to write detailed evaluation rubrics.
  • Experience with AI evaluation, data annotation or rubric-based scoring is a plus.

Who can apply

Open to residents of the US only. This is a freelance contract, done remotely.

A tip from Romowork

Lead your application with your specialty and your years of clinical practice, because that's what we look for first. Show a sample of a question or a rubric you've written, even a short one, to prove you think like an expert.

Originally published on SME Careers by SuperAnnotate

Related jobs

Mercor

Regulatory Affairs Expert

Pay: $70 to $100 / hour

  • Contract: Full time
  • Who can apply: United States

Posted Nov 14, 2026

micro1

Hematology Physician

Pay: $150 to $180 / hour

  • Contract: Contract
  • Who can apply: United States

Posted Nov 13, 2026

micro1

Medicare Counselor

Pay: $20 to $50 / hour

  • Contract: Contract
  • Who can apply: Open worldwide

Posted Nov 12, 2026