AI Conversation Evaluator
Pay: $40 to $70 / hour
- Contract: Contract
- Who can apply: Open worldwide
Posted Nov 12, 2026
The Bilingual Hindi Generalist Expert evaluates advanced AI models by writing sensitive prompts and classifying conversations in Hindi and English. Applicants must possess native fluency in Hindi, strong written reasoning, and a bachelor's degree.
Description in English, as published by Mercor.
About the role
We're hiring proficient bilingual speakers (English & Hindi) to help make advanced AI models safer. You'll apply your language fluency and cultural judgment to evaluate and strengthen how these models handle sensitive topics in Hindi. No prior AI/ML experience is required, we'll train you on the workflow.
What you'll do
Write expert-level prompts in Hindi across a range of sensitive subject areas.
Apply structured guidelines to classify prompts and conversations.
Flag adversarial phrasings and escalation patterns, and document the reasoning behind your judgments.
What we're looking for
Native or near-native fluency in Hindi, plus business-level written English.
A bachelor's degree, completed or in progress.
Strong written reasoning and a high level of attention to detail.
Sound judgment around sensitive and dual-use information.
Nice to have
Based in India or the wider South Asia region. This is a preference, not a requirement, applicants based elsewhere are welcome.
Experience reviewing, grading, or red-teaming written or technical content.
Background in trust and safety, content moderation, policy evaluation, or adversarial testing.
Project Timeline
Pay: $40 to $70 / hour
Posted Nov 12, 2026
Posted Nov 11, 2026
Pay: $20 to $40 / hour
Posted Nov 9, 2026
Pay: $20 to $40 / hour
Posted Nov 9, 2026
Pay: $10 to $35 / hour
Posted Nov 7, 2026
Pay: $70 to $120 / hour
Posted Nov 5, 2026