Home
micro1

Member of Technical Staff, Coding Agent Research & Evaluations

  • Pay: $8 to $9 / hour
  • Contract: Full time
  • Who can apply: Open worldwide
  • Posted Nov 7, 2026

In short

Full-time, remote, and paid 8 to 9 USD per hour: this micro1 role lets you work remotely while helping shape how coding agents get tested and improved. If you know your way around Python or C++ and enjoy designing tests for AI, this one is for you.

What you will do

  • Design evaluation frameworks for coding agents, including benchmarks, scoring methods, rubrics and quality standards.
  • Build high-quality datasets and evaluation protocols that show how reliable coding models really are.
  • Dig into how models behave, spot their repeated weak points and turn them into fixes for training and testing.
  • Create tools and pipelines that run large-scale experiments, data generation and review workflows.

What you need to apply

  • Strong software engineering skills in Python, C++ or a similar programming language.
  • At least 3 years of experience in software engineering, machine learning, AI research, evaluation or a related technical field.
  • Experience designing, reviewing or validating technical tests, benchmarks, coding tasks or evaluation methods.
  • Clear written and spoken communication, so you can explain technical findings to different audiences.

Who can apply

Open worldwide, with no country restriction stated. You need a minimum of 3 years of relevant experience.

A tip from Romowork

We suggest putting a benchmark, evaluation or testing project you have built at the top of your application, with a short explanation of how it works.

Originally published on micro1

Related jobs

SME Careers by SuperAnnotate

Document Annotation Specialist (PDF)

Pay: $3 to $10 / hour

  • Contract: Contract
  • Who can apply: Indonesia, Philippines, Pakistan +3

Posted Nov 10, 2026

micro1

AI Trainer (ML Engineering)

Pay: $60 to $120 / hour

  • Contract: Contract
  • Who can apply: Open worldwide

Posted Nov 9, 2026

micro1

Open Source Contributor

Pay: $60 to $120 / hour

  • Contract: Contract
  • Who can apply: Open worldwide

Posted Nov 8, 2026