AI Evaluation Specialist

Urgent Hiring!!!

AI Evaluation Specialist — remote, contractor.

This role is for professionals who write with precision, think in structured frameworks, and catch what others miss. You'll be helping train frontier AI systems by designing evaluation tasks and grading rubrics based on your real-world expertise.

You're the right fit if you have 3+ years in any of these roles:
— Paralegal or legal assistant
— Executive or administrative assistant
— Technical writer or QA analyst
— Research assistant, librarian, or document specialist
— Junior analyst with a focus on structured reporting

What the work involves:
— Designing self-contained evaluation tasks with clear grading criteria
— Observing and documenting AI behavior with precision in English
— Iterating on rubrics based on feedback from the team
— Working independently on ambiguous, loosely defined projects

Requirements — please read before applying:
✔️ Minimum 3 years in a role that required precise, structured writing
✔️ Native or fluent English — succinct, specific, unambiguous
✔️ Experience applying or designing rubric-based evaluation or scoring frameworks
✔️ Strong computer literacy across SaaS tools, browsers, and document platforms
✔️ High self-direction — you own your work without needing constant direction

No AI experience needed. Your domain expertise is what this role is built around.

If you meet the requirements above and this sounds like you, we'd love to hear from you.

👉 Send us your CV to

Subject line: AI Specialist - (Your First Name)

Rate: $20-$35 USD per hour for fulltime role so 30-40hrs a week

Create a 60-second Loom video and send us the link along with your CV.

Please apply only if you genuinely meet the experience requirements. Quality over volume — we review every application carefully. No DM.

Looking forward to your applications!
📌 Remote · Worldwide