All roles

English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)

Remote · USA Full-time New today

Position Summary

  • This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:
  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.
  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.
  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.
  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.

  • Profile Requirements
  • Native speakers of American English born and raised in the United States.
  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.
  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.
  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.
  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.
  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.
  • Preferred Experience
  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.
  • Familiarity with QA workflows.
  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions. Apply To This Job

Related roles

AI Training Generalist

Remote · USA Full-time

AI Trainer - Advanced HTML/ CSS Developers

Remote · USA Full-time

Remote Fintech Project Manager

Remote · USA Full-time

Remote Social Media Manager: Fintech for Financial Wellness

Remote · USA Full-time

Remote Inbound Sales Agent (Fintech)

Remote · USA Full-time

Remote Project Leadership - Biotech

Remote · USA Full-time

Mechanical Engineer-Part Time Remote / Telecommute Jobs

Remote · USA Full-time

Remote Mechanical Design Engineer - R&D

Remote · USA Full-time

[Remote] Electrical Engineer - Industrial Market

Remote · USA Full-time

REMOTE Sr Electrical Engineer- PE- Heavy Industrial $140-170K

Remote · USA Full-time

Experienced Chat Support Supervisor – Healthcare Operations & Patient Experience Team Leadership

Remote · USA Full-time

Senior Consultant - Pharmacovigilance/Safety Systems Implementation (Remote)

Remote · USA Full-time

Technical Analyst-Bespoke

Remote · USA Full-time

Experienced Virtual Customer Service Associate – Delivering Exceptional Support and Solutions to arenaflex Clients

Remote · USA Full-time

Director of Business Development (DoD Fourth Estate)

Remote · USA Full-time

ServiceNow Practice Lead

Remote · USA Full-time

Experienced Full Stack Customer Service Representative – Remote Work Opportunity with arenaflex

Remote · USA Full-time

Science Lab Safety Trainer - Contractor

Remote · USA Full-time

Senior Revenue Accountant

Remote · USA Full-time

Experienced Data Entry Representative (Remote) – Join arenaflex’s Dynamic Team!

Remote · USA Full-time