All roles

English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contrator)

Remote · USA Full-time New today

Position Summary This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:

  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.
  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.
  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.
  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States. Profile Requirements

  • Native speakers of American English born and raised in the United States.
  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.
  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.
  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.
  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.
  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.

Preferred Experience

  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.
  • Familiarity with QA workflows.
  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions. Apply To This Job Apply To This Job Apply tot his job Apply To this Job

Related roles

Product Owner - Contract

Remote · USA Full-time

Remote AI Visual Quality Evaluator

Remote · USA Full-time

Academic Evaluator

Remote · USA Full-time

Part-Time Trainer, Evaluator, and Outreach Support

Remote · USA Full-time

Remote Requirements Analyst/Product Owner

Remote · USA Full-time

Experienced Virtual Customer Experience Evaluator – Online Presence and Customer Service Evaluation Specialist (US Only)

Remote · USA Full-time

Online Survey Evaluator (Hiring Immediately)

Remote · USA Full-time

Casualty Specialist, Evaluator (Remote)

Remote · USA Full-time

Search Engine Evaluator - Part Time Remote

Remote · USA Full-time

Evaluator - Pittsburgh area

Remote · USA Full-time

Experienced Customer Service Associate – Delivering Exceptional Arenaflex Customer Experiences

Remote · USA Full-time

Vice President, Finance

Remote · USA Full-time

Behavioral Health Associate Manager Clinical Health Services - Field NJ

Remote · USA Full-time

Experienced Virtual Customer Care Chat Professional:

Remote · USA Full-time

Experienced Customer Chat Support Specialist – Entry-Level Remote Position with Arenaflex

Remote · USA Full-time

Experienced Customer Success Manager – Leading a Team to Deliver Exceptional Client Experience in Healthcare Reimbursement

Remote · USA Full-time

Sales Systems Engineer

Remote · USA Full-time

Remote Functional Nurse Practitioner - MUST be licensed in NY and NJ

Remote · USA Full-time

Huron Research Suite Business Analyst (Higher Education) - Remote (US only)

Remote · USA Full-time

Experienced Live Chat Support Specialist – Remote Customer Service Representative

Remote · USA Full-time