Domain Advisor Consultant (Subject Matter Expert)
Engagement Type: Business-to-Business (B2B) / Independent Contractor Location: Remote The Opportunity: Define the "Ground Truth" for Generative AI We are looking to engage elite Subject Matter Experts (SMEs) to partner with us on high-impact AI evaluation and training projects. We are not looking for generalists; we are seeking established authorities—the top 1% in their respective fields—who are eager to apply their deep domain knowledge to shape the reasoning, accuracy, and safety of next-generation Large Language Models (LLMs). This is a consulting engagement for independent professionals who want to help define what "perfection" looks like in their industry. You will not just be grading AI; you will be architecting the "Gold Standard" rubrics that teach models how to think like an expert. Scope of Services & Deliverables This engagement focuses on high-level advisory and specialized analysis. Consultants will operate under a Statement of Work (SOW) to provide the following deliverables:
- Rubric Architecture: Review and advise on the quality criteria used to evaluate AI outputs. You will determine if the AI’s logic holds up to professional scrutiny in your field.
- "Golden" Data Curation: Create, edit, or certify "Golden Tasks"—benchmark examples of perfect prompts and responses that serve as the ground truth for model training.
- Expert Gap Analysis: Analyze model failures (hallucinations, logical fallacies) and provide technical breakdowns of why the model failed and how a human expert would have approached the problem.
- Advisory on Complexity: Consult on the difficulty and nuance of specific prompts to ensure the AI is being tested against sufficiently rigorous scenarios.
Consultant Profile: Who We Are Looking To Partner With We are seeking independent business owners, freelancers, and academic leaders who possess:
- Elite Domain Mastery: Advanced degrees (PhD, MD, JD) or equivalent industry-recognized status (e.g., Senior Principal Engineer, Published Author, Award-Winning Creative).
- Professional Autonomy: You currently operate as an independent consultant or freelancer and have your own workflows, equipment, and professional methodology.
- Interest in Shaping Technology: While prior experience in AI evaluation is a bonus, it is absolutely not required. We want industry veterans who are eager to set the "gold standard" for how AI should operate within their specific profession.
- Articulate Reasoning: The ability to not just know the right answer, but to articulate the reasoning process clearly in writing.
Engagement Structure & Compliance This is a strictly non-employee, independent contractor opportunity designed for professionals who manage their own business operations.
- Engagements are project-based and non-exclusive, allowing you to continue working with other clients
- You have flexibility in how you complete deliverables, in alignment with project requirements
- Scope, timelines, and compensation are defined in advance for each assignment
- Remote & Independent: You provide your own workspace and equipment.
- Global Compliance: Candidates must be properly registered to operate as independent contractors in their country of residence.
Why Top-Tier Consultants Partner With Us
- Intellectual Challenge: This is rare, cerebral work that challenges you to deconstruct your own expertise to train a machine.
- High-Value Impact: Your input directly influences the safety and capability of models used by millions.
- Flexible Revenue Stream: Supplement your primary consulting business with flexible, high-value project work.
Apply tot his job Apply To this Job