Role Overview:

We are hiring for one of our clients, seeking a Rubrics Expert to work on a contract basis. In this role, you'll apply your expertise to help train next-generation AI systems by designing, developing, and refining comprehensive rubrics tailored to AI training and assessment needs. Your work will shape how models learn, reason, and perform through high-quality, real-world input. This is a unique opportunity to contribute to the development of frontier AI models, enabling high-quality contributions at scale.

Key Responsibilities:

• Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs.

• Analyze task performance and provide structured, actionable feedback to guide improvement and calibration.

• Establish and document effective scoring methodologies that ensure consistency, fairness, and high-quality outcomes.

• Lead calibration sessions to align evaluators and maintain rubric integrity across projects.

• Validate assessment outputs for accuracy, reliability, and alignment with project objectives.

Required Skills & Qualifications:

• Performance analysis and feedback structuring expertise, with the ability to analyze task performance and provide actionable feedback.

• Rubric design and development skills, with the ability to create comprehensive rubrics tailored to AI training and assessment needs.

• Scoring methodology and calibration expertise, with the ability to establish and document effective scoring methodologies.

• Assessment validation and quality control skills, with the ability to validate assessment outputs for accuracy and reliability.

• Domain expertise in a relevant field, such as finance, healthcare, or engineering, with the ability to apply real-world knowledge to AI training and assessment.

More About the Opportunity:

This role offers a unique opportunity to work with a global leader in the AI industry, contributing to the development of frontier AI models that improve how models perform across various domains. As a Rubrics Expert, you'll have the chance to work with a global network of experts and make a meaningful impact on the development of AI systems.

Equal Opportunity Employer:

We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.