Job Summary:

Join our customer's team as a Business Consulting Expert specializing in AI Training, where your advanced expertise in business and proven academic or industry experience will help set new standards for evaluating AI capabilities. In this pivotal remote role, you will design complex, domain-specific assessment questions and robust evaluation rubrics to test the limits of cutting-edge frontier models.

Key Responsibilities:

• Develop and refine challenging, industry-specific business questions targeting advanced AI models, ensuring questions demand high-level strategic thinking and nuanced understanding.
• Design comprehensive rubrics to systematically evaluate AI-generated responses for credibility, accuracy, and depth.
• Collaborate with technical and non-technical stakeholders to ensure assessment relevance and domain alignment.
• Conduct rigorous analysis of AI performance, identifying gaps and potential for improvement in model reasoning and responses.
• Leverage your business acumen to create scenarios reflective of real-world and emerging industry challenges.
• Iterate on questions and rubrics based on model results, maintaining a standard that frontier models are challenged to score above 40%.
• Document methodologies, rationales, and findings with exceptional clarity in both written and verbal formats.

Required Skills and Qualifications:

• MSc., PhD, or equivalent business experience in business administration, management, or a related field; current or former professors and seasoned industry professionals are encouraged.
• Proven expertise in business consulting, management, or academic instruction at an advanced level.
• Exceptional written and verbal communication skills, with an ability to distill complex concepts succinctly.
• Demonstrated experience developing rigorous evaluation criteria, rubrics, or assessment materials.
• Strong analytical and critical thinking skills, with a track record of challenging existing norms and standards.
• Proficiency in collaborating within cross-functional teams and remote settings.
• Demonstrated commitment to continuous learning and staying abreast of AI and business trends.

Preferred Qualifications:

• Experience working directly with or evaluating large language models or AI-driven business solutions.
• Publication record or thought leadership in business strategy, consulting, or AI evaluation.
• Background in designing assessments or academic content for executive education or graduate-level programs.