Management Consultant AI Evaluator
DataAnnotation
Use management consulting judgment to evaluate AI models against business problems, with flexible remote project availability through DataAnnotation. Your analysis shapes better business tools.
This opportunity suits experienced Management Consultants and Strategy Consultants. You will create client-style briefs, test AI responses, and assess problem framing, analytical rigor, insight, and storyline. Work may draw on strategy, market research, communications, operations, transformation, or transactions.
Key Responsibilities:
- Write client-style briefs from familiar consulting engagements
- Run business problems through AI models
- Review responses for structure, rigor, and insight
- Flag unsupported claims, faulty numbers, and vague conclusions
- Compare responses and select the stronger recommendation
Requirements:
- Professional experience in management consulting, strategy, PMO, or deal advisory
- Fluent English at native or bilingual level
- Strong analytical and structured problem-solving skills
- Experience building and critiquing work for senior stakeholders
- Residence in Australia, Canada, Ireland, New Zealand, United Kingdom, or United States
Apply consulting standards, structured problem-solving, and senior-stakeholder judgment while evaluating AI-generated business recommendations for DataAnnotation.
#J-18808-Ljbffr$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: Management Consulting Expert Type: Contract Compensation... ...Role Responsibilities Evaluate AI-generated artifacts for usability in...SuggestedRemote jobContract workSummer workWork at office$126k - $176k per year
...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible... ...workplace policies designed to help manage personal and professional... ...opportunities to get involved with pro-bono consulting projects and Environmental, Social, and...SuggestedRemplacementFull timeWork at officeLocal areaFlexible hours- ...specialists with project-based AI opportunities for leading... ...companies, focused on testing, evaluating, and improving AI systems. This... ...vignettes for a medical AI evaluation project. General and internal... ...differential diagnosis, next-step management, and application of evidence-...SuggestedPart timeFor contractorsRemote workFlexible hours
$30 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...tasks guiding it answering questions and correcting errors. Evaluate the experience and deliverables providing concise feedback on performance...SuggestedHourly payWeekly payFull timeContract workFor contractorsSummer workRemote work$140k - $175k per year
...software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable... ...workplace policies designed to help manage personal and professional responsibilities... ...to get involved with pro-bono consulting projects and Environmental, Social, and...SuggestedFull timeInternshipWork at officeLocal areaFlexible hours$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...pipelines , and technical reports. Evaluate AI-generated or human-created work against... ...Provide detailed written justifications for evaluations and scores to maintain transparency....Remote jobContract workSummer work$80k - $138k per year
...scale? As a Cloud, Automation & AI Infrastructure Engineer, Senior Consultant, you will play a key role in... ...processes, monitoring, configuration management, testing, compliance, and deployment... ...and internal stakeholders. Evaluate emerging technologies and lead proofs...Long term contractPermanent employmentFlexible hours$80k - $138k per year
...expertise with client-facing consulting skills. On a typical engagement... ...— so downstream analytics and AI workloads are safe and auditable... ...about you This is a Senior Consultant role: 7–10 years of total... ...working under the direction of a Manager or Senior Manager. Qualifications...Permanent employmentApprenticeshipFlexible hours$80k - $138k per year
...job coaching -- Advance records and information management initiatives that build the trusted, well-governed information foundation required for AI readiness. What will your typical day look like? As a Consultant or Senior Consultant, you will help clients...Permanent employmentFlexible hours$70k - $150k per year
...Family Group: Customer Solutions The AI Enablement Manager owns the development and management of... .... The role provides specialized consulting, analysis, and coordination throughout... ...or non-routine business problems, evaluates incomplete or competing information, and...Contract workPart timeInternship$54k - $81.5k per year
...intricate regulatory environment to effectively manage and assess capital in support of their... ...Risk Management (FSRM) practice is a consulting unit that provides risk management support... ...are seeking a staff with machine learning & AI experience to join our team. Along with our...$140.6k - $190.6k per year
...Job Description: Engineering Manager, Are you passionate about transforming... ...future of legal research with AI? Join our Global Westlaw... ...practices, and continuous evaluation of quality. Design and manage... ...to get involved with pro-bono consulting projects and Environmental, Social...Full timeInternshipWork at officeLocal areaWorldwideFlexible hoursShift work$120k per year
...Gen AI Security & NIST Consultant Location: Toronto, ON – Hybrid (2–3 Days WFO) Skills: Digital... ..., reporting, and stakeholder management. Conduct AI/GenAI security, governance... ...and supply chain vulnerabilities. Evaluate controls against NIST AI RMF, ISO 42001...Permanent employment$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning... ...detail and accurate application of structured evaluation guidelines. Work independently and...Remote jobContract workSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against... ...detailed written justifications for evaluations and scores to maintain transparency and accountability...Remote jobContract workSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$39 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start$20 - $160 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour...Remote jobContract workSummer work- ...solutions at speed and scale. Our skilled consulting professionals engage with mining... ...operations and maintenance, including work management and process safety supervision ~ In-house... ...technology and leadership in cloud, data and AI with unmatched industry experience, functional...Hourly payFull timeApprenticeshipWork at officeLocal area
$84k - $175k per year
...Delivery • Lead design and implementation of AI-powered applications and agents using:... ...mitigation o Monitoring and evaluation of model outputs • Integrate governance... ...innovation About the team We are seeking a Manager – AI Engineering to lead the design and implementation...Permanent employmentFlexible hours$90k - $175k per year
...governance, enhance operational performance, manage risk, and build a modern, data driven... ...organization. As an SAP Treasury Senior Consultant, you'll play a pivotal role in helping... ...will utilize human screening combined with AI technology to help identify the skills and...Permanent employmentInternshipWork at officeFlexible hours$90k - $175k per year
...clients deliver meaningful outcomes through consulting excellence and delivery leadership.... ...and achieve strategic outcomes. You will manage stakeholder relationships, facilitate workshops... ...DevOps (ADO), and Confluence; experience in AI development projects is preferred • Able...Permanent employmentFlexible hours$80k - $138k per year
...services, technology implementation and managed services business. Our purpose is to “... ...typical day look like? As a Senior Consultant in the Change Management group, expect that no two days will be... ...with or willing to learn generative AI tools ability to obtain Federal government...Long term contractPermanent employmentWork at officeRemote workFlexible hours$110k - $160k per year
...working world for all. As AI Engineer, you will design and... ..., multi-agent coordination, evaluation frameworks, observability and... ...AI governance, model risk management, and regulatory considerations... ...integration and development. ~ Consulting or professional services...Long term contract- ...Job Description: As a Manager, SEO & AI Discovery at Merkle, you will lead SEO strategy across... ...planning, SERP feature analysis, AI Overview evaluation, LLM visibility analysis, entity and... ...Mentor and review junior work: Coach consultants and staff consultants on analysis planning...Long term contractPermanent employmentFull timeContract workTemporary workWork at officeLocal areaRemote workFlexible hoursShift work2 days per week3 days per week
$140.6k - $190.6k per year
...over time. We are looking for a Senior Manager, AI Engineering to build and lead a team... ...observability, experimentation, testing, and AI evaluation. Take ideas to production. Lead work... ...to get involved with pro-bono consulting projects and Environmental, Social, and...RemplacementFull timeWork at officeLocal areaFlexible hours$90.85k - $140.85k per year
...AI Transformation Associate Manager We Are: Accenture Song accelerates growth and value for our clients through... ...delivery alone. Develop and evaluate transformation approaches, weighing... ...solutions and assets across Strategy & Consulting, Technology, Operations, Industry X...Full timeWork at officeLocal area$108k - $158k per year
...Strategy & Operations team brings together CIO Strategy, AI Transformation, and the Project Management Office to align priorities, govern execution, and... ...and senior stakeholder management. This role suits a consultant from a Big 4, strategy, or technology consulting background...RemplacementFull timeWork at officeLocal areaFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Management Consultant AI Evaluator. Be the first to apply!
- business systems consultant Toronto, ON
- small business associate Toronto, ON
- document management consultant Toronto, ON
- risk management consultant Toronto, ON
- change management consultant Toronto, ON
- small business advisor Toronto, ON
- junior business consultant Toronto, ON
- senior business consultant Toronto, ON
- business continuity specialist Toronto, ON
- emergency management consultant Toronto, ON
