Ad Designer - AI Creative Evaluation (Contra Labs)
Temporary
Contra Labs
About Contra Labs
Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying the patterns behind what gets created, what gets chosen, and what resonates. We believe human input will always be at the center of net new creation, and our mission is to help shape technology so human creativity can be amplified to create what today is unimaginable.
By joining the Contra Labs network you gain access to paid projects with some of the most innovative companies building the next generation of creative and AI-powered tools.
How It Works
This is an application to join the network and be eligible for roles as they arise. Projects are staffed on an as-needed basis, typically 5 to 10 hours at a time, though some may extend into longer engagements. In unique cases, we may have full-time roles available as well. When a project matches your skill set, we'll reach out with details and timeline.
To Join the Network
- Portfolio review - We'll assess your Contra profile and portfolio for strength in product design, specifically across desktop and mobile applications.
- Record a 30 second intro video - Share a quick 30 second introduction so we can get to know you.
- Complete profile - Once you’ve applied, we recommend completing your profile for better job matches and setting up your wallet so you can get paid when a job comes through.
What You May Work On
- Evaluate AI-generated advertisements and marketing creative across digital, social, display, email, and other campaign formats.
- Provide structured feedback on messaging, composition, branding, hierarchy, visual storytelling, and overall creative effectiveness.
- Help define benchmarks for what makes advertising creative engaging, memorable, on-brand, and likely to perform.
- Compare multiple creative approaches, identify strengths and weaknesses, and explain why certain ads are more compelling than others.
- Contribute to research on how human creative judgment can improve the next generation of AI-powered advertising and marketing tools.
What We're Looking For
- A strong portfolio of advertising, marketing, or brand creative across digital channels.
- Experience creating campaigns, paid social ads, display creative, email marketing assets, or other performance and brand marketing materials.
- A sharp eye for visual communication, messaging, branding, and creative strategy.
- The ability to articulate thoughtful, actionable feedback on both visual execution and marketing effectiveness.
- Strong creative instincts and an understanding of current advertising trends, consumer behavior, and digital creative best practices.
- Comfort working in fast-paced, experimental environments. Experience with AI creative tools is a plus.
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Ad Designer - AI Creative Evaluation (Contra Labs) in Remote vacancy
- ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying...CreativeFull timeContract work
- ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying...CreativeContract workImmediate start
- ...About Contra Labs Contra Labs sits at the intersection of human creativity and technology. We partner with leading product companies to improve the creative tools that... ...a range of subjects and styles. # Skills evaluation - You’ll complete a structured videography submission...CreativeFull timeContract work
- ...next steps. Our partner is looking for an Ad Creative Strategist (Freelance) based in Canada.... ...collaborate with creators, copywriters, designers, motion developers, and media buyers to... ...execute structured creative testing cycles, evaluate campaign results, and refine concepts...CreativeFull timeFreelanceRemote work
- ...Evaluate AI model safety by designing adversarial test prompts and classifications. About Turing: Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced...CreativeOngoing contractPart timeFor contractors
- ...partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Canada. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability infrastructure that ensures...Full timeRemote work
- © 2026 Smart Ecosystems. All rights reserved.Contract work
- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios • Analyze model outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements...Contract work
- ...We're building a research cohort of senior domain experts in creative technology — spanning audio, design, and UX — to help evaluate how frontier AI models reason about hard, real-world expert-level problems. This is research-and-evaluation work, not production engineering...CreativeContract work
usd16 per hour
...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration. Job Type... ...naturalness, and cultural appropriateness. - Providing structured evaluations and feedback following the project instructions and quality...Hourly payDaily paidFull timeFreelanceImmediate startRemote workFlexible hours- ...Transformative Brand Growth. We’re building the AI Growth Engine that powers the next... ...Responsibilities At Trafilea, creative isn’t just about making great-looking ads. It’s about building a system that... ...~ Bachelor’s degree in Graphic Design, Marketing, Business,...CreativePermanent employmentFull timeRemote work
$75 - $90 per hour
...years Location: United States | Canada + 21 more Help a top AI lab evaluate and improve large language models through security-focused... ...code review, coding annotation, LLM/code evaluation or benchmark design. Knowledge of another programming language. Team...Long term contractContract workRemote work$13 per hour
...Location: Argentina | Belize | Bolivia + 15 more Help evaluate how an AI assistant uses information from connected Google apps to respond... .... • Follow project guidelines for consistent, confidential evaluation work. Important account-access requirement • This project...Hourly payContract workFor contractorsRemote work- ...Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for university students,... ...scenarios Responsible AI behaviour Domain-Specific AI Evaluation Healthcare & Medicine Law Finance, Economics &...Part time
$40 per hour
...review your choices. Accept All Customize Settings Reject All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr Depending on the project Bachelor's Remote Part-time Flexible...Part timeRemote workFlexible hours- ...Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the... ...done in practice. Benchmarks and domain depth: Design challenging finance tasks and evaluation sets, and help build finance-specific skills and tools...Full timeContract workPart timeFreelanceLive InManual laborRelocationRelocation package
$35 - $49 per hour
...Put frontier AI models through real process engineering problems and mark... ...About the role Sovrano AI builds evaluation and training data for frontier AI labs, and this project tests how well... ...experience with real hands-on work: process design, plant and operations engineering,...Hourly payContract workPart timeFor contractorsManual laborRemote workShift work- ...contractor Remote · Contract · Radiological Science · Health Physics · AI Safety · CBRN What this pays Rates are set by the client... ...a figure we cannot stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US, Canada, UK, Europe,...Hourly payContract workFor contractorsRemote work
- ...we build for the long term. The Associate Creative Director will play a pivotal role in shaping... ...a blend of strategic thinking, hands-on design expertise, and collaboration across multidisciplinary... ...web and digital experiences can be in an AI-first world — moving beyond conventional...CreativeLong term contractFull timeRemote work
$55 - $100 per hour
...Pay: $55–100/hour You'll evaluate AI-generated responses to legal questions — covering case analysis, statutory interpretation, procedural questions, and litigation strategy. Your primary task is assessing whether a model's answer reflects sound legal reasoning, accurate...Contract work- ...What You'll Do Apply your subject-matter expertise to advanced AI training and evaluation work Develop or evaluate challenging problems within your area of expertise Assess AI-generated reasoning for technical accuracy and identify subtle errors or failure modes...Contract workImmediate startRemote workFlexible hours
$30 - $90 per hour
...backgrounds to support quality control on AI reasoning datasets. This role requires professional... ...Nice to Have Experience with AI/ML evaluation or data annotation Background in AI,... ...on location, experience, and educatioanl background). Company: Leading AI Lab...Contract workRemote work10 hours per weekFlexible hours$80 per hour
...to $1.6k/week We're working with a leading foundational AI lab to find experienced creative directors and art directors who can help train their... ...presentation and slide deck tasks. We're looking for CDs and ADs with 6+ years presenting creative work at top agencies or...CreativeContract workImmediate startRemote workFlexible hours- ...What You'll Do Review real user interaction traces with an AI shopping assistant Identify logical failures, inaccuracies, or poor... ...verifiers to judge response quality Commit to 20+ hours per week of evaluation work on our internal platform Who Should Apply Experience...Contract workFor contractorsRemote work
$70 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our...Hourly payPermanent employmentPart time10 hours per week- ...develop systems to enhance frontier AI capabilities. About Turing:... ...accelerator for frontier AI labs and a trusted partner for... ...enterprises. Our environments evaluate and improve AI models on complex... ...investigate high-impact questions, design rigorous experiments, build research...Contract workPart timeFor contractors
$20 - $25 per hour
...engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that...Hourly payPart timeFixed term contract- ...Create and evaluate board game tasks to enhance AI reasoning skills. About Turing Turing is one of the world... ...AI systems. Turing helps leading AI labs improve the reasoning, problem-... ...and review game-based reasoning tasks designed to evaluate AI systems. Analyze...Contract workPart timeFor contractorsFreelanceRemote work
- ...About the Role: Do you have a background in Chemistry or Chemical Engineering ? AI is currently learning how to help scientists design new materials, understand reactions, and read lab reports. At TELUS Digital , we need people with a "Chemistry Brain" to make sure...Part time
$50 - $150 per hour
...6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where your academic... ...) Prior experience with data annotation or AI model evaluation Experience reviewing or publishing research papers Compensation...Contract workTemporary workInternshipRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ad Designer - AI Creative Evaluation (Contra Labs). Be the first to apply!
