Ad Designer - AI Creative Evaluation (Contra Labs)
Contra Labs
About Contra Labs
Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying the patterns behind what gets created, what gets chosen, and what resonates. We believe human input will always be at the center of net new creation, and our mission is to help shape technology so human creativity can be amplified to create what today is unimaginable.
By joining the Contra Labs network you gain access to paid projects with some of the most innovative companies building the next generation of creative and AI-powered tools.
How It Works
This is an application to join the network and be eligible for roles as they arise. Projects are staffed on an as-needed basis, typically 5 to 10 hours at a time, though some may extend into longer engagements. In unique cases, we may have full-time roles available as well. When a project matches your skill set, we'll reach out with details and timeline.
To Join the Network
- Portfolio review - We'll assess your Contra profile and portfolio for strength in product design, specifically across desktop and mobile applications.
- Record a 30 second intro video - Share a quick 30 second introduction so we can get to know you.
- Complete profile - Once you’ve applied, we recommend completing your profile for better job matches and setting up your wallet so you can get paid when a job comes through.
What You May Work On
- Evaluate AI-generated advertisements and marketing creative across digital, social, display, email, and other campaign formats.
- Provide structured feedback on messaging, composition, branding, hierarchy, visual storytelling, and overall creative effectiveness.
- Help define benchmarks for what makes advertising creative engaging, memorable, on-brand, and likely to perform.
- Compare multiple creative approaches, identify strengths and weaknesses, and explain why certain ads are more compelling than others.
- Contribute to research on how human creative judgment can improve the next generation of AI-powered advertising and marketing tools.
What We're Looking For
- A strong portfolio of advertising, marketing, or brand creative across digital channels.
- Experience creating campaigns, paid social ads, display creative, email marketing assets, or other performance and brand marketing materials.
- A sharp eye for visual communication, messaging, branding, and creative strategy.
- The ability to articulate thoughtful, actionable feedback on both visual execution and marketing effectiveness.
- Strong creative instincts and an understanding of current advertising trends, consumer behavior, and digital creative best practices.
- Comfort working in fast-paced, experimental environments. Experience with AI creative tools is a plus.
- ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying...CreativeFull timeContract work
- ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying...CreativeFull timeContract work
- ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying...CreativeContract workImmediate start
- ...About Contra Labs Contra Labs sits at the intersection of human creativity and technology. We partner with leading product companies to improve the creative tools that... ...a range of subjects and styles. # Skills evaluation - You’ll complete a structured videography submission...CreativeFull timeContract work
- ...printed publications. The brand designers on this team are... ...everywhere in between. We craft the creative vision and strategy for different... ...experiences. About Stripe Creative Lab Stripe Creative Lab aims to... ...Experience identifying, evaluating, and directing outside technical...Creative
- ...steps. Our partner is looking for a Bild-Ad Designer (m/w/d) based in Canada. Are you passionate... ...multiple industries. You will combine creativity, marketing psychology, and direct-response... ...Explore innovative design approaches and AI-powered tools to improve creative workflows...CreativeFull timePart timeFreelanceRemote work
- ...applications and next steps. Our partner is looking for an Image Ad Designer based in Canada. Join a creative environment focused on producing high-performing... ...that would be an advantage: - Familiarity with AI-powered image-generation tools and the ability to use AI...CreativeFull timeRemote work
- ...partner company, which manages all applications and next steps. Our partner is looking for a Creative Designer | Logos based in Canada. Join an innovative digital product team developing an AI-powered self-discovery platform designed to help people better understand themselves...CreativeFull time
$125.6k - $172.7k per year
...the long term. The Associate Creative Director will play a pivotal... ...of strategic thinking, hands-on design expertise, and collaboration across... ...experiences can be in an AI-first world — moving beyond conventional... ...like Cinema 4D or Blender, adding depth and sophistication to...CreativeLong term contractFull timeInternshipManual laborRemote workFlexible hours- ...competitive advantage. Cresta’s unified AI platform combines... .... Born from the Stanford AI Lab, Cresta has raised more than $270... ...you. As our first AI Agent Evaluation Engineer, you define what quality... ...analysis, rigorous evaluation design, and engineering execution: reading...Full timeWork at officeRemote workHome officeFlexible hours
- ...competitive advantage. Cresta’s unified AI platform combines... ...day. Born from the Stanford AI Lab, Cresta has raised more than $270... ...That’s you. As our first AI Agent Evaluation Engineer, you define what quality... ...analysis, rigorous evaluation design, and engineering execution:...Full time
- ...applications and next steps. Our partner is looking for a Principal Creative Director, AI Video based in Canada. The Principal Creative Director will... ...will define how AI is integrated into video, motion, and design, while setting a high creative standard through original work...CreativeFull timeFlexible hours
- ...About the role AI assistants are becoming part of everyday life, helping people with... ...and select your preferred experience. Evaluate conversational quality, helpfulness,... ...simple testing guidelines and document your evaluations accurately. Who we're looking for Active...Hourly payTemporary workPart timeRemote work
- ...Transformative Brand Growth. We’re building the AI Growth Engine that powers the next... ...Responsibilities At Trafilea, creative isn’t just about making great-looking ads. It’s about building a system that... ...~ Bachelor’s degree in Graphic Design, Marketing, Business,...CreativePermanent employmentFull timeRemote work
- ...each one into a self-contained Task that an AI agent has to solve in a Linux terminal.... ...*Machine learning:** training, inference, evaluation, and kernels - **Security:** cryptography,... ...security - **Hardware:** CAD and mechanical design, and RTL and digital design - **Business...Shift work
- ...drives supplement sales through relevant affiliate offers. As our AI Creative Strategist , you’ll own the thinking behind the content:... ...on strategy, copy, and creative direction. - Freedom to test. No ad spend approvals or endless creative bottlenecks. Put ideas into the...CreativeFull timeManual laborImmediate startRemote work
$10 - $24 per hour
...Teach live online classes on grading one AI response against written criteria: accuracy, instruction following and safety, with a justification... .... What the work is for YPAI Learn trains people for AI evaluation work in live classes. Your classes take learners from a gut...Contract workRemote work- ...partner is looking for a Staff Product Designer - AI Products based in Canada . The Staff Product... ...new AI experiences. The role requires creativity, strong product judgment, and comfort... ...results into design decisions. - Continuously evaluate and improve products after launch, using...Full time
- ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer, Ads Data (AI Native) based in Canada . Join a remote-first technology organization building innovative products that help families stay...Full timeRemote work
- ...Curate and evaluate Java code for AI training and performance benchmarks. About Us Based in San Francisco... ...research accelerator for frontier AI labs and a trusted partner for global... ...engineering cycle (prototyping, architecture design, API design, production implementation,...Part timeFor contractorsFlexible hours
- ...We're building a research cohort of senior domain experts in creative technology — spanning audio, design, and UX — to help evaluate how frontier AI models reason about hard, real-world expert-level problems. This is research-and-evaluation work, not production engineering...CreativeContract work
$10 - $30 per hour
...feedback digital delivery platforms ai-driven tools familiarity independent work... ...About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational... ...models and agents. We provide frontier evaluations and reinforcement learning environments to...Part timeFor contractorsRemote workShift work- ...requirements Help Shape the Future of AI in Healthcare What if the... ...healthcare information, evaluates medical scenarios, and delivers... ...opportunities to contribute to the evaluation and improvement of advanced... ...pathways . This opportunity is designed for candidates who can apply...Contract workFor contractorsTraineeshipRemote work
$26 - $99 per hour
...Teach live online classes for product and UX designers on using AI in research synthesis, exploring directions and reviewing finished screens.... ...work Teach the live class “Turn user interviews into three design directions with AI”, 90 minutes, from the class kit. Teach...Contract workLocal areaRemote work- ...French (FR) and interested in working on AI-related projects? We're currently looking... ...talent pool for an upcoming AI Response Evaluation and Fact-Checking project . This freelance... ...short French Language & Reasoning Test designed to assess French language proficiency and...Contract workFreelanceRemote workFlexible hours
- ...steps. Our partner is looking for a UX/UI Designer – AI-powered based in Canada. We are looking... ...: Plan and conduct usability tests, evaluate user feedback, and continuously improve... ...such as Scrum and Kanban. - Initiative, creativity, adaptability, and a pragmatic approach...Full time
- ...found, cited and recommended when their buyers ask AI for solutions. We do it through Generative... ...the Role You own the quality bar for everything creative Foundation delivers: written content, design, video, and social and ad creative. You make sure the work clients get is...CreativeFull timeFreelance
$50 - $105 per hour
...Pay: $50 - $105/hour Required Skills Marketing Posts Google Ads Marketing Campaigns Creative Strategist Copywriter About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations...CreativeHourly payPart timeFor contractorsRemote workWorldwide- ...Although several large digital ad platforms already exist,... ...platform measurement, campaign and creative management, advertiser growth... ...organization. Responsibilities: Design the Future of Ads Identity:... .... Define Ground Truth & Evaluation Frameworks: Solve the...CreativeRemplacementFor contractorsRemote workFlexible hours
$80 per hour
...to $1.6k/week We're working with a leading foundational AI lab to find experienced creative directors and art directors who can help train their... ...presentation and slide deck tasks. We're looking for CDs and ADs with 6+ years presenting creative work at top agencies or...CreativeContract workImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ad Designer - AI Creative Evaluation (Contra Labs). Be the first to apply!
