Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Designer - AI Creative Evaluation (Contra Labs)

Temporary

Contra Labs

About Contra Labs

Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying the patterns behind what gets created, what gets chosen, and what resonates. We believe human input will always be at the center of net new creation, and our mission is to help shape technology so human creativity can be amplified to create what today is unimaginable.

By joining the Contra Labs network you gain access to paid projects with some of the most innovative companies building the next generation of creative and AI-powered tools.

How It Works

This is an application to join the network and be eligible for roles as they arise. Projects are staffed on an as-needed basis, typically 5 to 10 hours at a time, though some may extend into longer engagements. In unique cases, we may have full-time roles available as well. When a project matches your skill set, we'll reach out with details and timeline.

To Join the Network

  1. Portfolio review - We'll assess your Contra profile and portfolio for strength in product design, specifically across desktop and mobile applications.
  2. Record a 30 second intro video - Share a quick 30 second introduction so we can get to know you.
  3. Complete profile - Once you’ve applied, we recommend completing your profile for better job matches and setting up your wallet so you can get paid when a job comes through.

What You May Work On

  • Evaluate AI-generated product design outputs across desktop and mobile app interfaces, applying professional design standards and best practices
  • Provide clear, structured feedback on UI/UX quality including layout, hierarchy, interaction patterns, accessibility, and visual polish
  • Help define creative benchmarks and taste standards for what great product design looks like in the next generation of AI-powered tools
  • Contribute to research on how convergence (shared best practices) and divergence (individual taste and creative direction) shape design quality

What We're Looking For

  • Strong portfolio showcasing high-quality product design work across desktop and/or mobile applications, shared via your Contra profile
  • Deep understanding of what makes app interfaces intuitive, polished, and well-crafted, from information architecture to micro-interactions
  • Ability to articulate design and UX feedback clearly and constructively
  • Comfort working in fast-paced, experimental environments (experience with AI or design tools is a plus)
Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Product Designer - AI Creative Evaluation (Contra Labs) in Remote vacancy
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying... 
    Creative
    Full time
    Contract work

    Contra Labs

    Remote
    3 days ago
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying... 
    Creative
    Contract work
    Immediate start

    Contra Labs

    Remote
    22 days ago
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying... 
    Creative
    Full time
    Contract work

    Contra Labs

    Remote
    22 days ago
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and technology. We partner with leading product companies to improve the creative tools that professionals use every day. Our research is grounded in how top creatives actually work, studying the... 
    Creative
    Full time
    Contract work

    Contra Labs

    Remote
    22 days ago
  •  ...experiences, packaging, digital products, and even printed publications. The brand designers on this team are multidisciplinary...  ...everywhere in between. We craft the creative vision and strategy for different...  .... About Stripe Creative Lab Stripe Creative Lab aims to create... 
    Creative

    Stripe

    Remote
    4 days ago
  •  ...applications and next steps. Our partner is looking for a Staff Product Designer - AI Products based in Canada . The Staff Product Designer will...  ...the direction of new AI experiences. The role requires creativity, strong product judgment, and comfort navigating ambiguity and... 
    Full time

    Jobgether

    Remote
    8 days ago
  •  ...partner company, which manages all applications and next steps. Our partner is looking for a Creative Designer | Logos based in Canada. Join an innovative digital product team developing an AI-powered self-discovery platform designed to help people better understand themselves... 
    Creative
    Full time

    Jobgether

    Remote
    3 days ago
  •  ...work to accelerate the future of AI, we’re continuing to redefine...  ...email and in-app, plus the product-qualified signals that tell Sales...  ...a data team ~ Experience designing and running experiments, and...  ...and launch and document Design, build and launch onboarding... 
    Full time
    Contract work
    Part time
    Fixed term contract
    Remote work

    Prolific

    Remote
    2 days ago
  • $125.6k - $172.7k per year

     ...s shaping an exciting array of product solutions, including Video-Based...  ...long term. The Associate Creative Director will play a pivotal role...  ...of strategic thinking, hands-on design expertise, and collaboration...  ...digital experiences can be in an AI-first world — moving beyond conventional... 
    Creative
    Long term contract
    Full time
    Internship
    Manual labor
    Remote work
    Flexible hours

    Samsara

    Remote
    4 days ago
  •  ...competitive advantage. Cresta’s unified AI platform combines...  ....  Born from the Stanford AI Lab, Cresta has raised more than $270...  ...you.   As our first AI Agent Evaluation Engineer, you define what quality...  ...analysis, rigorous evaluation design, and engineering execution: reading... 
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    Cresta

    Remote
    10 hours ago
  •  ...competitive advantage. Cresta’s unified AI platform combines...  ...day. Born from the Stanford AI Lab, Cresta has raised more than $270...  ...That’s you. As our first AI Agent Evaluation Engineer, you define what quality...  ...analysis, rigorous evaluation design, and engineering execution:... 
    Full time

    Cresta

    Remote
    1 day ago
  • usd160k - usd215k per year

     ...powerful for all developers. As AI has advanced, Warp has evolved...  ...to code, deploy, and debug production software. Today, we have three...  ...freeing them to focus on the creative and rewarding aspects of their...  ...Work' guide. As a Product Designer, you will… Design and... 
    Creative
    Internship
    Work at office
    Remote work
    Flexible hours

    Warp

    Remote
    4 days ago
  • usd209k - usd269k per year

     ...what matters most. About the Product Team The Product team...  ...vision. The team works closely with design, engineering, and analytics to...  .... About the Role The ZT1 Labs group is a small, senior team of...  .... Own the full UI/UX, using AI tools to build and iterate on working... 
    Long term contract
    Contract work
    Work at office
    Remote work
    Flexible hours
    Shift work

    Affirm

    Remote
    4 days ago
  •  ...Our partner is looking for a Principal Creative Director, AI Video based in Canada. The Principal Creative...  ...shape the future of AI-native creative production, combining advanced generative...  ...is integrated into video, motion, and design, while setting a high creative standard... 
    Creative
    Full time
    Flexible hours

    Jobgether

    Remote
    9 days ago
  •  ...partner is looking for a Head of Internal Product, Systems & Creative Operations based in Canada. This is an...  ...and explore innovative applications of AI. This is a fully remote position...  ...roadmaps and clear product requirements. - Design, develop, and continuously improve internal... 
    Creative
    Long term contract
    Full time
    Remote work

    Jobgether

    Remote
    8 days ago
  • $50 - $105 per hour

     ...SketchUp AutoCAD Vectorworks Scripts Briefs Set designer About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM... 
    Hourly pay
    Part time
    For contractors
    Remote work
    Worldwide

    micro1

    Remote
    9 days ago
  •  ...powerful for all developers. As AI has advanced, Warp has evolved...  ...to code, deploy, and debug production software. Today, we have three...  ...freeing them to focus on the creative and rewarding aspects of their...  ...We Work' guide. As a Product Designer, you will… - Design and prototype... 
    Creative
    Full time

    Warp

    Remote
    16 days ago
  •  .... Our partner is looking for a Director, Product Design based in Canada. As Director of Product Design...  ...You will play a key role in integrating AI-powered and agentic capabilities into...  ...position combines strategic leadership, creative execution and technical collaboration in... 
    Creative
    Long term contract
    Remote work

    Jobgether

    Remote
    1 day ago
  • $161.6k - $222.2k per year

     ...shaping an exciting array of product solutions, including Video-Based...  ...role:  As a Staff Product Designer at Samsara, you will set a vision...  ...best efforts to bring forth creative, ambitious ideas for our customers...  ...decisions. Leverage AI tools through every step of the... 
    Creative
    Long term contract
    Full time
    Internship
    Remote work
    Flexible hours

    Samsara

    Remote
    4 days ago
  •  ...strategic cornerstone of our operations. We’re looking for a Product Designer to set the cross-application UX direction for our commercial...  ...code to explore and test concepts during discovery, and run evaluative tests with users and engineers Define the cross-application... 
    Permanent employment
    Full time
    Local area
    Remote work
    Worldwide
    Relocation
    Flexible hours

    SkyCell AG

    Remote
    3 days ago
  • $151.3k - $195.8k per year

     ...shaping an exciting array of product solutions, including Video-Based...  ...role:  As a Lead Product Designer at Samsara, you'll own design...  ...and best efforts to bring forth creative, ambitious ideas for our customers...  ...decisions. Leverage AI tools through every step of the... 
    Creative
    Long term contract
    Full time
    Remote work
    Flexible hours

    Samsara

    Remote
    4 days ago
  • $151k - $196k per year

     ...shaping an exciting array of product solutions, including Video-Based...  ...this role: As a Lead Product Designer at Samsara, you'll own design...  ...and best efforts to bring forth creative, ambitious ideas for our...  ...product decisions. Leverage AI tools through every step of the... 
    Creative
    Long term contract
    Full time
    Remote work
    Flexible hours

    Samsara

    Remote
    6 days ago
  •  ...is at the core of our strategy and product innovation. We’re hiring a principal designer to own it. This role is the...  ...setting the standard for what an AI-native designer creates. You shape...  ...(and plan and run) generative and evaluative research to unlock actionable insights... 
    Long term contract
    Full time

    Babylist

    Remote
    5 days ago
  •  ...a self-contained Task that an AI agent has to solve in a Linux...  ...learning:** training, inference, evaluation, and kernels - **Security:**...  ...Hardware:** CAD and mechanical design, and RTL and digital design -...  ..., music technology, and audio production, and graphic, UX/UI, motion, and... 
    Shift work

    Workada

    Remote
    8 days ago
  •  ...steps. Our partner is looking for a Senior Product Designer based in Canada. As a Senior Product...  ...part of your mission will be designing for AI agents as first-class users, ensuring they...  ...rates, and tool-call efficiency. - Test and evaluate experiences with both human users and AI... 
    Long term contract
    Full time
    Remote work

    Jobgether

    Remote
    9 days ago
  • $171k - $180.5k per year

     ...ABOUT THE TEAM The Growth Design Team focuses on driving business...  ...sits at the intersection of product thinking, brand expression, behavioral...  ...for Growth and the AI workflows that put them to work...  ...principles, product experiences, evaluation, and evolving technology, shaping... 
    Long term contract
    Permanent employment
    Manual labor
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    Remote
    4 days ago
  •  ...About the role AI assistants are becoming part of everyday life, helping people with...  ...and select your preferred experience. Evaluate conversational quality, helpfulness,...  ...simple testing guidelines and document your evaluations accurately. Who we're looking for Active... 
    Hourly pay
    Temporary work
    Part time
    Remote work

    micro1

    Remote
    1 day ago
  •  ...Curate and evaluate Java code for AI training and performance benchmarks. About Us Based in San Francisco...  ...research accelerator for frontier AI labs and a trusted partner for global...  ...engineering cycle (prototyping, architecture design, API design, production implementation,... 
    Part time
    For contractors
    Flexible hours

    Turing

    Remote
    7 days ago
  •  ...As a Senior Product Designer at Bridgit, you’re a builder first. You’ll work alongside product and...  ...shipped UI and post-launch iteration - Work AI-first, every day : use AI tools across...  ...product and customer needs evolves quickly - Creative problem solving skills resulting in... 
    Creative
    Full time
    Shift work

    Bridgit

    Remote
    21 days ago
  •  ...next steps. Our partner is looking for a Product Designer, Invoice Simple based in Canada. This is...  ...and experimentation. You will use Figma, AI-assisted tools, and potentially code to turn...  ...creating unnecessary complexity. - Evaluate end-to-end customer journeys to identify... 
    Full time

    Jobgether

    Remote
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Designer - AI Creative Evaluation (Contra Labs). Be the first to apply!