Product Designer - AI Creative Evaluation (Contra Labs)
Contra Labs
About Contra Labs
Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying the patterns behind what gets created, what gets chosen, and what resonates. We believe human input will always be at the center of net new creation, and our mission is to help shape technology so human creativity can be amplified to create what today is unimaginable.
By joining the Contra Labs network you gain access to paid projects with some of the most innovative companies building the next generation of creative and AI-powered tools.
How It Works
This is an application to join the network and be eligible for roles as they arise. Projects are staffed on an as-needed basis, typically 5 to 10 hours at a time, though some may extend into longer engagements. In unique cases, we may have full-time roles available as well. When a project matches your skill set, we'll reach out with details and timeline.
To Join the Network
- Portfolio review - We'll assess your Contra profile and portfolio for strength in product design, specifically across desktop and mobile applications.
- Record a 30 second intro video - Share a quick 30 second introduction so we can get to know you.
- Complete profile - Once you’ve applied, we recommend completing your profile for better job matches and setting up your wallet so you can get paid when a job comes through.
What You May Work On
- Evaluate AI-generated product design outputs across desktop and mobile app interfaces, applying professional design standards and best practices
- Provide clear, structured feedback on UI/UX quality including layout, hierarchy, interaction patterns, accessibility, and visual polish
- Help define creative benchmarks and taste standards for what great product design looks like in the next generation of AI-powered tools
- Contribute to research on how convergence (shared best practices) and divergence (individual taste and creative direction) shape design quality
What We're Looking For
- Strong portfolio showcasing high-quality product design work across desktop and/or mobile applications, shared via your Contra profile
- Deep understanding of what makes app interfaces intuitive, polished, and well-crafted, from information architecture to micro-interactions
- Ability to articulate design and UX feedback clearly and constructively
- Comfort working in fast-paced, experimental environments (experience with AI or design tools is a plus)
- ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying...CreativeFull timeContract work
- ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying...CreativeContract workImmediate start
- ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying...CreativeFull timeContract work
- ...About Contra Labs Contra Labs sits at the intersection of human creativity and technology. We partner with leading product companies to improve the creative tools that professionals use every day. Our research is grounded in how top creatives actually work, studying the...CreativeFull timeContract work
- ...experiences, packaging, digital products, and even printed publications. The brand designers on this team are multidisciplinary... ...everywhere in between. We craft the creative vision and strategy for different... .... About Stripe Creative Lab Stripe Creative Lab aims to create...Creative
- ...applications and next steps. Our partner is looking for a Staff Product Designer - AI Products based in Canada . The Staff Product Designer will... ...the direction of new AI experiences. The role requires creativity, strong product judgment, and comfort navigating ambiguity and...Full time
- ...partner company, which manages all applications and next steps. Our partner is looking for a Creative Designer | Logos based in Canada. Join an innovative digital product team developing an AI-powered self-discovery platform designed to help people better understand themselves...CreativeFull time
- ...work to accelerate the future of AI, we’re continuing to redefine... ...email and in-app, plus the product-qualified signals that tell Sales... ...a data team ~ Experience designing and running experiments, and... ...and launch and document Design, build and launch onboarding...Full timeContract workPart timeFixed term contractRemote work
$125.6k - $172.7k per year
...s shaping an exciting array of product solutions, including Video-Based... ...long term. The Associate Creative Director will play a pivotal role... ...of strategic thinking, hands-on design expertise, and collaboration... ...digital experiences can be in an AI-first world — moving beyond conventional...CreativeLong term contractFull timeInternshipManual laborRemote workFlexible hours- ...competitive advantage. Cresta’s unified AI platform combines... .... Born from the Stanford AI Lab, Cresta has raised more than $270... ...you. As our first AI Agent Evaluation Engineer, you define what quality... ...analysis, rigorous evaluation design, and engineering execution: reading...Full timeWork at officeRemote workHome officeFlexible hours
- ...competitive advantage. Cresta’s unified AI platform combines... ...day. Born from the Stanford AI Lab, Cresta has raised more than $270... ...That’s you. As our first AI Agent Evaluation Engineer, you define what quality... ...analysis, rigorous evaluation design, and engineering execution:...Full time
usd160k - usd215k per year
...powerful for all developers. As AI has advanced, Warp has evolved... ...to code, deploy, and debug production software. Today, we have three... ...freeing them to focus on the creative and rewarding aspects of their... ...Work' guide. As a Product Designer, you will… Design and...CreativeInternshipWork at officeRemote workFlexible hoursusd209k - usd269k per year
...what matters most. About the Product Team The Product team... ...vision. The team works closely with design, engineering, and analytics to... .... About the Role The ZT1 Labs group is a small, senior team of... .... Own the full UI/UX, using AI tools to build and iterate on working...Long term contractContract workWork at officeRemote workFlexible hoursShift work- ...Our partner is looking for a Principal Creative Director, AI Video based in Canada. The Principal Creative... ...shape the future of AI-native creative production, combining advanced generative... ...is integrated into video, motion, and design, while setting a high creative standard...CreativeFull timeFlexible hours
- ...partner is looking for a Head of Internal Product, Systems & Creative Operations based in Canada. This is an... ...and explore innovative applications of AI. This is a fully remote position... ...roadmaps and clear product requirements. - Design, develop, and continuously improve internal...CreativeLong term contractFull timeRemote work
$50 - $105 per hour
...SketchUp AutoCAD Vectorworks Scripts Briefs Set designer About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM...Hourly payPart timeFor contractorsRemote workWorldwide- ...powerful for all developers. As AI has advanced, Warp has evolved... ...to code, deploy, and debug production software. Today, we have three... ...freeing them to focus on the creative and rewarding aspects of their... ...We Work' guide. As a Product Designer, you will… - Design and prototype...CreativeFull time
- .... Our partner is looking for a Director, Product Design based in Canada. As Director of Product Design... ...You will play a key role in integrating AI-powered and agentic capabilities into... ...position combines strategic leadership, creative execution and technical collaboration in...CreativeLong term contractRemote work
$161.6k - $222.2k per year
...shaping an exciting array of product solutions, including Video-Based... ...role: As a Staff Product Designer at Samsara, you will set a vision... ...best efforts to bring forth creative, ambitious ideas for our customers... ...decisions. Leverage AI tools through every step of the...CreativeLong term contractFull timeInternshipRemote workFlexible hours- ...strategic cornerstone of our operations. We’re looking for a Product Designer to set the cross-application UX direction for our commercial... ...code to explore and test concepts during discovery, and run evaluative tests with users and engineers Define the cross-application...Permanent employmentFull timeLocal areaRemote workWorldwideRelocationFlexible hours
$151.3k - $195.8k per year
...shaping an exciting array of product solutions, including Video-Based... ...role: As a Lead Product Designer at Samsara, you'll own design... ...and best efforts to bring forth creative, ambitious ideas for our customers... ...decisions. Leverage AI tools through every step of the...CreativeLong term contractFull timeRemote workFlexible hours$151k - $196k per year
...shaping an exciting array of product solutions, including Video-Based... ...this role: As a Lead Product Designer at Samsara, you'll own design... ...and best efforts to bring forth creative, ambitious ideas for our... ...product decisions. Leverage AI tools through every step of the...CreativeLong term contractFull timeRemote workFlexible hours- ...is at the core of our strategy and product innovation. We’re hiring a principal designer to own it. This role is the... ...setting the standard for what an AI-native designer creates. You shape... ...(and plan and run) generative and evaluative research to unlock actionable insights...Long term contractFull time
- ...a self-contained Task that an AI agent has to solve in a Linux... ...learning:** training, inference, evaluation, and kernels - **Security:**... ...Hardware:** CAD and mechanical design, and RTL and digital design -... ..., music technology, and audio production, and graphic, UX/UI, motion, and...Shift work
- ...steps. Our partner is looking for a Senior Product Designer based in Canada. As a Senior Product... ...part of your mission will be designing for AI agents as first-class users, ensuring they... ...rates, and tool-call efficiency. - Test and evaluate experiences with both human users and AI...Long term contractFull timeRemote work
$171k - $180.5k per year
...ABOUT THE TEAM The Growth Design Team focuses on driving business... ...sits at the intersection of product thinking, brand expression, behavioral... ...for Growth and the AI workflows that put them to work... ...principles, product experiences, evaluation, and evolving technology, shaping...Long term contractPermanent employmentManual laborWork at officeRemote workWork from homeFlexible hours- ...About the role AI assistants are becoming part of everyday life, helping people with... ...and select your preferred experience. Evaluate conversational quality, helpfulness,... ...simple testing guidelines and document your evaluations accurately. Who we're looking for Active...Hourly payTemporary workPart timeRemote work
- ...Curate and evaluate Java code for AI training and performance benchmarks. About Us Based in San Francisco... ...research accelerator for frontier AI labs and a trusted partner for global... ...engineering cycle (prototyping, architecture design, API design, production implementation,...Part timeFor contractorsFlexible hours
- ...As a Senior Product Designer at Bridgit, you’re a builder first. You’ll work alongside product and... ...shipped UI and post-launch iteration - Work AI-first, every day : use AI tools across... ...product and customer needs evolves quickly - Creative problem solving skills resulting in...CreativeFull timeShift work
- ...next steps. Our partner is looking for a Product Designer, Invoice Simple based in Canada. This is... ...and experimentation. You will use Figma, AI-assisted tools, and potentially code to turn... ...creating unnecessary complexity. - Evaluate end-to-end customer journeys to identify...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Designer - AI Creative Evaluation (Contra Labs). Be the first to apply!
