Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Researcher, AI Evaluations

Figma

Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma’s platform helps teams bring ideas to life—whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the world. If you're excited to shape the future of design and collaboration, join us!

We’re hiring a Researcher, AI Evaluations to join AI Insights within Figma’s Research team. This is a senior individual contributor role with no direct reports, reporting to the AI Insights lead and working directly with AI Research within AI Platform. You’ll strengthen the team’s model, agent system, and evaluation work through hands-on studies, clear rubrics, and reliable measures of quality that reflect user needs, and your findings will guide model and product improvements.

This is a full time role that can be held from one of our US hubs or remotely in the United States.

What you’ll do at Figma:

  • Own evaluation research for priority AI Research workstreams. Define quality criteria, design studies, analyze results, and recommend actions
  • Build rubrics, representative evaluation datasets, benchmarks, and quality thresholds that reflect user needs and expert design judgment
  • Work with AI Research and Modeling Platform engineers to integrate validated methods into repeatable evaluations and regression tests
  • Explain quality, failure patterns, and uncertainty. Recommend actions that guide model selection, model improvements, product priorities, and release decisions
  • Validate automated graders against human ratings, including LLM-as-judge methods that use a large language model to score outputs. Identify bias, gaps, and uncertainty
  • Connect user research with AI Research’s model development work. Share reusable methods, review work, and mentor peers

We’d love to hear from you if you have:

  • 7+ years of experience in research, applied research, or a related field, with a proven track record of independently leading complex evaluation projects and delivering measurable impact
  • Hands-on experience evaluating AI products, with demonstrated ability to translate evaluation findings into meaningful model and product improvements
  • Expertise in designing human evaluations, scoring rubrics, datasets, and benchmarks, including measuring inter-rater agreement and validating automated graders
  • Strong qualitative and quantitative research skills, with the ability to analyze data, interpret uncertainty, and draw actionable insights into model behavior and performance
  • Excellent problem-solving and stakeholder management skills, with the ability to navigate ambiguity, prioritize risks, balance speed with rigor, and deliver recommendations that influence cross-functional decisions

While it’s not required, it’s an added plus if you also have:

  • Experience integrating automated evaluations and regression testing into engineering workflows, with familiarity in tools such as Braintrust, LangSmith, DeepEval, or equivalent platforms
  • Proven ability to develop scalable, reusable evaluation frameworks and drive the adoption of consistent quality standards across teams
  • Background in product design, product management, data science, or engineering, with familiarity in Figma or similar design and developer tools
  • Strong statistical expertise in sampling, significance testing, and agreement metrics, with experience conducting experiments or analyzing performance metrics for AI-powered features
  • Advanced training in a quantitative or behavioral discipline, gained through formal education or equivalent hands-on experience

At Figma, one of our values is Grow as you go. We believe in hiring smart, curious people who are excited to learn and develop their skills. If you’re excited about this role but your past experience doesn’t align perfectly with the points outlined in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.

Pay Transparency Disclosure

Job level and actual compensation will be decided based on factors including, but not limited to, individual qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), market demands, and specific work location. 

Figma offers equity to employees, as well as a competitive package of additional benefits, including health, dental, and vision coverage; retirement benefits with company contributions; parental leave and reproductive or family planning support; mental health and wellness benefits; and paid time off. Figma provides paid sick leave, holidays, and other leave benefits in compliance with applicable federal, state, and local laws, including the requirements of the Washington Minimum Wage Act and related regulations. Exempt employees are eligible for employer‑provided paid flexible PTO in addition to flexible paid sick leave. PTO is subject to manager approval. Additional benefits may include company recharge days, cell phone and home internet reimbursements, and a number of lifestyle spending accounts. Figma also offers sales incentive compensation for most sales roles and an annual bonus plan for eligible non-sales roles. All compensation and benefits are subject to applicable plan terms and may be modified by Figma at any time, consistent with applicable law.

Annual Base Salary Range:

$169,000—$250,000 USD

At Figma we celebrate and support our differences. We know employing a team rich in diverse thoughts, experiences, and opinions allows our employees, our product and our community to flourish. Figma is an equal opportunity workplace - we are dedicated to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity/expression, veteran status , or any other characteristic protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.

We will work to ensure individuals with disabilities are provided reasonable accommodation to apply for a role, participate in the interview process, perform essential job functions, and receive other benefits and privileges of employment. If you require accommodation, please reach out to View email address on boards.greenhouse.io . These modifications enable an individual with a disability to have an equal opportunity not only to get a job, but successfully perform their job tasks to the same extent as people without disabilities. 

Examples of accommodations include but are not limited to: 

  • Holding interviews in an accessible location
  • Enabling closed captioning on video conferencing
  • Ensuring all written communication be compatible with screen readers
  • Changing the mode or format of interviews 

To ensure the integrity of our hiring process and facilitate a more personal connection, we require all candidates keep their cameras on during video interviews. Additionally, if hired you will be required to attend in person onboarding.

By applying for this job, the candidate acknowledges and agrees that any personal data contained in their application or supporting materials will be processed in accordance with Figma's Candidate Privacy Notice .

Application limits: To help candidates focus on the opportunities most relevant to their skills and experience, Figma limits the number and frequency of applications. These limits apply to all roles:

  • Candidates may submit up to 5 applications during any rolling 30-day period.
  • Candidates may not reapply to the same role while an application is active or within 90 days of receiving a rejection.

Once the applicable days has passed, candidates are welcome to apply again.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Researcher, AI Evaluations in York Regional Municipality, ON vacancy
  •  ...creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline...  ...shape the future of design and collaboration, join us! The Figma Research team is hiring an experienced researcher for our Rapid Research program... 
    Suggested
    Minimum wage
    Long term contract
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline...  ...shape the future of design and collaboration, join us! The Figma Research team is hiring an experienced researcher to support our core product... 
    Suggested
    Minimum wage
    Long term contract
    Full time
    Temporary work
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...translating designs into code, or iterating with AI. From idea to product, Figma empowers...  ...us! Figma’s AI Insights team, within Research, is hiring a builder with exceptional design...  ...the first idea through design, building, evaluation, and adoption. You build primarily with AI... 
    Suggested
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    20 days ago
  •  ...translating designs into code, or iterating with AI. From idea to product, Figma empowers...  ..., to rapidly prototyping an approach, to evaluating it and integrating it with the systems...  ..., Support, and internal APIs Build evaluations and feedback loops to measure accuracy, reliability... 
    Suggested
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    14 days ago
  •  ...translating designs into code, or iterating with AI. From idea to product, Figma empowers...  ...will be driving fundamental and applied research in this area. You will be combining industry...  ...into requirements for AI systems Build evaluation systems to measure and improve quality of... 
    Suggested
    Minimum wage
    Long term contract
    Full time
    Temporary work
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...translating designs into code, or iterating with AI. From idea to product, Figma empowers...  ...work on: Evals for design : Building evaluation frameworks for design generation quality...  ...performant. Collaborate with product, research, and infrastructure engineers working across... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...translating designs into code, or iterating with AI. From idea to product, Figma empowers...  ...and become the bridge connecting our AI research innovations with world-class design principles...  ...models' design capabilities and oversee evaluation quality. This is an exciting... 
    Minimum wage
    Full time
    For contractors
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  • usd218k per year

     ...is aligned with the product roadmap Software Design Provides technical leadership to team for design of multiple products Evaluates and recommends adoption of open source Evaluates third party and off the shelf solutions to influence build vs. buy decisions... 
    Full time
    Work at office

    Equinix

    York Regional Municipality, ON
    25 days ago
  •  ...creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline...  ...work in close collaboration with product management, engineering, research, marketing, and other teams to shape both product and business strategy... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...About us Appnovation is the AI Product Company. Headquartered in Vancouver, Canada, with teams around the world, Appnovation builds AI products, delivers enterprise AI and digital solutions, and co-invests with clients to bring new AI products to market. Open source has... 
    Full time
    Internship

    Appnovation Technologies

    York Regional Municipality, ON
    18 days ago
  •  ...creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline...  ...greater than ever. You’ll collaborate closely with a cutting edge AI Research team and your work will help raise the ceiling of what’s possible... 
    Minimum wage
    Long term contract
    Full time
    Temporary work
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...The Stripe Marketing organization is undergoing a fundamental transformation in how it works. We're building a team of Forward Deployed AI Accelerators (FDAs) embedded directly with marketing cohorts to make AI the default mode for all work — not an occasional tool, but the... 
    Long term contract
    Immediate start

    Stripe

    York Regional Municipality, ON
    1 day ago
  •  ...platform helps teams bring ideas to life—whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    22 days ago
  •  ...platform helps teams bring ideas to life—whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the... 
    Minimum wage
    Local area
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...translating designs into code, or iterating with AI. From idea to product, Figma empowers...  ...developer workflows and drive adoption Evaluate and integrate emerging AI tools, models,...  ...capabilities to build versus buy Establish evaluation frameworks to measure the quality, cost,... 
    Minimum wage
    Long term contract
    Full time
    Internship
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...platform helps teams bring ideas to life—whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the... 
    Minimum wage
    Full time
    Internship
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...into code, or iterating with AI. From idea to product, Figma empowers...  ...closely with engineers, researchers, designers, and product managers...  ...high-quality training and evaluation datasets, including annotation...  ...functions (engineering, product, research). At Figma, one of our... 
    Minimum wage
    Long term contract
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...into code, or iterating with AI. From idea to product, Figma empowers...  ...well as creating  datasets, evaluators, and benchmarks that show how...  ...measurement, and turn evaluation results and customer feedback...  ...with Product, Design, and AI Research teams at Figma to achieve business... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    12 days ago
  • $169k - $232k per year

    Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted...  ...the product development cycle — use AI-assisted tools for research, writing, prototyping, and demo creation to move faster, reduce manual... 
    Internship
    Local area
    Worldwide
    Flexible hours

    Okta

    York Regional Municipality, ON
    7 days ago
  • $132k - $162k per year

     ..., and knowledge practices that produce health inequities. Relevant research specializations in global and public health may include planetary health and climate justice; implementation science and evaluation; transdisciplinary approaches; artificial intelligence and data justice... 
    Permanent employment
    Remote work

    The School of Global Health in the Faculty of Health at York...

    York Regional Municipality, ON
    15 days ago
  •  ...translating designs into code, or iterating with AI. From idea to product, Figma empowers...  ...product forward with engineers, PMs, and researchers, and help us invent new ways for people...  ...closely with engineering, product, research, and designers across Figma, you’ll set direction... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    15 days ago
  •  ...self-service tools, empowering data consumers to efficiently extract and analyze data from BitGo’s large-scale data platform. Research, evaluate, and prototype new technologies to drive continuous improvement in data engineering. Skills & Experience:  We are looking... 
    Full time
    Work at office
    Worldwide

    BitGo

    York Regional Municipality, ON
    a month ago
  • $164k - $225k per year

    Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted...  ...tech debt, quality, and adoption. Raise the craft: Enable Okta Research and Development teams through clear alignment and documentation.... 
    Full time
    Internship
    Work at office
    Local area
    Worldwide
    Flexible hours
    Shift work
    2 days per week

    Okta

    York Regional Municipality, ON
    7 days ago
  • $169k - $232k per year

    Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted...  ...Collaboration : Partner with global engineering, design, and research teams to deliver infrastructure that supports Okta’s massive scale... 
    Local area
    Worldwide
    Flexible hours

    Okta

    York Regional Municipality, ON
    7 days ago
  •  ...creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline...  ...to and evolving design systems and templates ~ Experience using research and data to run experiments and drive decisions ~ Comfort with... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline...  ...and delivered measurable business results ~ Conducted customer research to deeply understand user needs and uncover actionable insights... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    20 days ago
  •  ...creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline...  ...highly cross-functional, partnering closely with Product, Design, Research, and Data to deliver best-in-class experiences. If you’re excited... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...translating designs into code, or iterating with AI. From idea to product, Figma empowers...  ...product forward with engineers, PMs, and researchers, and help us invent new ways for people...  ..., using customer insights, qualitative research, and product data to guide decisions ~... 
    Minimum wage
    Long term contract
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline...  ...measurement across these areas. This org engages closely with AI Research and is a driving force behind our evals work and the future of product... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago
  •  ...creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline...  ...Partner across Data Engineering, Data Infrastructure, Data Science, Research, Modeling Platform, Security, and Product Engineering to define... 
    Minimum wage
    Full time
    Internship
    Local area
    Remote work
    Flexible hours

    Figma

    York Regional Municipality, ON
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Researcher, AI Evaluations. Be the first to apply!