Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Engineer, Evaluation And Quality, Creativity Apps

$119.1k - $230.5k per year

Lex

Summary

Imagine what you could do here. At Apple, new ideas have a way of becoming outstanding products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish.

The Creativity Apps team is looking for a Machine Learning Engineer focused on the quality and evaluation of ML models and AI features in our creativity applications. You will define how we measure whether the product and AI features are good enough to ship: designing the evaluation strategy and metrics, building the datasets and infrastructure behind them, and driving end-to-end quality from model development through to the feature in customers' hands. You will have the unique and rewarding opportunity to help shape upcoming products that will delight and inspire millions of creators every day.

Description

In this role, you will own the evaluation and quality of AI features across Creativity Apps. You will work closely with Machine Learning engineering, infrastructure, product, and design teams to understand each model and use case, and translate them into evaluation methodology, testing strategy, and quality metrics that reflect what creators actually experience.

You Will
  • Define evaluation strategy and metrics for ML models, LLMs, and AI features, tailored to the model, the product, and its use cases.
  • Curate and create evaluation datasets, measure and improve dataset quality, and run iterative improvement loops so that datasets stay representative of each product.
  • Design, build, maintain, and optimize evaluation infrastructure at scale, with reproducible runs, tracked baselines, and comparisons between model versions.
  • Apply ML, LLMs, and agentic workflows to the evaluation itself, including automated judging, test generation, and analysis, to make evaluation more efficient, more accurate, and more scalable.
  • Drive end-to-end evaluation and quality of AI features, from model checkpoints to integrated, shipping features, including triaging issues and driving them to resolution.
  • Report quality clearly, turning evaluation results into ship/no-ship risk and recommendations for both technical and non-technical audiences.
  • Partner with and drive cross-functional teams, comfortable with ambiguity and making educated, critical judgments.

Your curiosity about the latest developments in ML and generative AI, and your drive to apply new technology to practical problems, will set you apart.

Minimum Qualifications
  • 5+ years of industry experience in machine learning or software engineering, with a focus on ML/AI model evaluation and quality.
  • Experience with evaluation methodology for ML models, LLMs, and AI products or features.
  • Strong understanding of the ML development cycle, from data and training to evaluation, deployment, and monitoring.
  • Solid machine learning fundamentals and LLM knowledge, including agentic workflows, and you keep up with the latest developments in the field.
  • Track record of applying LLMs, or agentic workflows to ML evaluation and quality.
  • Experience in data curation, dataset creation, and dataset quality, including iterative improvement workflows that deliver high-quality datasets tailored to specific products.
  • Experience designing, implementing, maintaining, or optimizing ML evaluation infrastructure at scale.
  • Experience designing evaluation metrics based on the model, the product, and its use cases.
  • Experience driving end-to-end evaluation and quality for AI products.
  • Fluency in quality reporting, presenting quality data to both technical and non-technical audiences.
  • Strong communication skills and experience working with and driving cross-functional partners.
  • Proficient in Python and/or Swift or comparable languages.
  • Bachelor's degree in Computer Science, Data Science, Machine Learning, or a related field, or equivalent experience.
Preferred Qualifications
  • Knowledge of the software development life cycle and software quality assurance methodologies.
  • Experience in objective image and video quality evaluation and metrics.
  • Knowledge of color science and/or experience with subjective image or video quality review.
  • Passion for creative applications;
    experience as a creator(photo, video, music, or design) is a plus.
  • Excitement about learning new technology and applying it to practical problems.
  • Familiarity with iOS and macOS.
Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $119,100 and $230,500, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple Inc.’s discretionary employee stock programs. Employees are eligible for discretionary restricted stock unit award recommendations, and can purchase Apple Inc. stock at a discount if voluntarily participating in Apple Inc.’s Employee Stock Purchase Plan. Participation in Apple Inc.’s discretionary stock programs is governed by Apple Inc.’s stock plans and agreements and are not part of local employment contracts or compensation.

You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit and compensation programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. Apple provides reasonable accommodations to applicants with disabilities. Apple is a drug-free workplace.

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace

Role Number: 200693920-3350

#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Machine Learning Engineer, Evaluation And Quality, Creativity Apps in Canada vacancy
  • $181k - $241k per year

     ...pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. About the role Join Affirm as a Machine Learning Engineering Manager and lead our Commerce Optimization Machine Learning team. You will manage a team of ML engineers that builds and... 
    Suggested
    Remote job
    Long term contract
    Work at office
    Flexible hours
    Canada
    20 hours ago
  •  ...customers. Cohere is a team of researchers, engineers, designers, and more, who are all...  ...full-time4 month internship. As a Machine Learning Intern, you will: Design, train and improve...  ...: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit... 
    Quality
    Full time
    Internship
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Canada
    10 days ago
  •  ...frontier AI systems are built, evaluated, and governed. HFC members...  ...models understand real-world deep learning workflows by designing,...  ...postdoctoral research experience, in Machine Learning, Computer Science, or...  ...Our products provide the high-quality data and full-stack... 
    Quality
    Full time
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    Scale AI

    Canada
    10 days ago
  • $90k - $110k per year

     ...performance marketing, turning creative concepts into compelling ads...  ...skills, and knows how to balance quality, speed, and performance....  ...creative for mobile games or apps. ~ Exceptional motion design...  ...career advancement through ongoing learning and professional development opportunities... 
    Quality
    Long term contract
    Work at office
    Remote work
    Relocation package
    Flexible hours
    Afternoon shift

    Tripledot Studios

    Canada
    13 hours ago
  • $70k - $100k per year

     ...Innovation Starts With You. Quality Assurance Lead Full time -...  ...release confidence for an AI learning platform featuring...  ...risks and work with Product and Engineering to resolve them before providing...  ...without breaking other areas. Evaluate simulation behaviour, AI... 
    Quality
    Permanent employment
    Full time
    Remote work
    Work from home

    CGS Immersive

    Canada
    3 days ago
  •  ...Sulzer is a leading engineering company with a proud heritage of innovation...  ...role Job Summary The Machine Operator is responsible for operating...  ...efficiently, products meet quality standards, and safety...  ...physical stamina. Willingness to learn and work in a team environment... 
    Quality
    Long term contract
    Full time
    Temporary work

    Sulzer

    Canada
    a month ago
  • $115k - $130k per year

     ...Monday to Friday, 40 hours per week. The Opportunity The Quality Control Manager is responsible for implementing and overseeing quality...  ...required for project closeout. Contribute to lessons-learned reviews and continuous improvement initiatives to strengthen quality... 
    Quality
    Daily paid
    Permanent employment
    Full time
    For contractors
    For subcontractor
    Remote work
    Monday to friday

    Forbes Bros. Group of Companies

    Canada
    3 days ago
  • $110k - $125k per year

     ...Toronto for an experienced Quality Assurance Manager to lead quality...  ...across production, engineering and supply chain operations....  ...document-control processes. Evaluate existing quality systems, identify...  ...precision manufacturing, CNC machining, metal fabrication or complex... 
    Quality
    Full time
    Contract work
    Remote work

    Remote People

    Canada
    16 days ago
  •  ...is known for its peaceful and safe environment and offers a high quality of life for younger and experienced professionals and for...  ...promote autonomous cross-collaboration, mutual support and collective learning. Your role is to declare the aircraft ready for the production flight... 
    Quality
    Permanent employment
    Contract work
    Flexible hours
    Day shift

    AIRBUS

    Canada
    7 days ago
  •  ...Cloudbeds. This is a product engineering role focused on production AI systems, agentic workflows, evaluation, and observability - not an internal...  ..., latency, cost, and model quality are core to the job. Your...  ...pragmatic architecture, fast learning, and strong collaboration... 
    Quality
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours

    Third-Party Job Posts

    Canada
    3 days ago
  •  ...the product that runs the fast apps our world runs on. (If you...  ...will create an environment where engineers can do their best work, partner...  ...risk, and hold a high bar for quality without becoming the team's...  ...incident response, post-incident learning, and reduction of recurring... 
    Quality
    Full time
    Local area
    Worldwide

    Redis

    Canada
    10 days ago
  • $5000 per month

     ...SUMMARY The role of the Site Quality Technician directly supports...  ...for inspection, testing, and evaluation and provides input for...  ...information, communicating with Nordex Engineering, Repair teams and other...  ...attitude and willingness to learn and improve. ~ Strong interpersonal... 
    Quality
    Long term contract
    Weekend work

    Nordex Group

    Canada
    12 days ago
  •  ...Summary The Senior Mechanical Engineer is a hands-on technical lead...  ...technical requisitions, evaluate vendor proposals, and complete...  ..., hazard reviews, and lessons-learned activities. Coordinate with...  ...instrumentation, structural, procurement, quality, project engineering, and... 
    Quality
    Full time
    For subcontractor
    Work at office
    Local area
    Worldwide

    Enerflex

    Canada
    1 day ago
  •  ...engagements that transform workforce capability through integrated learning, enablement, and adoption strategies. As Workforce Experience...  ...with measurable outcomes Set solution vision, architecture, and quality standards for comprehensive learning deliverable portfolios Own... 
    Quality
    Remote job
    Temporary work

    EPAM Systems

    Canada
    10 days ago
  •  ...Job Description WE’RE LOOKING FOR A QUALITY ENGINEER, AIRWORTHINESS COMPLIANCE Location: Fort Erie, ON Ensure compliance with Transport Canada...  ...activities related to maintenance, coordination of Aircraft & Engine Calendar and/or hourly inspections, repairs, alterations and... 
    Quality
    Hourly pay
    Permanent employment
    Work at office
    Flexible hours

    AIRBUS

    Canada
    15 days ago
  • $148.3k - $171k per year

     ...its low fees, advanced trading engine, strong security and...  ...robust compliance framework. Learn more at . All roles supporting...  ...test, deploy, and maintain high-quality backend services and APIs using...  ...regulations by providing a link to machine readable files related to the... 
    Quality
    Full time
    Local area
    Remote work
    Work from home

    binance.us

    Canada
    1 day ago
  • $81.99k - $91.1k per year

     ...an experienced and versatile Analytics Engineer to join our dynamic team. In this role,...  ...background in data engineering, analytics, and machine learning, with the ability to drive data-driven...  ...best practices, ensuring data quality and consistency. Knowledge of data ethics... 
    Quality
    Local area
    Remote work

    Tucows Inc.

    Canada
    3 days ago
  •  ...clients. As a Mechanical Engineer, you will lead the mechanical...  ...and compliant with applicable quality procedures, project plans, codes...  ...standardization, lessons learned and continuous improvement initiatives...  ...of Integrity, Commitment, Creativity, and Success into action... 
    Quality
    Full time
    For contractors
    For subcontractor
    Work at office
    Local area
    Worldwide

    Enerflex

    Canada
    1 day ago
  •  ...enablement engagements as a strategic consulting partner to senior client executives. As Senior Manager, you'll shape enterprise-wide learning and adoption strategies, guide multidisciplinary teams, and drive practice growth while creating leverage through other leaders... 
    Remote job

    EPAM Systems

    Canada
    3 days ago
  • $126.23k - $163.35k per year

     ...Based Safety, Vehicle Telematics, Apps and Driver Workflows, and...  ...the role: As a Senior Software Engineer on Safety Core, you’ll build software...  ...and customers that push us to learn on the go. You believe...  ...remain accountable for the quality of what ships. Partner closely... 
    Quality
    Remote job
    Long term contract
    Full time
    Internship
    Relocation package
    Flexible hours
    Canada
    12 hours ago
  • $115k - $125k per year

     ...in an environment buzzing with creative energy and inspiration. No...  ...Wave is the ability to be bold, learn quickly and share your knowledge...  ...generously. Senior Software Engineers work in cross-functional teams...  ...on the entire team’s pace and quality of deliverables; By assisting... 
    Quality
    Internship
    Immediate start

    Wave Accounting

    Canada
    10 days ago
  •  ...As a global leader in data quality, data enrichment, and location...  ...We are looking for a Platform Engineering Manager with a strong hands-on...  ...iteration, and continuous learning. What you will do: Lead...  ...workflows, with sound judgment for evaluating which AI tools and approaches... 
    Quality

    Precisely International Jobs

    Canada
    3 days ago
  • $128.63k - $151.32k per year

     ...empower K12 leaders with the high-quality data they need to make...  ...the journey. Senior Platform Engineer Join a team where innovation...  ...intelligence (AI) to screen resumes or evaluate candidate fit against job...  ...Growth:  We host regular learning sessions. You also have access... 
    Quality
    Immediate start
    Remote work
    Flexible hours

    ThoughtExchange

    Canada
    3 days ago
  •  ...right people, it's the steepest learning curve of your career....  ...build it with us. As an AI Engineer at Jeeves, you will own whole...  ...Monitor, and Improve Build evaluation sets and automated evals for...  ...and alerts so you know when quality drops before a customer does... 
    Quality
    Full time
    Remote work

    Jeeves

    Canada
    10 days ago
  • $168k - $220k per year

     ...for an experienced Sr. Computer Vision Engineer to own core algorithms for mapping, localization...  ...computer vision but integrates modern machine learning methodologies to optimize performance on...  ...curation, and annotation to ensure high-quality training and validation data. Monitor... 
    Quality
    Local area

    OpenSpace

    Canada
    3 days ago
  •  ...role This is the first dedicated GTM engineering hire at Plane, and you will build the function...  ...stops. Work daily with Sales on reply quality and handoff, with Marketing on message...  ...our cloud, in customers' clouds, and on machines that will never touch the internet. Much... 
    Quality
    Full time

    plane

    Canada
    9 days ago
  •  ...meaningful impact . Job Title: Lead ML Engineer – Classical ML & GenAI/RAG About the...  ...have a strong foundation in classical Machine Learning/Data Science , with substantial hands-...  ...development, validation, tuning, and evaluation. Establish appropriate baselines and... 
    Quality

    Delaplex

    Canada
    1 day ago
  • $140k - $192.5k per year

     ...PySpark for large-scale data pipelines. Engineers on the team build resilient, highly available...  ...traffic. Collaborate with Product, Machine Learning, Data, and Infrastructure teams to solve...  ...Cross-Channel Advertising   To learn more about our privacy practices, please... 
    Local area
    Remote work
    Work from home
    Home office

    StackAdapt

    Canada
    2 days ago
  • $160k - $170k per year

     ...the herd! Description The Manager, Engineering leads a highly skilled team of engineering...  ...automated testing, CI/CD, documentation, code quality, and release processes. Leverage AI-...  ...-verify program for all US employees. Learn more about Tucows, our businesses,... 
    Quality
    Long term contract
    Remote work

    Tucows Inc.

    Canada
    3 days ago
  • usd180k per year

     ...Cohere is a team of researchers, engineers, designers, and more, who are...  ...ships, and turning what you learn into defaults other teams inherit...  ...Secure AI-powered products. Evaluate risks such as prompt injection...  ...& culture, fitness/wellness, quality time, and a workspace improvement... 
    Quality
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Canada
    10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Engineer, Evaluation And Quality, Creativity Apps. Be the first to apply!