Machine Learning Engineer, Evaluation And Quality, Creativity Apps
$119.1k - $230.5k per yearLex
Imagine what you could do here. At Apple, new ideas have a way of becoming outstanding products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish.
The Creativity Apps team is looking for a Machine Learning Engineer focused on the quality and evaluation of ML models and AI features in our creativity applications. You will define how we measure whether the product and AI features are good enough to ship: designing the evaluation strategy and metrics, building the datasets and infrastructure behind them, and driving end-to-end quality from model development through to the feature in customers' hands. You will have the unique and rewarding opportunity to help shape upcoming products that will delight and inspire millions of creators every day.
DescriptionIn this role, you will own the evaluation and quality of AI features across Creativity Apps. You will work closely with Machine Learning engineering, infrastructure, product, and design teams to understand each model and use case, and translate them into evaluation methodology, testing strategy, and quality metrics that reflect what creators actually experience.
You Will- Define evaluation strategy and metrics for ML models, LLMs, and AI features, tailored to the model, the product, and its use cases.
- Curate and create evaluation datasets, measure and improve dataset quality, and run iterative improvement loops so that datasets stay representative of each product.
- Design, build, maintain, and optimize evaluation infrastructure at scale, with reproducible runs, tracked baselines, and comparisons between model versions.
- Apply ML, LLMs, and agentic workflows to the evaluation itself, including automated judging, test generation, and analysis, to make evaluation more efficient, more accurate, and more scalable.
- Drive end-to-end evaluation and quality of AI features, from model checkpoints to integrated, shipping features, including triaging issues and driving them to resolution.
- Report quality clearly, turning evaluation results into ship/no-ship risk and recommendations for both technical and non-technical audiences.
- Partner with and drive cross-functional teams, comfortable with ambiguity and making educated, critical judgments.
Your curiosity about the latest developments in ML and generative AI, and your drive to apply new technology to practical problems, will set you apart.
Minimum Qualifications- 5+ years of industry experience in machine learning or software engineering, with a focus on ML/AI model evaluation and quality.
- Experience with evaluation methodology for ML models, LLMs, and AI products or features.
- Strong understanding of the ML development cycle, from data and training to evaluation, deployment, and monitoring.
- Solid machine learning fundamentals and LLM knowledge, including agentic workflows, and you keep up with the latest developments in the field.
- Track record of applying LLMs, or agentic workflows to ML evaluation and quality.
- Experience in data curation, dataset creation, and dataset quality, including iterative improvement workflows that deliver high-quality datasets tailored to specific products.
- Experience designing, implementing, maintaining, or optimizing ML evaluation infrastructure at scale.
- Experience designing evaluation metrics based on the model, the product, and its use cases.
- Experience driving end-to-end evaluation and quality for AI products.
- Fluency in quality reporting, presenting quality data to both technical and non-technical audiences.
- Strong communication skills and experience working with and driving cross-functional partners.
- Proficient in Python and/or Swift or comparable languages.
- Bachelor's degree in Computer Science, Data Science, Machine Learning, or a related field, or equivalent experience.
- Knowledge of the software development life cycle and software quality assurance methodologies.
- Experience in objective image and video quality evaluation and metrics.
- Knowledge of color science and/or experience with subjective image or video quality review.
- Passion for creative applications;
experience as a creator(photo, video, music, or design) is a plus. - Excitement about learning new technology and applying it to practical problems.
- Familiarity with iOS and macOS.
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $119,100 and $230,500, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple Inc.’s discretionary employee stock programs. Employees are eligible for discretionary restricted stock unit award recommendations, and can purchase Apple Inc. stock at a discount if voluntarily participating in Apple Inc.’s Employee Stock Purchase Plan. Participation in Apple Inc.’s discretionary stock programs is governed by Apple Inc.’s stock plans and agreements and are not part of local employment contracts or compensation.
You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits
Note: Apple benefit and compensation programs are subject to eligibility requirements and other terms of the applicable plan or program.
Apple is an equal opportunity employer that is committed to inclusion and diversity. Apple provides reasonable accommodations to applicants with disabilities. Apple is a drug-free workplace.
At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.
Learn about accessibility in Apple’s workplace
Role Number: 200693920-3350
#J-18808-Ljbffr$181k - $241k per year
...pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. About the role Join Affirm as a Machine Learning Engineering Manager and lead our Commerce Optimization Machine Learning team. You will manage a team of ML engineers that builds and...SuggestedRemote jobLong term contractWork at officeFlexible hours- ...customers. Cohere is a team of researchers, engineers, designers, and more, who are all... ...full-time4 month internship. As a Machine Learning Intern, you will: Design, train and improve... ...: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit...QualityFull timeInternshipWork at officeLocal areaRemote workHome office
- ...frontier AI systems are built, evaluated, and governed. HFC members... ...models understand real-world deep learning workflows by designing,... ...postdoctoral research experience, in Machine Learning, Computer Science, or... ...Our products provide the high-quality data and full-stack...QualityFull timeFor contractorsRemote work10 hours per weekFlexible hours
$90k - $110k per year
...performance marketing, turning creative concepts into compelling ads... ...skills, and knows how to balance quality, speed, and performance.... ...creative for mobile games or apps. ~ Exceptional motion design... ...career advancement through ongoing learning and professional development opportunities...QualityLong term contractWork at officeRemote workRelocation packageFlexible hoursAfternoon shift$70k - $100k per year
...Innovation Starts With You. Quality Assurance Lead Full time -... ...release confidence for an AI learning platform featuring... ...risks and work with Product and Engineering to resolve them before providing... ...without breaking other areas. Evaluate simulation behaviour, AI...QualityPermanent employmentFull timeRemote workWork from home- ...Sulzer is a leading engineering company with a proud heritage of innovation... ...role Job Summary The Machine Operator is responsible for operating... ...efficiently, products meet quality standards, and safety... ...physical stamina. Willingness to learn and work in a team environment...QualityLong term contractFull timeTemporary work
$115k - $130k per year
...Monday to Friday, 40 hours per week. The Opportunity The Quality Control Manager is responsible for implementing and overseeing quality... ...required for project closeout. Contribute to lessons-learned reviews and continuous improvement initiatives to strengthen quality...QualityDaily paidPermanent employmentFull timeFor contractorsFor subcontractorRemote workMonday to friday$110k - $125k per year
...Toronto for an experienced Quality Assurance Manager to lead quality... ...across production, engineering and supply chain operations.... ...document-control processes. Evaluate existing quality systems, identify... ...precision manufacturing, CNC machining, metal fabrication or complex...QualityFull timeContract workRemote work- ...is known for its peaceful and safe environment and offers a high quality of life for younger and experienced professionals and for... ...promote autonomous cross-collaboration, mutual support and collective learning. Your role is to declare the aircraft ready for the production flight...QualityPermanent employmentContract workFlexible hoursDay shift
- ...Cloudbeds. This is a product engineering role focused on production AI systems, agentic workflows, evaluation, and observability - not an internal... ..., latency, cost, and model quality are core to the job. Your... ...pragmatic architecture, fast learning, and strong collaboration...QualityWork at officeLocal areaRemote workWork from homeHome officeFlexible hours
- ...the product that runs the fast apps our world runs on. (If you... ...will create an environment where engineers can do their best work, partner... ...risk, and hold a high bar for quality without becoming the team's... ...incident response, post-incident learning, and reduction of recurring...QualityFull timeLocal areaWorldwide
$5000 per month
...SUMMARY The role of the Site Quality Technician directly supports... ...for inspection, testing, and evaluation and provides input for... ...information, communicating with Nordex Engineering, Repair teams and other... ...attitude and willingness to learn and improve. ~ Strong interpersonal...QualityLong term contractWeekend work- ...Summary The Senior Mechanical Engineer is a hands-on technical lead... ...technical requisitions, evaluate vendor proposals, and complete... ..., hazard reviews, and lessons-learned activities. Coordinate with... ...instrumentation, structural, procurement, quality, project engineering, and...QualityFull timeFor subcontractorWork at officeLocal areaWorldwide
- ...engagements that transform workforce capability through integrated learning, enablement, and adoption strategies. As Workforce Experience... ...with measurable outcomes Set solution vision, architecture, and quality standards for comprehensive learning deliverable portfolios Own...QualityRemote jobTemporary work
- ...Job Description WE’RE LOOKING FOR A QUALITY ENGINEER, AIRWORTHINESS COMPLIANCE Location: Fort Erie, ON Ensure compliance with Transport Canada... ...activities related to maintenance, coordination of Aircraft & Engine Calendar and/or hourly inspections, repairs, alterations and...QualityHourly payPermanent employmentWork at officeFlexible hours
$148.3k - $171k per year
...its low fees, advanced trading engine, strong security and... ...robust compliance framework. Learn more at . All roles supporting... ...test, deploy, and maintain high-quality backend services and APIs using... ...regulations by providing a link to machine readable files related to the...QualityFull timeLocal areaRemote workWork from home$81.99k - $91.1k per year
...an experienced and versatile Analytics Engineer to join our dynamic team. In this role,... ...background in data engineering, analytics, and machine learning, with the ability to drive data-driven... ...best practices, ensuring data quality and consistency. Knowledge of data ethics...QualityLocal areaRemote work- ...clients. As a Mechanical Engineer, you will lead the mechanical... ...and compliant with applicable quality procedures, project plans, codes... ...standardization, lessons learned and continuous improvement initiatives... ...of Integrity, Commitment, Creativity, and Success into action...QualityFull timeFor contractorsFor subcontractorWork at officeLocal areaWorldwide
- ...enablement engagements as a strategic consulting partner to senior client executives. As Senior Manager, you'll shape enterprise-wide learning and adoption strategies, guide multidisciplinary teams, and drive practice growth while creating leverage through other leaders...Remote job
$126.23k - $163.35k per year
...Based Safety, Vehicle Telematics, Apps and Driver Workflows, and... ...the role: As a Senior Software Engineer on Safety Core, you’ll build software... ...and customers that push us to learn on the go. You believe... ...remain accountable for the quality of what ships. Partner closely...QualityRemote jobLong term contractFull timeInternshipRelocation packageFlexible hours$115k - $125k per year
...in an environment buzzing with creative energy and inspiration. No... ...Wave is the ability to be bold, learn quickly and share your knowledge... ...generously. Senior Software Engineers work in cross-functional teams... ...on the entire team’s pace and quality of deliverables; By assisting...QualityInternshipImmediate start- ...As a global leader in data quality, data enrichment, and location... ...We are looking for a Platform Engineering Manager with a strong hands-on... ...iteration, and continuous learning. What you will do: Lead... ...workflows, with sound judgment for evaluating which AI tools and approaches...Quality
$128.63k - $151.32k per year
...empower K12 leaders with the high-quality data they need to make... ...the journey. Senior Platform Engineer Join a team where innovation... ...intelligence (AI) to screen resumes or evaluate candidate fit against job... ...Growth: We host regular learning sessions. You also have access...QualityImmediate startRemote workFlexible hours- ...right people, it's the steepest learning curve of your career.... ...build it with us. As an AI Engineer at Jeeves, you will own whole... ...Monitor, and Improve Build evaluation sets and automated evals for... ...and alerts so you know when quality drops before a customer does...QualityFull timeRemote work
$168k - $220k per year
...for an experienced Sr. Computer Vision Engineer to own core algorithms for mapping, localization... ...computer vision but integrates modern machine learning methodologies to optimize performance on... ...curation, and annotation to ensure high-quality training and validation data. Monitor...QualityLocal area- ...role This is the first dedicated GTM engineering hire at Plane, and you will build the function... ...stops. Work daily with Sales on reply quality and handoff, with Marketing on message... ...our cloud, in customers' clouds, and on machines that will never touch the internet. Much...QualityFull time
- ...meaningful impact . Job Title: Lead ML Engineer – Classical ML & GenAI/RAG About the... ...have a strong foundation in classical Machine Learning/Data Science , with substantial hands-... ...development, validation, tuning, and evaluation. Establish appropriate baselines and...Quality
$140k - $192.5k per year
...PySpark for large-scale data pipelines. Engineers on the team build resilient, highly available... ...traffic. Collaborate with Product, Machine Learning, Data, and Infrastructure teams to solve... ...Cross-Channel Advertising To learn more about our privacy practices, please...Local areaRemote workWork from homeHome office$160k - $170k per year
...the herd! Description The Manager, Engineering leads a highly skilled team of engineering... ...automated testing, CI/CD, documentation, code quality, and release processes. Leverage AI-... ...-verify program for all US employees. Learn more about Tucows, our businesses,...QualityLong term contractRemote workusd180k per year
...Cohere is a team of researchers, engineers, designers, and more, who are... ...ships, and turning what you learn into defaults other teams inherit... ...Secure AI-powered products. Evaluate risks such as prompt injection... ...& culture, fitness/wellness, quality time, and a workspace improvement...QualityFull timeWork at officeLocal areaRemote workHome office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning Engineer, Evaluation And Quality, Creativity Apps. Be the first to apply!
- machine learning engineer Canada
- junior machine learning developer Canada
- responsable amelioration continue et qualité Canada
- qualité santé Canada
- quality manufacturing Canada
- auditeur qualite Canada
- qualité agroalimentaire Canada
- qualité environnement Canada
- agent d'assurance de la qualité Canada
- superviseur qualité Canada
