Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Engineer, Evaluation And Quality, Creativity Apps

$119.1k - $230.5k per year

Lex

Summary
Imagine what you could do here. At Apple, new ideas have a way of becoming outstanding products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish.The Creativity Apps team is looking for a Machine Learning Engineer focused on the quality and evaluation of ML models and AI features in our creativity applications. You will define how we measure whether the product and AI features are good enough to ship: designing the evaluation strategy and metrics, building the datasets and infrastructure behind them, and driving end-to-end quality from model development through to the feature in customers' hands. You will have the unique and rewarding opportunity to help shape upcoming products that will delight and inspire millions of creators every day.Description
In this role, you will own the evaluation and quality of AI features across Creativity Apps. You will work closely with Machine Learning engineering, infrastructure, product, and design teams to understand each model and use case, and translate them into evaluation methodology, testing strategy, and quality metrics that reflect what creators actually experience.You Will
Define evaluation strategy and metrics for ML models, LLMs, and AI features, tailored to the model, the product, and its use cases.Curate and create evaluation datasets, measure and improve dataset quality, and run iterative improvement loops so that datasets stay representative of each product.Design, build, maintain, and optimize evaluation infrastructure at scale, with reproducible runs, tracked baselines, and comparisons between model versions.Apply ML, LLMs, and agentic workflows to the evaluation itself, including automated judging, test generation, and analysis, to make evaluation more efficient, more accurate, and more scalable.Drive end-to-end evaluation and quality of AI features, from model checkpoints to integrated, shipping features, including triaging issues and driving them to resolution.Report quality clearly, turning evaluation results into ship/no-ship risk and recommendations for both technical and non-technical audiences.Partner with and drive cross-functional teams, comfortable with ambiguity and making educated, critical judgments.Your curiosity about the latest developments in ML and generative AI, and your drive to apply new technology to practical problems, will set you apart.Minimum Qualifications
5+ years of industry experience in machine learning or software engineering, with a focus on ML/AI model evaluation and quality.Experience with evaluation methodology for ML models, LLMs, and AI products or features.Strong understanding of the ML development cycle, from data and training to evaluation, deployment, and monitoring.Solid machine learning fundamentals and LLM knowledge, including agentic workflows, and you keep up with the latest developments in the field.Track record of applying LLMs, or agentic workflows to ML evaluation and quality.Experience in data curation, dataset creation, and dataset quality, including iterative improvement workflows that deliver high-quality datasets tailored to specific products.Experience designing, implementing, maintaining, or optimizing ML evaluation infrastructure at scale.Experience designing evaluation metrics based on the model, the product, and its use cases.Experience driving end-to-end evaluation and quality for AI products.Fluency in quality reporting, presenting quality data to both technical and non-technical audiences.Strong communication skills and experience working with and driving cross-functional partners.Proficient in Python and/or Swift or comparable languages.Bachelor's degree in Computer Science, Data Science, Machine Learning, or a related field, or equivalent experience.Preferred Qualifications
Knowledge of the software development life cycle and software quality assurance methodologies.Experience in objective image and video quality evaluation and metrics.Knowledge of color science and/or experience with subjective image or video quality review.Passion for creative applications;
experience as a creator(photo, video, music, or design) is a plus.Excitement about learning new technology and applying it to practical problems.Familiarity with iOS and macOS.Pay & Benefits
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $119,100 and $230,500, and your base pay will depend on your skills, qualifications, experience, and location.Apple employees also have the opportunity to become an Apple shareholder through participation in Apple Inc.’s discretionary employee stock programs. Employees are eligible for discretionary restricted stock unit award recommendations, and can purchase Apple Inc. stock at a discount if voluntarily participating in Apple Inc.’s Employee Stock Purchase Plan. Participation in Apple Inc.’s discretionary stock programs is governed by Apple Inc.’s stock plans and agreements and are not part of local employment contracts or compensation.You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple BenefitsNote: Apple benefit and compensation programs are subject to eligibility requirements and other terms of the applicable plan or program.Apple is an equal opportunity employer that is committed to inclusion and diversity. Apple provides reasonable accommodations to applicants with disabilities. Apple is a drug-free workplace.At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.Learn about accessibility in Apple’s workplaceRole Number: 200693920-3350
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Machine Learning Engineer, Evaluation And Quality, Creativity Apps in Winnipeg, MB vacancy
  • $400k per year

     ...Job Description: Position: Machine Learning Engineer Location: Remote / Hybrid Employment Type: Full-time Responsibilities Design, train...  ...environments. Build data pipelines for model training, evaluation, and optimization. Work with large-scale datasets,... 
    Suggested
    Full time
    Remote work
    Relocation

    MS Systems

    Winnipeg, MB
    21 hours ago
  • $129.2k - $174.8k per year

     ...faster, and more securely. We are currently seeking a Machine Learning Engineer to join our rapidly growing engineering team. This role is...  ..., such as ChatGPT or Gemini; A proven ability to quickly learn new technologies and adapt to a dynamic, fast-paced... 
    Suggested
    Work at office
    Local area
    Flexible hours
    1 day per week

    Clio

    Winnipeg, MB
    10 days ago
  •  ...Build scalable machine learning platforms at PointClickCare using Python, Java, and MLOps expertise...  ...As a Senior Machine Learning Systems Engineer, you will design, build, and operate...  ...Engineering teams while supporting training, evaluation, serving, monitoring, and secure... 
    Suggested

    The Institute for Performance and Learning

    Winnipeg, MB
    10 days ago
  •  ...cornerstone in industrial life. Wherever there are machines or products in motion, SKF bearings are...  ...careers in an equitable environment. Learn about SKF at. Position Overview We are seeking a skilled Quality Electrical Engineer to support customer and manufacturing... 
    Quality
    Permanent employment

    SKF Group

    Winnipeg, MB
    10 days ago
  •  ...We are seeking a highly experienced and hands-on Supplier Quality Engineer (SQE) with strong expertise in casting and machining processes, particularly aluminum castings. The role requires close collaboration with suppliers, frequent onsite visits, and active involvement in... 
    Quality

    Global Connect Technologies

    Winnipeg, MB
    10 days ago
  •  ...very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. The Creativity Apps team is looking for a Machine Learning Engineer focused on the quality and evaluation of ML models and AI features in our creativity applications. You... 
    Quality

    Apple, Inc.

    Winnipeg, MB
    2 hours ago
  •  ...with experience in fitting, machining, pumps, and industrial maintenance...  ...workplace conditions. From machine shop operations and pump...  ...techniques, inspection, and quality assurance. Strengthen hydraulic...  ...qualification) in Mechanical Engineering, Manufacturing Engineering,... 
    Quality
    Permanent employment
    Apprenticeship
    Traineeship
    Local area
    Free visa

    Cuso International

    Winnipeg, MB
    2 hours ago
  •  ...commitment to people. Our dependable quality, reliable delivery, and...  ...anywhere through the Manulife app, with eligible prescriptions delivered...  ...ability to read and interpret engineering drawings. • High proficiency...  ...self-motivation, eagerness to learn, a positive attitude and a... 
    Quality
    Permanent employment
    Full time
    Work at office

    Price Industries Limited

    Winnipeg, MB
    10 days ago
  •  ...and aspirations with us, and we'll ensure that your efforts open doors to new opportunities and growth.  THE POSITION   The  Quality Engineer  leads the development, implementation, and continuous improvement of quality standards and inspection criteria to ensure product... 
    Quality
    Full time
    Remote work

    Smartrend Manufacturing Group

    Winnipeg, MB
    19 days ago
  •  ...together across manufacturing, engineering, customer care, service,...  ...POSITION SUMMARY: As the Learning & Development Specialist, reporting...  ...learning technologies. Evaluate the effectiveness of learning...  ...moving. Our values of Safety, Quality, Integrity, Accountability,... 
    Quality
    Permanent employment
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to friday

    NFI Group Inc.

    Winnipeg, MB
    27 days ago
  •  ...Workada as a Remote Video Production Evaluator dedicated to improving AI technology through precise evaluations. This full-time role focuses on quality assessment of multimedia outputs....  ...with sound judgment Experience in creative or technical evaluation Detail-oriented... 
    Quality
    Full time
    Remote work

    workada

    Winnipeg, MB
    10 days ago
  •  ...Summary   Reporting to the Sr. Director, Quality, the Director, Quality Assurance leads...  ...products; review of test results; evaluation of batch and production records; approval...  ...Bachelor’s degree in Science, Pharmacy, Engineering, or a related field. An advanced degree... 
    Quality
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    10 days ago
  •  ...Lead paid social creative strategy for SPC in Vaughan or Toronto, combining...  ...to support audience growth, app installs, and membership...  ...cadences Own testing roadmaps and evaluate creative performance metrics...  ...production expertise to SPC’s performance-driven content engine.... 

    Spc-Student-Price-Card-Ltd.

    Winnipeg, MB
    10 days ago
  •  ...buyer is not just a button pusher. They understand the full system: creative, offer, conversion rate, platform dynamics, competition, and what...  ...work on real brands with real budgets. We test aggressively. We learn quickly. We build frameworks that scale. You will grow into... 
    Full time

    Sweat Pants Agency

    Winnipeg, MB
    21 days ago
  •  ...Director of Quality Assurance Winnipeg, MB Full-Time, Onsite POSITION SUMMARY:...  ...a rewarding career with opportunities to learn and grow across our family of companies....  .... Partner closely with Manufacturing, Engineering, Supply Chain, Service, and Operations teams... 
    Quality
    Full time
    Internship
    Immediate start

    New Flyer

    Winnipeg, MB
    23 days ago
  •  ...pumps, motors or hydraulic assemblies. Inspect furniture and fixture subassemblies and finished products for conformance to quality standards. Use machining tools to fabricate or recondition parts. Repair or replace defective pressure vessel parts, such as safety valves or... 
    Quality
    Hourly pay
    Permanent employment
    Immediate start
    Weekend work
    Day shift
    Afternoon shift

    WESLEY INDUSTRIAL MACHINE SHOP LTD.

    Winnipeg, MB
    10 days ago
  •  ...protecting and saving lives. Job Summary  The Specialist I, Quality Compliance is responsible for supporting and representing...  ...audit observations, and author clear and concise audit reports. • Evaluate documentation, records, processes, and personnel practices to assess... 
    Quality
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    10 days ago
  •  ...ensure flight and product efficiency. As a Quality Inspector , you will ensure that all aircraft components, engines, and systems are maintained, repaired, or overhauled...  ...-Term Disability Life & AD&D Insurance Learning & Training opportunities   #MHE #LI-MC1... 
    Quality
    Long term contract
    Temporary work
    Traineeship
    Internship
    Immediate start
    Flexible hours
    Shift work
    Weekend work

    StandardAero

    Winnipeg, MB
    16 days ago
  •  ...and a commitment to people. Our dependable quality, reliable delivery, and knowledgeable...  ...services anytime, anywhere through the Manulife app, with eligible prescriptions delivered...  ...• Work collaboratively with Production, Engineering, Shipping, Logistics, Supply Chain,... 
    Quality

    Price Industries Limited

    Winnipeg, MB
    10 days ago
  •  ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the GNWT/WSCC in indeterminate and term positions. The Department of Executive and Indigenous Affairs works to provide overall management... 
    Long term contract

    gov

    Winnipeg, MB
    10 days ago
  •  ...Manager, Quality AssuranceApply: Remote, ON: Full time: Posted Yesterday: R2616835Our team members are at the heart of everything...  ...consultation to clients on quality matters by assessing risks, evaluating potential impacts, and recommending practical, compliant, and... 
    Quality
    Full time
    Remote work

    Micro Technologies

    Winnipeg, MB
    10 days ago
  • $19 - $20 per hour

    Overview Languages English Education ~ No degree, certificate or diploma Experience No experience (will train) On site Work must be completed at the physical location. There is no option to work remotely. Benefits Health benefits Dental...
    Permanent employment
    Full time
    Remote work

    WESTERN SPRING AND WIRE LTD.

    Winnipeg, MB
    2 days ago
  •  ...The Quality Control Inspector will provide Quality Process Audit support to the Assembly Line. This position will assist in reducing process variation through the use of statistical data analysis, process audits, and department metrics. The position emphasizes improving internal... 
    Quality
    Full time
    Temporary work

    Motor Coach Industries

    Winnipeg, MB
    14 days ago
  • $95k - $105k per year

     ...Quality Assurance Manager Winnipeg, MB  |  Full-Time  |  Permanent  |  $95,000 – $105,000 per year About the Opportunity Staffmax...  ...integrity. You build effective teams, motivate the people around you, learn on the fly and stay organized when things get busy. Compensation... 
    Quality
    Permanent employment
    Full time
    Casual work
    Work at office
    Night shift

    Staffmax Staffing & Recruiting

    Winnipeg, MB
    16 days ago
  • $19 per hour

     ...Plastic Extrusion Machine Operator Location: Winnipeg, MB Job Type: Full-Time, Permanent Pay Rate: $19.00/hour to start, increasing...  ...operate, and monitor plastic extrusion machines to manufacture quality plastic products. Complete machine setups and change dies... 
    Quality
    Long term contract
    Permanent employment
    Full time
    Trial period
    Shift work
    Night shift
    Day shift
    Afternoon shift

    Staffmax Staffing & Recruiting

    Winnipeg, MB
    16 days ago
  •  ...portfolio continues to grow, we are seeking a Quality Coordinator (Site) to lead project...  ...including MS Word and Excel, as well as learning new software platforms. The ideal...  ...Power Line Technician (PLT) Electrical Engineering Technologist Construction Inspector... 
    Quality
    Full time
    Contract work

    Victor Energy

    Winnipeg, MB
    more than 2 months ago
  •  ...passionate professionals where our culture is informed by our values and commitment to protecting and saving lives. Job Summary  The Quality Assurance Deviations and CAPA Specialist provides support by managing deviations and corrective/preventative actions. Additionally,... 
    Quality
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    10 days ago
  •  ...benefits.  With manufacturing, engineering, R&D, and corporate functions...  ...the operation of a variety of machines to assist with meeting daily...  ...of manufactured material for quality control and improvement functions...  ...and peers. Ability to learn and operate new equipment.... 
    Quality
    Full time
    Flexible hours
    Shift work
    Weekend work
    Day shift

    Carlisle

    Winnipeg, MB
    21 days ago
  •  ...commitment to people. Our dependable quality, reliable delivery, and...  ...anywhere through the Manulife app, with eligible prescriptions delivered...  ...AI team as an Intermediate AI Engineer, where you'll build and deploy...  .... • Build ML, deep learning, and generative AI models to solve... 
    Quality

    Price Industries Limited

    Winnipeg, MB
    10 days ago
  • Machine Learning Evaluation Engineer at Apple, focused on ML model quality, LLM evaluation, and AI features for Creativity Apps.This engineer defines evaluation strategies and metrics for models, products, and use cases. The role builds datasets and scalable infrastructure while... 
    Quality

    Apple, Inc.

    Winnipeg, MB
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Engineer, Evaluation And Quality, Creativity Apps. Be the first to apply!