Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Engineer, Evaluation And Quality, Creativity Apps

$119.1k - $230.5k per year

Lex

Summary
Imagine what you could do here. At Apple, new ideas have a way of becoming outstanding products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish.The Creativity Apps team is looking for a Machine Learning Engineer focused on the quality and evaluation of ML models and AI features in our creativity applications. You will define how we measure whether the product and AI features are good enough to ship: designing the evaluation strategy and metrics, building the datasets and infrastructure behind them, and driving end-to-end quality from model development through to the feature in customers' hands. You will have the unique and rewarding opportunity to help shape upcoming products that will delight and inspire millions of creators every day.Description
In this role, you will own the evaluation and quality of AI features across Creativity Apps. You will work closely with Machine Learning engineering, infrastructure, product, and design teams to understand each model and use case, and translate them into evaluation methodology, testing strategy, and quality metrics that reflect what creators actually experience.You Will
Define evaluation strategy and metrics for ML models, LLMs, and AI features, tailored to the model, the product, and its use cases.Curate and create evaluation datasets, measure and improve dataset quality, and run iterative improvement loops so that datasets stay representative of each product.Design, build, maintain, and optimize evaluation infrastructure at scale, with reproducible runs, tracked baselines, and comparisons between model versions.Apply ML, LLMs, and agentic workflows to the evaluation itself, including automated judging, test generation, and analysis, to make evaluation more efficient, more accurate, and more scalable.Drive end-to-end evaluation and quality of AI features, from model checkpoints to integrated, shipping features, including triaging issues and driving them to resolution.Report quality clearly, turning evaluation results into ship/no-ship risk and recommendations for both technical and non-technical audiences.Partner with and drive cross-functional teams, comfortable with ambiguity and making educated, critical judgments.Your curiosity about the latest developments in ML and generative AI, and your drive to apply new technology to practical problems, will set you apart.Minimum Qualifications
5+ years of industry experience in machine learning or software engineering, with a focus on ML/AI model evaluation and quality.Experience with evaluation methodology for ML models, LLMs, and AI products or features.Strong understanding of the ML development cycle, from data and training to evaluation, deployment, and monitoring.Solid machine learning fundamentals and LLM knowledge, including agentic workflows, and you keep up with the latest developments in the field.Track record of applying LLMs, or agentic workflows to ML evaluation and quality.Experience in data curation, dataset creation, and dataset quality, including iterative improvement workflows that deliver high-quality datasets tailored to specific products.Experience designing, implementing, maintaining, or optimizing ML evaluation infrastructure at scale.Experience designing evaluation metrics based on the model, the product, and its use cases.Experience driving end-to-end evaluation and quality for AI products.Fluency in quality reporting, presenting quality data to both technical and non-technical audiences.Strong communication skills and experience working with and driving cross-functional partners.Proficient in Python and/or Swift or comparable languages.Bachelor's degree in Computer Science, Data Science, Machine Learning, or a related field, or equivalent experience.Preferred Qualifications
Knowledge of the software development life cycle and software quality assurance methodologies.Experience in objective image and video quality evaluation and metrics.Knowledge of color science and/or experience with subjective image or video quality review.Passion for creative applications;
experience as a creator(photo, video, music, or design) is a plus.Excitement about learning new technology and applying it to practical problems.Familiarity with iOS and macOS.Pay & Benefits
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $119,100 and $230,500, and your base pay will depend on your skills, qualifications, experience, and location.Apple employees also have the opportunity to become an Apple shareholder through participation in Apple Inc.’s discretionary employee stock programs. Employees are eligible for discretionary restricted stock unit award recommendations, and can purchase Apple Inc. stock at a discount if voluntarily participating in Apple Inc.’s Employee Stock Purchase Plan. Participation in Apple Inc.’s discretionary stock programs is governed by Apple Inc.’s stock plans and agreements and are not part of local employment contracts or compensation.You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple BenefitsNote: Apple benefit and compensation programs are subject to eligibility requirements and other terms of the applicable plan or program.Apple is an equal opportunity employer that is committed to inclusion and diversity. Apple provides reasonable accommodations to applicants with disabilities. Apple is a drug-free workplace.At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.Learn about accessibility in Apple’s workplaceRole Number: 200693920-3350
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Machine Learning Engineer, Evaluation And Quality, Creativity Apps in Winnipeg, MB vacancy
  • Machine Learning Evaluation Engineers at Apple shape quality for AI features in Creativity Apps from Vancouver, British Columbia. Apply ML evaluation, metrics, and datasets.This engineer owns evaluation and quality across AI features in Creativity Apps. You will define methodologies... 
    Quality

    Apple, Inc.

    Winnipeg, MB
    1 hour ago
  • Machine Learning Evaluation Engineers shape quality for Apple Creativity Apps using model evaluation, datasets, and scalable infrastructure. The role focuses on AI features from development through shipment.Apple’s Creativity Apps team seeks an engineer with five or more years... 
    Quality

    Apple, Inc.

    Winnipeg, MB
    1 hour ago
  • $129.2k - $174.8k per year

     ...faster, and more securely. We are currently seeking a Machine Learning Engineer to join our rapidly growing engineering team. This role is...  ..., such as ChatGPT or Gemini; A proven ability to quickly learn new technologies and adapt to a dynamic, fast-paced... 
    Suggested
    Work at office
    Local area
    Flexible hours
    1 day per week

    Clio

    Winnipeg, MB
    5 days ago
  •  ...Build scalable machine learning platforms at PointClickCare using Python, Java, and MLOps expertise...  ...As a Senior Machine Learning Systems Engineer, you will design, build, and operate...  ...Engineering teams while supporting training, evaluation, serving, monitoring, and secure... 
    Suggested

    The Institute for Performance and Learning

    Winnipeg, MB
    5 days ago
  • $185.4k - $320.7k per year

     ...United States Software and Services The Creativity Apps team needs your help shaping the next...  ...us? We are looking for an experienced engineering manager who is a passionate creator to...  ...needed and maintaining a clear view of quality and delivery timelines Champion engineering... 
    Quality
    Relocation

    Apple Inc.

    Winnipeg, MB
    1 hour ago
  • Shape AI reasoning through machine learning evaluation, statistical analysis, and precise technical writing with Alignerr. This fully remote contract...  ...rigorous ground-truth solutionsReview code using Scikit-Learn, PyTorch, and TensorFlowAssess efficiency, correctness, and... 
    Contract work
    Remote work
    Flexible hours

    Alignerr Corp.

    Winnipeg, MB
    1 hour ago
  •  ...problems in a rapidly growing domain with a lot of data and creative solutions in Marketplace, Mapping, Fraud, Growth and beyond...  ...ML utilizing peta-byte scale data. Our highly motivated Machine Learning Engineers work on these challenging problems and define solutions to... 
    Quality

    Lyft, Inc.

    Winnipeg, MB
    1 hour ago
  • Overview We are looking for a Machine Learning Engineer to join our StudioLAB team - an innovation-focused group that shapes the next generation of creative and production technology across. 12-month assignment with the possibility of extension based on project needs and... 
    Quality

    OP

    Winnipeg, MB
    1 hour ago
  •  ...more information, visit At Reddit, machine learning sits at the heart of how millions of people...  ...and marketplace dynamics, our ML engineers tackle some of the most interesting and...  ...definition and feature engineering to training, evaluation, deployment, and monitoring Build... 
    Quality
    Remplacement
    Long term contract
    For contractors
    Flexible hours

    FDE Times

    Winnipeg, MB
    1 hour ago
  •  ...most innovative online shopping experience, or designing an app that will impact the lives of people across the country, we’re...  ...apparel spaces, and we’re only just getting started. As a Machine Learning Engineer on the GenAI team, you will lead the development of data science... 
    Work at office

    Confidential

    Winnipeg, MB
    1 hour ago
  •  ...stronger. We work in an environment buzzing with creative energy and inspiration. No matter where you...  ...success at Wave is the ability to be bold, learn quickly and share your knowledge generously.As a Machine Learning Engineer, you will be a key contributor to the design,... 
    Summer work
    Internship
    Immediate start

    Wave HQ

    Winnipeg, MB
    1 hour ago
  • $120k - $250k per year

     ...from junior to senior levels, and will evaluate your application in its entirety. Layer...  ...We develop and deploy industry-leading machine learning systems that impact the lives of over 27...  ...edge of machine learning in research, engineering, and impactful applications. We are looking... 
    Temporary work
    Work from home

    TD Bank Group

    Winnipeg, MB
    1 hour ago
  •  ...Senior Manager, Software & Data Engineering to lead the design,...  ...delivery practices and continuous learning within the team.Software Engineering...  ...solutions.Ensure data quality, governance, lineage, reconciliation...  ...environment that encourages creativity, curiosity, and celebrates... 
    Quality

    Scotiabank

    Winnipeg, MB
    1 hour ago
  •  ...than Zurich Canada. If you have experience in machine learning, artificial intelligence or ML/AI engineering and are looking for a new challenge, we would love...  ...validation/testing and bias/fairness testing. Evaluate models; move experiments to production and optimize... 
    Quality
    Internship

    Zurich Canada

    Winnipeg, MB
    1 hour ago
  • Senior Machine Learning Engineer Location: Hybrid, 3 days per week on-site Language: Strong written and verbal English communication skills...  ...effective validation strategies.You'll support data preparation, quality assurance, experimentation, and resource planning while... 
    Quality
    Contract work
    3 days per week

    Altis

    Winnipeg, MB
    1 hour ago
  • Job Title: Machine Learning Engineer - SeniorJob Location: Toronto, ONJob Type: 130 days contractClient: Public SectorJob Title: Machine Learning...  ...deploying the model in the real world Experience verifying data quality, and/or ensuring it via data cleaning Experience supervising... 
    Quality
    3 days per week

    Russell Tobin

    Winnipeg, MB
    1 hour ago
  • $210k - $224k per year

     ...that work across extraction quality and LLM-driven features. You’...  ..., whether your title says ML engineer or data scientist, this is for...  ...Build and tune models for learning-to-rank, query understanding,...  ...content classification, and evaluation of LLM-driven features Mine... 
    Quality
    Long term contract
    Full time
    Temporary work
    For contractors
    Remote work
    Work from home

    Urban Ridge Supplies

    Winnipeg, MB
    1 hour ago
  •  ...platforms that accelerate how fast our models learn. How fast we learn dictates how fast this...  ...on everything around you, and treat the quality of our end-to-end judgment as your...  ...with the end-to-end ML lifecycle (training, evaluation, deployment, monitoring, and iteration) and... 
    Quality
    Relocation
    Shift work

    Opendoor

    Winnipeg, MB
    1 hour ago
  • Machine Learning Engineer TechnicalPart TimeRemoteSmilepass is a pioneering startup looking to shake things up in the dental industry, and other...  ...statistical methods might be more suitable.Define and evaluate data and model quality, identifying the most effective models... 
    Quality

    Smilepass Inc.

    Winnipeg, MB
    1 hour ago
  • Train, evaluate and deploy the models behind Studdy's learning experience, from personalisation to content quality. Based in Vancouver or Toronto. Candidates in India are welcome to apply...  ...any provider you choose.3+ years in machine learning engineeringStrong Python and ML... 
    Quality
    Work visa

    Studdy

    Winnipeg, MB
    1 hour ago
  •  ...and collaboration features as a Senior iOS Engineer in Vancouver, Washington, using Swift and Apple platform expertise.Apple’s Creativity Apps team builds tools for creators alongside...  ..., cloud technologies, and high-quality products at scale.Key Responsibilities:... 
    Quality

    Apple, Inc.

    Winnipeg, MB
    1 hour ago
  •  ...to their clients. We’re now looking for a skilled Senior Machine Learning Engineer who thrives in a fast-paced environment and is passionate about...  ...The TeamOur Data Science and AI team is made up of curious, creative people who love solving tough problems. Much of our work... 
    Quality
    Long term contract

    Blue J

    Winnipeg, MB
    1 hour ago
  •  ...-backed knowledge a firm can build on. We are now hiring a Machine Learning Engineer, based in Toronto. You will build and improve the models and...  ...attribution, extraction and synthesis. You will design the evaluations that tell us when it works, and run the experiments that... 

    Syntrace

    Winnipeg, MB
    1 hour ago
  •  ...is someone who is adept at creating reliable AI agents, prompt engineering, possesses a great product sense, and is also an excellent software...  ...of users globally.What you'll contribute: Fine-tune and evaluate state-of-the-art language modelsOptimize prompts to maximize classification... 
    Internship

    Linkus Group

    Winnipeg, MB
    1 hour ago
  • The Machine Learning Engineer will lead the design, development, and deployment of advanced machine learning models and production-grade AI solutions...  ...patterns. Experience with emerging AI tools used for model evaluation, optimization, or automation. #J-18808-Ljbffr

    Compunnel Inc.

    Winnipeg, MB
    1 hour ago
  •  ...t wait to see how you’ll help us grow.Job Summary: As a Machine Learning Engineer, you will join a small, high-impact R&D team and own the full...  ...to production system: data acquisition, training, evaluation, and deployment on AWS or GCP. Rapidly prototype research... 
    Full time
    Casual work
    Work at office
    Worldwide

    MetaOptima Technology Inc.

    Winnipeg, MB
    1 hour ago
  •  ...problem is not accuracy, it is fairness and drift. The score must not learn proxies for things it has no business scoring, and it must stay...  ...the population it sees changes. You will spend as much time on evaluation and explanation as on modelling. What you will do Own the... 
    Full time
    Remote work

    Verifran

    Winnipeg, MB
    1 hour ago
  •  ...Full-TimeAbout the Role We are looking for a skilled Machine Learning Engineer to develop, deploy, and optimize machine learning systems that...  ...machine learning pipelines and workflows.Build, train, and evaluate machine learning models.Optimize models for performance, scalability... 
    Remote work

    Sequoia Technologies

    Winnipeg, MB
    1 hour ago
  • Senior AI / Machine Learning Engineer Senior Associate at TEEMA Solutions GroupWe are seeking a Senior AI / ML Engineer with deep hands...  ...including ingestion, feature engineering, model training, evaluation, and deployment Enhance platform usability and improve scalability... 
    Contract work

    TEEMA

    Winnipeg, MB
    1 hour ago
  • Advance GenAI evaluation and testing at TD in Toronto or Montréal, working with LLMs, NLP, and deep learning models. The role is office focused.This senior scientist position leads...  ...personal development objectivesShare AI and machine learning knowledge with business partnersProvide... 
    Work at office

    TD Bank Group

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Engineer, Evaluation And Quality, Creativity Apps. Be the first to apply!