Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Evaluation Engineer

Apple, Inc.

Machine Learning Evaluation Engineers shape quality for Apple Creativity Apps using model evaluation, datasets, and scalable infrastructure. The role focuses on AI features from development through shipment.Apple’s Creativity Apps team seeks an engineer with five or more years in machine learning or software engineering. You will define evaluation methodologies, metrics, and testing strategies for models, large language models, and AI features. Your work connects data curation, infrastructure, quality reporting, and cross-functional collaboration across model development and customer-facing features.Key Responsibilities:
Define evaluation strategies and metrics for models, LLMs, and featuresCreate representative datasets and improve their quality iterativelyBuild scalable infrastructure with reproducible runs and tracked baselinesApply automated judging, test generation, and agentic workflowsDrive quality issues from model checkpoints through integrated featuresRequirements:
Five or more years in machine learning or software engineeringExperience evaluating ML models, LLMs, and AI productsUnderstanding of data, training, deployment, and monitoring cyclesProficiency in Python, Swift, or comparable languagesBachelor’s degree or equivalent experience in a related fieldApply machine learning, LLM, dataset, and quality expertise to evaluate Apple creativity features at scale.
#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Machine Learning Evaluation Engineer in Winnipeg, MB vacancy
  • $129.2k - $174.8k per year

     ...faster, and more securely. We are currently seeking a Machine Learning Engineer to join our rapidly growing engineering team. This role is...  ..., such as ChatGPT or Gemini; A proven ability to quickly learn new technologies and adapt to a dynamic, fast-paced... 
    Suggested
    Work at office
    Local area
    Flexible hours
    1 day per week

    Clio

    Winnipeg, MB
    7 days ago
  • Machine Learning Evaluation Engineers at Apple shape quality for AI features in Creativity Apps from Vancouver, British Columbia. Apply ML evaluation, metrics, and datasets.This engineer owns evaluation and quality across AI features in Creativity Apps. You will define methodologies... 
    Suggested

    Apple, Inc.

    Winnipeg, MB
    3 hours ago
  •  ...Build scalable machine learning platforms at PointClickCare using Python, Java, and MLOps expertise...  ...As a Senior Machine Learning Systems Engineer, you will design, build, and operate...  ...Engineering teams while supporting training, evaluation, serving, monitoring, and secure... 
    Suggested

    The Institute for Performance and Learning

    Winnipeg, MB
    7 days ago
  • Shape AI reasoning through machine learning evaluation, statistical analysis, and precise technical writing with Alignerr. This fully remote contract...  ...rigorous ground-truth solutionsReview code using Scikit-Learn, PyTorch, and TensorFlowAssess efficiency, correctness, and... 
    Suggested
    Contract work
    Remote work
    Flexible hours

    Alignerr Corp.

    Winnipeg, MB
    3 hours ago
  • $119.1k - $230.5k per year

     ...dedication to your job and there's no telling what you could accomplish.The Creativity Apps team is looking for a Machine Learning Engineer focused on the quality and evaluation of ML models and AI features in our creativity applications. You will define how we measure whether the... 
    Suggested
    Local area
    Relocation

    Lex

    Winnipeg, MB
    3 hours ago
  • Advance GenAI evaluation and testing at TD in Toronto or Montréal, working with LLMs, NLP, and deep learning models. The role is office focused.This senior scientist position leads...  ...personal development objectivesShare AI and machine learning knowledge with business partnersProvide... 
    Work at office

    TD Bank Group

    Winnipeg, MB
    3 hours ago
  • Overview We are looking for a Machine Learning Engineer to join our StudioLAB team - an innovation-focused group that shapes the next generation...  ...-edge approaches.Stay current with ML research trends and evaluate their potential application to studio needs.Contribute to internal... 

    OP

    Winnipeg, MB
    3 hours ago
  •  ...modern ML utilizing peta-byte scale data. Our highly motivated Machine Learning Engineers work on these challenging problems and define solutions to...  ...quality code to launch machine learning models at scale Evaluate machine learning systems against business goal... 

    Lyft, Inc.

    Winnipeg, MB
    3 hours ago
  • $210k - $224k per year

     ...into production, whether your title says ML engineer or data scientist, this is for you....  ...production Build and tune models for learning-to-rank, query understanding, and LLM-driven...  ...extraction quality, content classification, and evaluation of LLM-driven features Mine query logs... 
    Long term contract
    Full time
    Temporary work
    For contractors
    Remote work
    Work from home

    Urban Ridge Supplies

    Winnipeg, MB
    3 hours ago
  •  ...than Zurich Canada. If you have experience in machine learning, artificial intelligence or ML/AI engineering and are looking for a new challenge, we would love...  ...validation/testing and bias/fairness testing. Evaluate models; move experiments to production and optimize... 
    Internship

    Zurich Canada

    Winnipeg, MB
    3 hours ago
  •  ...more information, visit At Reddit, machine learning sits at the heart of how millions of people...  ...and marketplace dynamics, our ML engineers tackle some of the most interesting and...  ...definition and feature engineering to training, evaluation, deployment, and monitoring Build... 
    Remplacement
    Long term contract
    For contractors
    Flexible hours

    FDE Times

    Winnipeg, MB
    3 hours ago
  • Train, evaluate and deploy the models behind Studdy's learning experience, from personalisation to content quality. Based...  ...provider you choose.3+ years in machine learning engineeringStrong Python...  ...models in productionWork with AI engineers and product on new featuresBenefits... 
    Work visa

    Studdy

    Winnipeg, MB
    3 hours ago
  •  ...is someone who is adept at creating reliable AI agents, prompt engineering, possesses a great product sense, and is also an excellent software...  ...of users globally.What you'll contribute: Fine-tune and evaluate state-of-the-art language modelsOptimize prompts to maximize classification... 
    Internship

    Linkus Group

    Winnipeg, MB
    3 hours ago
  •  ...problem is not accuracy, it is fairness and drift. The score must not learn proxies for things it has no business scoring, and it must stay...  ...the population it sees changes. You will spend as much time on evaluation and explanation as on modelling. What you will do Own the... 
    Full time
    Remote work

    Verifran

    Winnipeg, MB
    3 hours ago
  • Senior Machine Learning Engineer Location: Hybrid, 3 days per week on-site Language: Strong written and verbal English communication skills...  ..., regression, clustering, feature engineering, model evaluation, and hyperparameter optimization.Demonstrated experience with... 
    Contract work
    3 days per week

    Altis

    Winnipeg, MB
    3 hours ago
  • Job Title: Machine Learning Engineer - SeniorJob Location: Toronto, ONJob Type: 130 days contractClient: Public SectorJob Title: Machine Learning...  ..., regression, clustering, feature engineering, model evaluation, hyperparameter tuning, drift, retraining, performance optimization... 
    3 days per week

    Russell Tobin

    Winnipeg, MB
    3 hours ago
  • Senior AI / Machine Learning Engineer Senior Associate at TEEMA Solutions GroupWe are seeking a Senior AI / ML Engineer with deep hands...  ...including ingestion, feature engineering, model training, evaluation, and deployment Enhance platform usability and improve scalability... 
    Contract work

    TEEMA

    Winnipeg, MB
    3 hours ago
  •  ...t wait to see how you’ll help us grow.Job Summary: As a Machine Learning Engineer, you will join a small, high-impact R&D team and own the full...  ...to production system: data acquisition, training, evaluation, and deployment on AWS or GCP. Rapidly prototype research... 
    Full time
    Casual work
    Work at office
    Worldwide

    MetaOptima Technology Inc.

    Winnipeg, MB
    3 hours ago
  •  ...true success at Wave is the ability to be bold, learn quickly and share your knowledge generously.As a Machine Learning Engineer, you will be a key contributor to the design,...  ...workflows into our automated systems.Track & Evaluate: Formulate comprehensive observability... 

    Wave HQ

    Winnipeg, MB
    3 hours ago
  • The Machine Learning Engineer will lead the design, development, and deployment of advanced machine learning models and production-grade AI solutions...  ...patterns. Experience with emerging AI tools used for model evaluation, optimization, or automation. #J-18808-Ljbffr

    Compunnel Inc.

    Winnipeg, MB
    3 hours ago
  • Machine Learning Engineer TechnicalPart TimeRemoteSmilepass is a pioneering startup looking to shake things up in the dental industry, and other...  ...statistical methods might be more suitable.Define and evaluate data and model quality, identifying the most effective models... 

    Smilepass Inc.

    Winnipeg, MB
    3 hours ago
  •  ...-backed knowledge a firm can build on. We are now hiring a Machine Learning Engineer, based in Toronto. You will build and improve the models and...  ...attribution, extraction and synthesis. You will design the evaluations that tell us when it works, and run the experiments that... 

    Syntrace

    Winnipeg, MB
    3 hours ago
  • $120k - $250k per year

     ...from junior to senior levels, and will evaluate your application in its entirety. Layer...  ...We develop and deploy industry-leading machine learning systems that impact the lives of over 27...  ...edge of machine learning in research, engineering, and impactful applications. We are looking... 
    Temporary work
    Work from home

    TD Bank Group

    Winnipeg, MB
    3 hours ago
  •  ...real estate.Building platforms that accelerate how fast our models learn. How fast we learn dictates how fast this company can grow.You’...  ...ML systemsExpertise with the end-to-end ML lifecycle (training, evaluation, deployment, monitoring, and iteration) and associated tooling (... 
    Relocation
    Shift work

    Opendoor

    Winnipeg, MB
    3 hours ago
  •  ...Full-TimeAbout the Role We are looking for a skilled Machine Learning Engineer to develop, deploy, and optimize machine learning systems that...  ...machine learning pipelines and workflows.Build, train, and evaluate machine learning models.Optimize models for performance, scalability... 
    Remote work

    Sequoia Technologies

    Winnipeg, MB
    3 hours ago
  • Overview Role: Machine Learning EngineerLocations: Toronto, Canada Remote, and US remoteDuration: Long term contract QualificationsLanguages: Python, SQL, (Scala or Java) Skills: PyTorch, Huggingface transformers, Deep Learning, Spark/Hadoop, MLOps... 
    Long term contract
    Remote work

    Dew Software

    Winnipeg, MB
    3 hours ago
  •  ...Golden River LED is seeking a Machine Learning Engineer to help us make better use of business, product, sales, and service data in our LED display operations. This role will support practical data-driven tools for product planning, demand forecasting, customer solution matching... 

    Golden River LED

    Winnipeg, MB
    3 hours ago
  •  ...seed round shortly after. About The RoleWe’re looking for a Machine Learning Engineer to build and scale high-impact, world-class ML systems. You’...  ...in Python and familiarity with ML libraries like Scikit-learn, LightGBM, and PyTorch. Strong understanding of machine learning... 
    Temporary work
    Summer work
    Work at office
    Home office

    Bree

    Winnipeg, MB
    3 hours ago
  •  ...-driven Physical AI for general purpose robots, is seeking Machine Learning (ML) Engineers to join our team of seasoned engineers, researchers, and scientists...  ...and libraries (e.G., PyTorch, TensorFlow, scikit-learn). Experience with ROS2 and parallel computing (e.G., CUDA... 

    Sanctuary

    Winnipeg, MB
    3 hours ago
  • Join to apply for the Machine Learning Engineer role at BioRenderJoin to apply for the Machine Learning Engineer role at BioRenderAt...  ..., we are accelerating the world’s ability to discover, learn, and communicate science faster through visuals. Today, BioRender... 
    Remote work

    BioRender

    Winnipeg, MB
    3 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Evaluation Engineer. Be the first to apply!