Machine Learning Evaluation Engineer
Apple, Inc.
Machine Learning Evaluation Engineers shape quality for Apple Creativity Apps using model evaluation, datasets, and scalable infrastructure. The role focuses on AI features from development through shipment.Apple’s Creativity Apps team seeks an engineer with five or more years in machine learning or software engineering. You will define evaluation methodologies, metrics, and testing strategies for models, large language models, and AI features. Your work connects data curation, infrastructure, quality reporting, and cross-functional collaboration across model development and customer-facing features.Key Responsibilities:
Define evaluation strategies and metrics for models, LLMs, and featuresCreate representative datasets and improve their quality iterativelyBuild scalable infrastructure with reproducible runs and tracked baselinesApply automated judging, test generation, and agentic workflowsDrive quality issues from model checkpoints through integrated featuresRequirements:
Five or more years in machine learning or software engineeringExperience evaluating ML models, LLMs, and AI productsUnderstanding of data, training, deployment, and monitoring cyclesProficiency in Python, Swift, or comparable languagesBachelor’s degree or equivalent experience in a related fieldApply machine learning, LLM, dataset, and quality expertise to evaluate Apple creativity features at scale.
#J-18808-Ljbffr
Define evaluation strategies and metrics for models, LLMs, and featuresCreate representative datasets and improve their quality iterativelyBuild scalable infrastructure with reproducible runs and tracked baselinesApply automated judging, test generation, and agentic workflowsDrive quality issues from model checkpoints through integrated featuresRequirements:
Five or more years in machine learning or software engineeringExperience evaluating ML models, LLMs, and AI productsUnderstanding of data, training, deployment, and monitoring cyclesProficiency in Python, Swift, or comparable languagesBachelor’s degree or equivalent experience in a related fieldApply machine learning, LLM, dataset, and quality expertise to evaluate Apple creativity features at scale.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Machine Learning Evaluation Engineer in Winnipeg, MB vacancy
$129.2k - $174.8k per year
...faster, and more securely. We are currently seeking a Machine Learning Engineer to join our rapidly growing engineering team. This role is... ..., such as ChatGPT or Gemini; A proven ability to quickly learn new technologies and adapt to a dynamic, fast-paced...SuggestedWork at officeLocal areaFlexible hours1 day per week- Machine Learning Evaluation Engineers at Apple shape quality for AI features in Creativity Apps from Vancouver, British Columbia. Apply ML evaluation, metrics, and datasets.This engineer owns evaluation and quality across AI features in Creativity Apps. You will define methodologies...Suggested
- ...Build scalable machine learning platforms at PointClickCare using Python, Java, and MLOps expertise... ...As a Senior Machine Learning Systems Engineer, you will design, build, and operate... ...Engineering teams while supporting training, evaluation, serving, monitoring, and secure...Suggested
- Shape AI reasoning through machine learning evaluation, statistical analysis, and precise technical writing with Alignerr. This fully remote contract... ...rigorous ground-truth solutionsReview code using Scikit-Learn, PyTorch, and TensorFlowAssess efficiency, correctness, and...SuggestedContract workRemote workFlexible hours
$119.1k - $230.5k per year
Machine Learning Engineer, Evaluation and Quality, Creativity Apps Vancouver, British Columbia, Canada Software and ServicesImagine what you could do here. At Apple, new ideas have a way of becoming outstanding products, services, and customer experiences very quickly. Bring...SuggestedLocal areaRelocation- ...true success at Wave is the ability to be bold, learn quickly and share your knowledge generously.As a Machine Learning Engineer, you will be a key contributor to the design,... ...workflows into our automated systems.Track & Evaluate: Formulate comprehensive observability...Summer workInternshipImmediate start
- ...-backed knowledge a firm can build on. We are now hiring a Machine Learning Engineer, based in Toronto. You will build and improve the models and... ...attribution, extraction and synthesis. You will design the evaluations that tell us when it works, and run the experiments that...
- ...is someone who is adept at creating reliable AI agents, prompt engineering, possesses a great product sense, and is also an excellent software... ...of users globally.What you'll contribute: Fine-tune and evaluate state-of-the-art language modelsOptimize prompts to maximize classification...Internship
- ...problem is not accuracy, it is fairness and drift. The score must not learn proxies for things it has no business scoring, and it must stay... ...the population it sees changes. You will spend as much time on evaluation and explanation as on modelling. What you will do Own the...Full timeRemote work
- # Machine Learning EngineerRedditSalary not statedContractremote· midCanadallmpythonjavagopytorchtensorflowredisListed... ...and marketplace dynamics, our ML engineers tackle some of the most interesting and... ...and feature engineering to training, evaluation, deployment, and monitoring- Build...RemplacementLong term contractFor contractorsFlexible hours
- Train, evaluate and deploy the models behind Studdy's learning experience, from personalisation to content quality. Based... ...provider you choose.3+ years in machine learning engineeringStrong Python... ...models in productionWork with AI engineers and product on new featuresBenefits...Work visa
- Senior Machine Learning Engineer Location: Hybrid, 3 days per week on-site Language: Strong written and verbal English communication skills... ..., regression, clustering, feature engineering, model evaluation, and hyperparameter optimization.Demonstrated experience with...Contract work3 days per week
- Job Title: Machine Learning Engineer - SeniorJob Location: Toronto, ONJob Type: 130 days contractClient: Public SectorJob Title: Machine Learning... ..., regression, clustering, feature engineering, model evaluation, hyperparameter tuning, drift, retraining, performance optimization...3 days per week
- ...t wait to see how you’ll help us grow.Job Summary: As a Machine Learning Engineer, you will join a small, high-impact R&D team and own the full... ...to production system: data acquisition, training, evaluation, and deployment on AWS or GCP. Rapidly prototype research...Full timeCasual workWork at officeWorldwide
- The Machine Learning Engineer will lead the design, development, and deployment of advanced machine learning models and production-grade AI solutions... ...patterns. Experience with emerging AI tools used for model evaluation, optimization, or automation. #J-18808-Ljbffr
- ...than Zurich Canada. If you have experience in machine learning, artificial intelligence or ML/AI engineering and are looking for a new challenge, we would love... ...validation/testing and bias/fairness testing. Evaluate models; move experiments to production and optimize...Internship
- ...real estate.Building platforms that accelerate how fast our models learn. How fast we learn dictates how fast this company can grow.You’... ...ML systemsExpertise with the end-to-end ML lifecycle (training, evaluation, deployment, monitoring, and iteration) and associated tooling (...RelocationShift work
- Advance GenAI evaluation and testing at TD in Toronto or Montréal, working with LLMs, NLP, and deep learning models. The role is office focused.This senior scientist position leads... ...personal development objectivesShare AI and machine learning knowledge with business partnersProvide...Work at office
- Sapphire Stream Technology (SST) is a technology and engineering solutions company specializing in software development, AI and machine learning, semiconductor technologies, automotive solutions, and advanced engineering services.We collaborate with leading global technology...
- Ingénieur(e) Machine Learning (ML) - Role in Montreal, QC - French Fluency requiredNous avons commencé notre aventure en 2001 en tant que petite... ...IA & NLP : OpenAI, ingénierie de prompts (Prompt Engineering), fine-tuning et intégration de modèles d’IA générative. MLOps...Work at officeRemote workFlexible hours
- Overview Role: Machine Learning EngineerLocations: Toronto, Canada Remote, and US remoteDuration: Long term contract QualificationsLanguages: Python, SQL, (Scala or Java) Skills: PyTorch, Huggingface transformers, Deep Learning, Spark/Hadoop, MLOps...Long term contractRemote work
$136.1k - $204.1k per year
...various tasks for building Unity games. Integrate Machine Learning models seamlessly within real-time game engine constraints, optimizing for latency, compute, and... ...practices for model quality, simulation-based evaluation, and ML/AI safety within real-time systems. Mentor...Long term contractWork at officeWorldwide$150k - $200k per year
Senior Machine Learning Engineer – AI Innovation TeamsAs one of the world’s top three credit ratings agencies, Fitch Ratings plays a critical role... ...Experiment with frontier models, implement novel ML architectures, evaluate emerging AI technologies, build proofs‑of‑concept, and...Long term contractInternshipManual laborImmediate start$196k - $265k per year
...individuals who seek to have a lasting impact. Learn more at Senior Machine Learning EngineerAt EvenUp, we... ...for a Senior Machine Learning Engineer to help build the models and systems... ...problem framing, data strategy, training, evaluation, deployment, and monitoring. Architect...Long term contractFull timeTemporary workWork at officeLocal areaHome officeFlexible hours$160k - $200k per year
...Solutions is hiring a Senior ML Engineer to help build our customer-... ...production Train, fine-tune, and evaluate models for matching,... ...monitoring, and retraining Build evaluation that tells us whether... ...habit of building quickly to learn: you'd rather test an idea in...Work at officeLocal areaWorldwide- Build Studdy’s learning models with Python and PyTorch in Vancouver or Toronto. Shape personalisation and content quality for learners.As a Machine Learning Engineer, you will train, evaluate, and deploy models that determine what each learner sees next. You will develop production...
- ...AI systems with Cohere using Python and machine learning frameworks, working remotely or from... ...models, and contribute across research and engineering. The work supports enterprise AI... ...public-interest products. You will train, evaluate, and use large language models while executing...Remote work
- ...client is seeking a highly innovative and experienced Senior Machine Learning Engineer to join their pioneering, fully remote team. This role is... ...data preprocessing, feature engineering, model training, and evaluation. Deploy ML models into production environments, ensuring...Remote workFlexible hours
- ...records and connect them, so scientists and engineers get answers they can check against the... ...that material.You'll also build the evaluations that tell us whether an answer is right... ...for Five or more years building machine learning systems in productionExperience with document...Work at office
- Develop and validate machine-learning models and training pipelinesImplement model components, data pipelines, and evaluation systemsBuild reproducible programmatic workflows using Python... ...and solve challenging machine-learning engineering tasksOptimize memory and throughput for...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning Evaluation Engineer. Be the first to apply!

