Machine Learning Evaluation Engineer

Machine Learning Evaluation Engineers at Apple shape quality for AI features in Creativity Apps from Vancouver, British Columbia. Apply ML evaluation, metrics, and datasets.This engineer owns evaluation and quality across AI features in Creativity Apps. You will define methodologies, testing strategies, and metrics reflecting creator experiences. The work spans model development, infrastructure, integrated features, and customer-ready quality.Key Responsibilities:
Define evaluation strategies and metrics for models, LLMs, and AI featuresCreate representative datasets and improve their quality iterativelyBuild scalable infrastructure with reproducible runs and tracked baselinesApply LLMs and agentic workflows to evaluationReport quality, risks, recommendations, and resolution progress clearlyRequirements:
Five-plus years in machine learning or software engineeringExperience evaluating ML models, LLMs, and AI productsUnderstanding of data, training, deployment, and monitoring cyclesProficiency in Python, Swift, or comparable languagesBachelor’s degree or equivalent experience in a related fieldBring evaluation methodology, dataset quality, scalable infrastructure, and machine learning expertise to Apple’s creative applications.
#J-18808-Ljbffr