Data Scientist Focused on ML Evaluation

Contribute to trusted AI systems as a Data Scientist at Jobber, where you will focus on evaluating and validating machine learning models. Help ensure robust model performance in our AI initiatives. In this role, you will directly support Jobber's ML & AI practice, concentrating on creating and maintaining comprehensive ML model validation processes. Your responsibilities encompass building regression tests and executing evaluations that assure model integrity across their lifecycle. By collaborating with product and data science teams, you'll document and share insights that inform the continuous improvement of our models while facing various business challenges. Key Responsibilities:

• Develop validation frameworks and statistical tests for ML
• Own regression test suites for LLM and ML models
• Perform evaluations to assess model capabilities
• Monitor and address production model performance issues
• Provide clear documentation on evaluation methodologies

Requirements:

• Background in data science or machine learning
• Expertise in Python and core data science libraries
• Understanding of A/B testing and statistical concepts
• Experience with LLM evaluation techniques
• Strong attention to detail for quality assurance

Shape the future of AI systems at Jobber by applying your skills in machine learning evaluation. #J-18808-Ljbffr