Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Python Developer-Ai Evaluation

Linuxassociation

# Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. ·, CABack to resultsPython Developer-AI EvaluationZettaMine Labs Pvt. Ltd., CA Posted October 29, 2026 Via JobLeads### Full Job DescriptionFreelancing Opportunity: We are hiring Senior Software Engineers – Python / TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on improving AI models through high-quality training data, preference data evaluation, and engineering workflows.Candidates must be based in Canada.Role: Python Developer-AI EvaluationExperience: 4+ YearsLocation: CanadaMode of Work: RemoteEngagement: Freelance / Project-BasedMandatory Eligibility CriteriaTechnical Qualification:

  • Experience building, maintaining, and improving software pipelines and infrastructure.
  • Hands-on experience with preference data collection and/or rubric creation.
  • Ability to review technical data and evaluate quality using defined criteria.
  • Strong analytical, problem-solving, and technical judgment skills.
  • Experience working with large codebases, such as VS Code, is an advantage.
  • Ability to explain why a technical solution or output is good, accurate, and effective.
  • Strong written and verbal communication skills.Educational Qualification:
  • Bachelor’s or Master’s degree in a relevant field, including BCA, B.Tech, B.E., MCA, or M.Tech.Experience:
  • Candidates from Tier 1 companies are preferred.
  • Candidates must not currently be working with Microsoft.Availability:
  • Minimum 4 hours per day and 20 hours per week.
  • Minimum 4 hours of overlap with Pacific Standard Time (PST) working hours.
  • Immediate availability preferred.
  • Ability to commit to the full 3-month contract.Others:
  • An updated LinkedIn profile is mandatory for candidate review. Please include the LinkedIn profile URL in your resume.
  • Ability to work independently in a fully remote environment.
  • Strong attention to detail and commitment to high-quality deliverables.
  • Ability to work in a fast-paced environment and deliver results within deadlines.
  • Good communication and collaboration skills to work with researchers and engineering teams.What You’ll Work On
  • Design, develop, and improve evaluation rubrics and criteria for preference data.
  • Review and label data while ensuring high standards of quality and accuracy.
  • Identify subtle issues and inconsistencies in data and evaluation results.
  • Build and maintain pipelines and infrastructure for data generation, collection, and evaluation.
  • Analyze technical findings and prepare clear reports, summaries, and recommendations.
  • Collaborate with researchers and engineers to convert qualitative judgments into scalable processes.
  • Support AI training and evaluation workflows to improve the quality of AI model outputs.
  • Communicate technical findings clearly and recommend improvements to project teams.Evaluation Process
  • AI Interview
  • Technical and Cultural Interview – Approximately 30 minutes.Perks of Freelancing
  • Fully remote work environment.
  • Opportunity to work on cutting-edge AI projects with leading AI companies.
  • Opportunity to contribute to AI model training, evaluation, and engineering initiatives.
  • Competitive hourly compensation based on candidate quality and interview feedback.#J-18808-Ljbffr

Vacancy posted 59 minutes ago
Similar jobs that could be interesting for youBased on the Python Developer-Ai Evaluation in Winnipeg, MB vacancy
  •  ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our...  ...client. You will play a key role in developing and enhancing an enterprise AI platform...  ...observability, monitoring, telemetry, and evaluation platforms. ~ Strong knowledge of... 
    Suggested
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    5 days ago
  • NOW HIRING: PYTHON DEVELOPER GENAI / AILocation: Mississauga, Ontario, Canada Client: Citi Bank...  ...with strong expertise in Generative AI, LLMs, RAG, Agentic AI, Data Engineering...  ...Guardrails and GenAI performance/safety evaluation. PYTHON & DATA ENGINEERING Strong... 
    Suggested
    Full time

    SIDRAM TECHNOLOGIES

    Winnipeg, MB
    57 minutes ago
  • UKG is looking to hire a Python Engineer to join our extremely talented Data Science team....  ...where you can work on the next generation AI Platform. You’ll get to work directly with...  ...cloud. The job requires you to be able to develop and troubleshoot complex software applications... 
    Suggested
    Local area

    Kronos Incorporated

    Winnipeg, MB
    1 hour ago
  • Apply Python, PyTest, and AI-assisted development practices to AlayaCare’s fullstack products from Montréal’s hybrid office.As an Intermediate Fullstack Developer, you will help develop AlayaCare Cloud features for Admission and Marketplace. Your work can support rebuilt intake... 
    Suggested
    Work at office

    SportsTechJobs

    Winnipeg, MB
    58 minutes ago
  • Build Python and React applications with Synechron in a flexible hybrid model, integrating AI features across modern full stack systems.As a Python Full Stack Developer, you will design, develop, test, and maintain scalable web applications. The work spans Django, React, APIs... 
    Suggested
    Flexible hours

    Synechron

    Winnipeg, MB
    1 hour ago
  • Sr Python Developer (with AI) This is with a global IT services firm for a leading investment/wealth management services firm.Client Location is downtown Toronto Ontario, close to TTC and GO service.Hybrid - In Office 4 days per week.Contract - 6 months, possible renewalTarget... 
    Contract work
    For contractors
    Work at office

    Carlos Goncalves

    Winnipeg, MB
    1 hour ago
  • Become an integral AI Developer in Toronto, specializing in Python, AWS, and Generative AI. This contract role offers a hybrid work environment while advancing your technical skills. This position is ideal for those with strong Python programming skills and extensive knowledge... 
    Contract work

    Apptoza Inc.

    Winnipeg, MB
    1 hour ago
  • Chatbot Content Developer - Python/Java, AI Toronto-5 Days WFOKey Roles & Responsibilities Review, analyze, and improve technical documentation used as chatbot knowledge sources. Convert Confluence content into Markdown and documentation-as-code formats. Use GitHub... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  • Python, SQL, and Azure data expertise define this Senior Software Developer ETL position with Metrolinx in Toronto. Work hybrid, onsite three days weekly.The senior developer...  ...build reusable data services supporting enterprise AI, machine learning, Generative AI, analytics, and... 

    S M Software Solutions Inc

    Winnipeg, MB
    1 hour ago
  •  ...Python Developer Needed for Quantara AI Development We are building out features for our Quantara AI business and need a skilled Python freelancer to join us. Scope & Requirements: Build and integrate clean, responsive Python components. Connect with backend... 
    Freelance
    Internship

    BotDigit Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Consulting is currently seeking a highly motivated Python Engineer for an opportunity in Mississauga...  .... Responsibilities: Design, develop, test, and support Python-based applications...  ...driven integrations. Contribute to Agentic AI workflows and MCP-enabled application... 
    Long term contract
    Contract work
    Temporary work
    Immediate start

    TSR Consulting

    Winnipeg, MB
    1 hour ago
  •  ...notre utilisation des technologies. Afin de soutenir notre équipe de recrutement, des outils d’IA peuvent être utilisés pour aider à l’évaluation des candidatures, sans jamais remplacer le jugement humain. Toutes les décisions d'embauche demeurent entièrement entre les mains de... 
    Summer work
    Remote work

    Axelon Services Corporation

    Winnipeg, MB
    57 minutes ago
  • $90k - $120k per year

     ...related technologies in a large organization developing large, scalable, distributed systems...  ...systems Working as a software developer working with Agile methodologies and practices...  ...intelligence tools for candidate screening or evaluation. This posting is for a current... 

    Tata Consultancy Services Limited

    Winnipeg, MB
    58 minutes ago
  • $120k - $130k per year

    Job Title: Python Developer with Java exp. Work Arrangement: Hybrid (3 days) Employment Type: Full-Time Perm. Rate: CAD 120-130K/Year...  ...for employment. DISCLAIMERAI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are... 
    Permanent employment
    Full time

    Pacer Group

    Winnipeg, MB
    1 hour ago
  •  ...Design, develop, test, and support Python-based applications and services. Build and maintain REST APIs, microservices, and event-driven integrations. Contribute to development of Agentic AI workflows and MCP-enabled application components. Implement integrations between... 
    Contract work
    Remote work

    IT Connex

    Winnipeg, MB
    1 hour ago
  • We are looking for a skilled Python Developer with 3-5 years of experience in developing, implementing, and maintaining scalable applications....  ...background task processing. Basic understanding of Machine Learning or AI integration. Familiarity with Agile/Scrum development... 

    G-FORCE IT SERVICES INC

    Winnipeg, MB
    1 hour ago
  • $100k - $110k per year

    Senior Python Software Engineer - TorontoWe’re unlocking community knowledge in a new,Veterally improve memory usage. Actually in new way....  ...add insights directly into each article, started with the help of AI. Location: Toronto, Ontario, Canada Salary: CA$100,000... 
    Contract work

    VBeyond Corporation

    Winnipeg, MB
    1 hour ago
  •  ...required 3x/week) Years of experience: ~5-7 years of Python & Database experience (70%) ~2-3 years of hands-on AI project experience (30%) Skills Required: Strong proficiency of Python with experience developing production-grade data processing pipelines and AI/ML... 
    Work at office

    Soho Square Solutions

    Winnipeg, MB
    1 hour ago
  •  ...technology stacks and Generative AI capabilities. You will...  ...knowledge and hands-on experience with Python frameworks like Django, Flask,...  ...depending on the specialization. Develop and integrate APIs for Gen AI...  ...Conduct rapid experiments to evaluate new LLM versions and features.... 

    Virtusa Corporation

    Winnipeg, MB
    57 minutes ago
  •  ...the RoleWe are seeking a Senior Full Stack Developer to join our AlayaLabs team within the Data...  .... Build innovative features, including AI features leveraging LLMs. Contribute,...  ...frameworks. Development experience in Python. Experience using SQL databases, Git, CI... 
    Full time

    AlayaCare

    Winnipeg, MB
    1 hour ago
  • $100 per hour

     ...We are looking for developers who have a software project they personally...  ...this project, you will use an AI coding assistant to work on...  ...generated coding responses. Evaluate which response is more useful,...  ...Requirements: Experienced software developer with a personal software... 
    Hourly pay
    Contract work
    Freelance
    Remote work
    Worldwide
    10 hours per week

    Liftedanupworkcompany

    Winnipeg, MB
    59 minutes ago
  •  ...experienced Senior Automation Engineer with strong expertise in Python programming, UNIX/Linux shell scripting, software deployment...  ..., and Linux server administration. The role will focus on developing and maintaining automation solutions for infrastructure patching... 

    KTek Resourcing LLC

    Winnipeg, MB
    1 hour ago
  •  ...needs. Schedule Hours: 9am-5pm Monday-Friday; standard 37.5 hrs/week Qualifications 10+ years of relevant experience as Python Developer. 5+ years of hands‑on experience in Python such as Django and Flask. Good understanding of libraries like NumPy, SciPy, Pandas,... 
    Contract work
    Monday to friday

    Lancesoft

    Winnipeg, MB
    1 hour ago
  • $65.21 - $86.95 per hour

     ...Are you an experienced Python Developer ready to make an impact? Apply Now! Working with one of our top financial clients, this role calls for...  ...enabled tools, including automation and artificial intelligence (AI), to support parts of the recruitment process such as resume... 

    BeachHead

    Winnipeg, MB
    59 minutes ago
  • We’re looking for aSenior Python Developer to join BrainyYack and help build modern, scalable applications and AI-powered solutions for our clients.The ideal candidate is a strong hands-on engineer who can take ownership of complex backend development, architecture, integrations... 
    Remote work

    Brainyyack

    Winnipeg, MB
    1 hour ago
  • 3-5 years of SAS/Python development experienceAdvanced SAS: Data Steps, Macros, SAS SQL...  ...Copilot: Practical experience with AI-assisted developmentData: Strong understanding...  ...Global is hiring for a SAS/Python Developer on a 12-month contract for a leading banking... 
    Contract work
    Remote work

    Insight Global (United States)

    Winnipeg, MB
    1 hour ago
  •  ...to work in technology at an investment bank?We are seeking a Python Developer with a proven track record of large scale distributed systems...  ...aspects of the project life cycle and including proof-of-concept evaluations, coding, designing, testing, implementing, and deploying. In... 
    Long term contract
    Full time
    Local area
    Worldwide

    mthree Recruiting Portal

    Winnipeg, MB
    1 hour ago
  •  ...consistent studio culture across teams. Job Description The Python Software Developer designs, develops, integrates, and maintains software...  ...of Artificial Intelligence in Recruitment Rodeo FX may use AI‑based tools to support certain steps of the recruitment process... 
    Internship
    Local area

    Rodeo FX Group

    Winnipeg, MB
    56 minutes ago
  • OverviewAdastra is seeking a SAS/Python Developer to support a large-scale modernization initiative focused on migrating legacy SAS-based workloads...  ...initiatives ABOUT ADASTRAAdastra is a global leader in AI and data-driven transformation, helping organizations lead with... 
    Full time
    For contractors
    Internship
    Remote work
    Flexible hours

    Adastra Group

    Winnipeg, MB
    1 hour ago
  • Poste : Développeur Backend Python - Spécialisation en IA générative (GenAI)Lieu : Montréal, QC (Intégration sur place dès le premier jour;...  ...). Connaissance de la mise en œuvre de l’IA agentique (Agentic AI), des agents intelligents et des outils permettant d’intégrer des... 
    Permanent employment
    Work at office
    3 days per week

    Akkodis

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Python Developer-Ai Evaluation. Be the first to apply!