Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Python Developer-Ai Evaluation

Linuxassociation

# Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. ·, CABack to resultsPython Developer-AI EvaluationZettaMine Labs Pvt. Ltd., CA Posted October 29, 2026 Via JobLeads### Full Job DescriptionFreelancing Opportunity: We are hiring Senior Software Engineers – Python / TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on improving AI models through high-quality training data, preference data evaluation, and engineering workflows.Candidates must be based in Canada.Role: Python Developer-AI EvaluationExperience: 4+ YearsLocation: CanadaMode of Work: RemoteEngagement: Freelance / Project-BasedMandatory Eligibility CriteriaTechnical Qualification:

  • Experience building, maintaining, and improving software pipelines and infrastructure.
  • Hands-on experience with preference data collection and/or rubric creation.
  • Ability to review technical data and evaluate quality using defined criteria.
  • Strong analytical, problem-solving, and technical judgment skills.
  • Experience working with large codebases, such as VS Code, is an advantage.
  • Ability to explain why a technical solution or output is good, accurate, and effective.
  • Strong written and verbal communication skills.Educational Qualification:
  • Bachelor’s or Master’s degree in a relevant field, including BCA, B.Tech, B.E., MCA, or M.Tech.Experience:
  • Candidates from Tier 1 companies are preferred.
  • Candidates must not currently be working with Microsoft.Availability:
  • Minimum 4 hours per day and 20 hours per week.
  • Minimum 4 hours of overlap with Pacific Standard Time (PST) working hours.
  • Immediate availability preferred.
  • Ability to commit to the full 3-month contract.Others:
  • An updated LinkedIn profile is mandatory for candidate review. Please include the LinkedIn profile URL in your resume.
  • Ability to work independently in a fully remote environment.
  • Strong attention to detail and commitment to high-quality deliverables.
  • Ability to work in a fast-paced environment and deliver results within deadlines.
  • Good communication and collaboration skills to work with researchers and engineering teams.What You’ll Work On
  • Design, develop, and improve evaluation rubrics and criteria for preference data.
  • Review and label data while ensuring high standards of quality and accuracy.
  • Identify subtle issues and inconsistencies in data and evaluation results.
  • Build and maintain pipelines and infrastructure for data generation, collection, and evaluation.
  • Analyze technical findings and prepare clear reports, summaries, and recommendations.
  • Collaborate with researchers and engineers to convert qualitative judgments into scalable processes.
  • Support AI training and evaluation workflows to improve the quality of AI model outputs.
  • Communicate technical findings clearly and recommend improvements to project teams.Evaluation Process
  • AI Interview
  • Technical and Cultural Interview – Approximately 30 minutes.Perks of Freelancing
  • Fully remote work environment.
  • Opportunity to work on cutting-edge AI projects with leading AI companies.
  • Opportunity to contribute to AI model training, evaluation, and engineering initiatives.
  • Competitive hourly compensation based on candidate quality and interview feedback.#J-18808-Ljbffr

Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Python Developer-Ai Evaluation in Winnipeg, MB vacancy
  •  ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our...  ...client. You will play a key role in developing and enhancing an enterprise AI platform...  ...observability, monitoring, telemetry, and evaluation platforms. ~ Strong knowledge of... 
    Suggested
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    6 days ago
  • NOW HIRING: PYTHON DEVELOPER GENAI / AILocation: Mississauga, Ontario, Canada Client: Citi Bank...  ...with strong expertise in Generative AI, LLMs, RAG, Agentic AI, Data Engineering...  ...Guardrails and GenAI performance/safety evaluation. PYTHON & DATA ENGINEERING Strong... 
    Suggested
    Full time

    SIDRAM TECHNOLOGIES

    Winnipeg, MB
    1 hour ago
  • UKG is looking to hire a Python Engineer to join our extremely talented Data Science team....  ...where you can work on the next generation AI Platform. You’ll get to work directly with...  ...cloud. The job requires you to be able to develop and troubleshoot complex software applications... 
    Suggested
    Local area

    Kronos Incorporated

    Winnipeg, MB
    59 minutes ago
  • Build AI and machine learning solutions with Python, AWS, and large language model expertise in a professional software development role.This developer role suits professionals with five or more years of software development experience. You will apply Python frameworks and... 
    Suggested

    Astra-North Infoteck Inc.

    Winnipeg, MB
    54 minutes ago
  • Sr Python Developer (with AI) This is with a global IT services firm for a leading investment/wealth management services firm.Client Location is downtown Toronto Ontario, close to TTC and GO service.Hybrid - In Office 4 days per week.Contract - 6 months, possible renewalTarget... 
    Suggested
    Contract work
    For contractors
    Work at office

    Carlos Goncalves

    Winnipeg, MB
    54 minutes ago
  • Apply Python, PyTest, and AI-assisted development practices to AlayaCare’s fullstack products from Montréal’s hybrid office.As an Intermediate Fullstack Developer, you will help develop AlayaCare Cloud features for Admission and Marketplace. Your work can support rebuilt intake... 
    Work at office

    SportsTechJobs

    Winnipeg, MB
    54 minutes ago
  •  ...Python Developer Needed for Quantara AI Development We are building out features for our Quantara AI business and need a skilled Python freelancer to join us. Scope & Requirements: Build and integrate clean, responsive Python components. Connect with backend... 
    Freelance
    Internship

    BotDigit Inc.

    Winnipeg, MB
    57 minutes ago
  • Chatbot Content Developer - Python/Java, AI. Chatbot Content Developer – Documentation Modernization & AI EnablementWork Arrangement: 1 day onsite per week Experience Required: 6–8 years Role DescriptionReview, analyze, and improve technical documentation used... 
    1 day per week

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  • Become an integral AI Developer in Toronto, specializing in Python, AWS, and Generative AI. This contract role offers a hybrid work environment while advancing your technical skills. This position is ideal for those with strong Python programming skills and extensive knowledge... 
    Contract work

    Apptoza Inc.

    Winnipeg, MB
    1 hour ago
  • Python, SQL, and Azure data expertise define this Senior Software Developer ETL position with Metrolinx in Toronto. Work hybrid, onsite three days weekly.The senior developer...  ...build reusable data services supporting enterprise AI, machine learning, Generative AI, analytics, and... 

    S M Software Solutions Inc

    Winnipeg, MB
    1 hour ago
  • $90k - $120k per year

     ...related technologies in a large organization developing large, scalable, distributed systems...  ...systems Working as a software developer working with Agile methodologies and practices...  ...intelligence tools for candidate screening or evaluation. This posting is for a current... 

    Tata Consultancy Services Limited

    Winnipeg, MB
    54 minutes ago
  • We are looking for a skilled Python Developer with 3-5 years of experience in developing, implementing, and maintaining scalable applications....  ...background task processing. Basic understanding of Machine Learning or AI integration. Familiarity with Agile/Scrum development... 

    G-FORCE IT SERVICES INC

    Winnipeg, MB
    57 minutes ago
  • $100k - $110k per year

    Senior Python Software Engineer - TorontoWe’re unlocking community knowledge in a new,Veterally improve memory usage. Actually in new way....  ...add insights directly into each article, started with the help of AI. Location: Toronto, Ontario, Canada Salary: CA$100,000... 
    Contract work

    VBeyond Corporation

    Winnipeg, MB
    1 hour ago
  •  ...Consulting is currently seeking a highly motivated Python Engineer for an opportunity in Mississauga...  .... Responsibilities: Design, develop, test, and support Python-based applications...  ...driven integrations. Contribute to Agentic AI workflows and MCP-enabled application... 
    Long term contract
    Contract work
    Temporary work
    Immediate start

    TSR Consulting

    Winnipeg, MB
    1 hour ago
  •  ...Design, develop, test, and support Python-based applications and services. Build and maintain REST APIs, microservices, and event-driven integrations. Contribute to development of Agentic AI workflows and MCP-enabled application components. Implement integrations between... 
    Contract work
    Remote work

    IT Connex

    Winnipeg, MB
    59 minutes ago
  • $120k - $130k per year

    Job Title: Python Developer with Java exp. Work Arrangement: Hybrid (3 days) Employment Type: Full-Time Perm. Rate: CAD 120-130K/Year...  ...for employment. DISCLAIMERAI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are... 
    Permanent employment
    Full time

    Pacer Group

    Winnipeg, MB
    1 hour ago
  •  ...required 3x/week) Years of experience: ~5-7 years of Python & Database experience (70%) ~2-3 years of hands-on AI project experience (30%) Skills Required: Strong proficiency of Python with experience developing production-grade data processing pipelines and AI/ML... 
    Work at office

    Soho Square Solutions

    Winnipeg, MB
    1 hour ago
  • $100 per hour

     ...We are looking for developers who have a software project they personally...  ...this project, you will use an AI coding assistant to work on...  ...generated coding responses. Evaluate which response is more useful,...  ...Requirements: Experienced software developer with a personal software... 
    Hourly pay
    Contract work
    Freelance
    Remote work
    Worldwide
    10 hours per week

    Liftedanupworkcompany

    Winnipeg, MB
    1 hour ago
  •  ...needs. Schedule Hours: 9am-5pm Monday-Friday; standard 37.5 hrs/week Qualifications 10+ years of relevant experience as Python Developer. 5+ years of hands‑on experience in Python such as Django and Flask. Good understanding of libraries like NumPy, SciPy, Pandas,... 
    Contract work
    Monday to friday

    Lancesoft

    Winnipeg, MB
    59 minutes ago
  •  ...security| performance| and reusability Qualification Must have 3-4 years working experience as a software developer Must-have 3 years experience with Python 3 years experience with Relational Databases and SQL (MSSQL| Oracle) Experience with Apache Airflow... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  •  ...reduce cost. Spend 10-20% supporting other teams’ applications. Qualifications ~ Hard Skills ~8+ years of experience within python based development and programming ~ Experience within application architecture design (software) ~ Experience with Linux operating... 
    Contract work

    TekStaff IT Solutions

    Winnipeg, MB
    56 minutes ago
  • # Python DeveloperIris Software Inc. · Toronto, Ontario, CABack to resultsPython DeveloperIris Software Inc.Toronto, Ontario, CA Posted...  ...and financial services corporation is looking to hire a Python Developer Our direct client is a is a world-leading financial services company... 

    Linuxassociation

    Winnipeg, MB
    59 minutes ago
  •  ...with Linux platform, and CI/CD integration tools Proficiency in Python and Flask framework. Strong understanding of React.Js and its...  ...is a plus What will you do?Front-end Development (React) Develop and maintain user interfaces (UI) using React.Js, HTML, CSS, and... 

    Jay Analytix

    Winnipeg, MB
    1 hour ago
  •  ...: 5+ years of professional experience in software development. Strong proficiency in Python (FastAPI, Flask, asyncio, pandas, etc.). Hands-on experience with AWS services related to AI/ML and serverless architectures. Strong understanding of LLMs, transformers, embeddings... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  • $65.21 - $86.95 per hour

     ...Are you an experienced Python Developer ready to make an impact? Apply Now! Working with one of our top financial clients, this role calls for...  ...enabled tools, including automation and artificial intelligence (AI), to support parts of the recruitment process such as resume... 

    BeachHead

    Winnipeg, MB
    1 hour ago
  •  ...the RoleWe are seeking a Senior Full Stack Developer to join our AlayaLabs team within the Data...  .... Build innovative features, including AI features leveraging LLMs. Contribute,...  ...frameworks. Development experience in Python. Experience using SQL databases, Git, CI... 
    Full time

    AlayaCare

    Winnipeg, MB
    1 hour ago
  •  ...deadlocks, etc.). Significant experience with at least one dynamically typed, object-oriented programming language (preference for Python). Great understanding of distributed systems and microservice architecture. Hands-on experience in using message brokers such as... 

    VySystems

    Winnipeg, MB
    1 hour ago
  •  ...PandasIntermediate NumPyAdvanced SQL / OracleAdvanced Apache SparkStrong coding and Big Data processing experience is mandatoryNOW HIRING PYTHON DEVELOPER Client: CitiRole: Python DeveloperExperience: 10+ YearsLocation: Mississauga, CanadaEmployment Type: Full-Time /... 
    Full time

    SIDRAM TECHNOLOGIES

    Winnipeg, MB
    1 hour ago
  •  ...experienced Senior Automation Engineer with strong expertise in Python programming, UNIX/Linux shell scripting, software deployment...  ..., and Linux server administration. The role will focus on developing and maintaining automation solutions for infrastructure patching... 

    KTek Resourcing LLC

    Winnipeg, MB
    57 minutes ago
  • We’re looking for aSenior Python Developer to join BrainyYack and help build modern, scalable applications and AI-powered solutions for our clients.The ideal candidate is a strong hands-on engineer who can take ownership of complex backend development, architecture, integrations... 
    Remote work

    Brainyyack

    Winnipeg, MB
    59 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Python Developer-Ai Evaluation. Be the first to apply!