Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Python Developer-Ai Evaluation

Linuxassociation

# Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. ·, CABack to resultsPython Developer-AI EvaluationZettaMine Labs Pvt. Ltd., CA Posted October 29, 2026 Via JobLeads### Full Job DescriptionFreelancing Opportunity: We are hiring Senior Software Engineers – Python / TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on improving AI models through high-quality training data, preference data evaluation, and engineering workflows.Candidates must be based in Canada.Role: Python Developer-AI EvaluationExperience: 4+ YearsLocation: CanadaMode of Work: RemoteEngagement: Freelance / Project-BasedMandatory Eligibility CriteriaTechnical Qualification:

  • Experience building, maintaining, and improving software pipelines and infrastructure.
  • Hands-on experience with preference data collection and/or rubric creation.
  • Ability to review technical data and evaluate quality using defined criteria.
  • Strong analytical, problem-solving, and technical judgment skills.
  • Experience working with large codebases, such as VS Code, is an advantage.
  • Ability to explain why a technical solution or output is good, accurate, and effective.
  • Strong written and verbal communication skills.Educational Qualification:
  • Bachelor’s or Master’s degree in a relevant field, including BCA, B.Tech, B.E., MCA, or M.Tech.Experience:
  • Candidates from Tier 1 companies are preferred.
  • Candidates must not currently be working with Microsoft.Availability:
  • Minimum 4 hours per day and 20 hours per week.
  • Minimum 4 hours of overlap with Pacific Standard Time (PST) working hours.
  • Immediate availability preferred.
  • Ability to commit to the full 3-month contract.Others:
  • An updated LinkedIn profile is mandatory for candidate review. Please include the LinkedIn profile URL in your resume.
  • Ability to work independently in a fully remote environment.
  • Strong attention to detail and commitment to high-quality deliverables.
  • Ability to work in a fast-paced environment and deliver results within deadlines.
  • Good communication and collaboration skills to work with researchers and engineering teams.What You’ll Work On
  • Design, develop, and improve evaluation rubrics and criteria for preference data.
  • Review and label data while ensuring high standards of quality and accuracy.
  • Identify subtle issues and inconsistencies in data and evaluation results.
  • Build and maintain pipelines and infrastructure for data generation, collection, and evaluation.
  • Analyze technical findings and prepare clear reports, summaries, and recommendations.
  • Collaborate with researchers and engineers to convert qualitative judgments into scalable processes.
  • Support AI training and evaluation workflows to improve the quality of AI model outputs.
  • Communicate technical findings clearly and recommend improvements to project teams.Evaluation Process
  • AI Interview
  • Technical and Cultural Interview – Approximately 30 minutes.Perks of Freelancing
  • Fully remote work environment.
  • Opportunity to work on cutting-edge AI projects with leading AI companies.
  • Opportunity to contribute to AI model training, evaluation, and engineering initiatives.
  • Competitive hourly compensation based on candidate quality and interview feedback.#J-18808-Ljbffr

Vacancy posted 52 minutes ago
Similar jobs that could be interesting for youBased on the Python Developer-Ai Evaluation in Winnipeg, MB vacancy
  •  ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our...  ...client. You will play a key role in developing and enhancing an enterprise AI platform...  ...observability, monitoring, telemetry, and evaluation platforms. ~ Strong knowledge of... 
    Suggested
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    5 days ago
  • Build AI and machine learning solutions with Python, AWS, and large language model expertise in a professional software development role.This developer role suits professionals with five or more years of software development experience. You will apply Python frameworks and... 
    Suggested

    Astra-North Infoteck Inc.

    Winnipeg, MB
    48 minutes ago
  • UKG is looking to hire a Python Engineer to join our extremely talented Data Science team....  ...where you can work on the next generation AI Platform. You’ll get to work directly with...  ...cloud. The job requires you to be able to develop and troubleshoot complex software applications... 
    Suggested
    Local area

    Kronos Incorporated

    Winnipeg, MB
    50 minutes ago
  • Apply Python, PyTest, and AI-assisted development practices to AlayaCare’s fullstack products from Montréal’s hybrid office.As an Intermediate Fullstack Developer, you will help develop AlayaCare Cloud features for Admission and Marketplace. Your work can support rebuilt intake... 
    Suggested
    Work at office

    SportsTechJobs

    Winnipeg, MB
    54 minutes ago
  • Chatbot Content Developer - Python/Java, AI. Chatbot Content Developer – Documentation Modernization & AI EnablementWork Arrangement: 1 day onsite per week Experience Required: 6–8 years Role DescriptionReview, analyze, and improve technical documentation used... 
    Suggested
    1 day per week

    Astra-North Infoteck Inc.

    Winnipeg, MB
    50 minutes ago
  • Python, SQL, and Azure data expertise define this Senior Software Developer ETL position with Metrolinx in Toronto. Work hybrid, onsite three days weekly.The senior developer...  ...build reusable data services supporting enterprise AI, machine learning, Generative AI, analytics, and... 

    S M Software Solutions Inc

    Winnipeg, MB
    52 minutes ago
  •  ...required 3x/week) Years of experience: ~5-7 years of Python & Database experience (70%) ~2-3 years of hands-on AI project experience (30%) Skills Required: Strong proficiency of Python with experience developing production-grade data processing pipelines and AI/ML... 
    Work at office

    Soho Square Solutions

    Winnipeg, MB
    50 minutes ago
  •  ...Design, develop, test, and support Python-based applications and services. Build and maintain REST APIs, microservices, and event-driven integrations. Contribute to development of Agentic AI workflows and MCP-enabled application components. Implement integrations between... 
    Contract work
    Remote work

    IT Connex

    Winnipeg, MB
    52 minutes ago
  • $120k - $130k per year

    Job Title: Python Developer with Java exp. Work Arrangement: Hybrid (3 days) Employment Type: Full-Time Perm. Rate: CAD 120-130K/Year...  ...for employment. DISCLAIMERAI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are... 
    Permanent employment
    Full time

    Pacer Group

    Winnipeg, MB
    54 minutes ago
  • $100k - $110k per year

    Senior Python Software Engineer - TorontoWe’re unlocking community knowledge in a new,Veterally improve memory usage. Actually in new way....  ...add insights directly into each article, started with the help of AI. Location: Toronto, Ontario, Canada Salary: CA$100,000... 
    Contract work

    VBeyond Corporation

    Winnipeg, MB
    51 minutes ago
  • We are looking for a skilled Python Developer with 3-5 years of experience in developing, implementing, and maintaining scalable applications....  ...background task processing. Basic understanding of Machine Learning or AI integration. Familiarity with Agile/Scrum development... 

    G-FORCE IT SERVICES INC

    Winnipeg, MB
    48 minutes ago
  •  ...Consulting is currently seeking a highly motivated Python Engineer for an opportunity in Mississauga...  .... Responsibilities: Design, develop, test, and support Python-based applications...  ...driven integrations. Contribute to Agentic AI workflows and MCP-enabled application... 
    Long term contract
    Contract work
    Temporary work
    Immediate start

    TSR Consulting

    Winnipeg, MB
    52 minutes ago
  •  ...the RoleWe are seeking a Senior Full Stack Developer to join our AlayaLabs team within the Data...  .... Build innovative features, including AI features leveraging LLMs. Contribute,...  ...frameworks. Development experience in Python. Experience using SQL databases, Git, CI... 
    Full time

    AlayaCare

    Winnipeg, MB
    48 minutes ago
  • # Python DeveloperIris Software Inc. · Toronto, Ontario, CABack to resultsPython DeveloperIris Software Inc.Toronto, Ontario, CA Posted...  ...and financial services corporation is looking to hire a Python Developer Our direct client is a is a world-leading financial services company... 

    Linuxassociation

    Winnipeg, MB
    50 minutes ago
  •  ...needs. Schedule Hours: 9am-5pm Monday-Friday; standard 37.5 hrs/week Qualifications 10+ years of relevant experience as Python Developer. 5+ years of hands‑on experience in Python such as Django and Flask. Good understanding of libraries like NumPy, SciPy, Pandas,... 
    Contract work
    Monday to friday

    Lancesoft

    Winnipeg, MB
    52 minutes ago
  •  ...with Linux platform, and CI/CD integration tools Proficiency in Python and Flask framework. Strong understanding of React.Js and its...  ...is a plus What will you do?Front-end Development (React) Develop and maintain user interfaces (UI) using React.Js, HTML, CSS, and... 

    Jay Analytix

    Winnipeg, MB
    48 minutes ago
  •  ...security| performance| and reusability Qualification Must have 3-4 years working experience as a software developer Must-have 3 years experience with Python 3 years experience with Relational Databases and SQL (MSSQL| Oracle) Experience with Apache Airflow... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    50 minutes ago
  • Job Description Insight Global is hiring for a SAS/Python Developer on a 12-month contract for a leading banking client. This is a hybrid role...  ...using GitHub Copilot and an understanding of AI-assisted development toolsStrong understanding of data concepts... 
    Contract work
    Remote work

    Insight Global (United States)

    Winnipeg, MB
    47 minutes ago
  • 3-5 years of SAS/Python development experienceAdvanced SAS: Data Steps, Macros, SAS SQL...  ...Copilot: Practical experience with AI-assisted developmentData: Strong understanding...  ...Global is hiring for a SAS/Python Developer on a 12-month contract for a leading banking... 
    Contract work
    Remote work

    Insight Global (United States)

    Winnipeg, MB
    52 minutes ago
  •  ...reduce cost. Spend 10-20% supporting other teams’ applications. Qualifications ~ Hard Skills ~8+ years of experience within python based development and programming ~ Experience within application architecture design (software) ~ Experience with Linux operating... 
    Contract work

    TekStaff IT Solutions

    Winnipeg, MB
    50 minutes ago
  •  ...deadlocks, etc.). Significant experience with at least one dynamically typed, object-oriented programming language (preference for Python). Great understanding of distributed systems and microservice architecture. Hands-on experience in using message brokers such as... 

    VySystems

    Winnipeg, MB
    52 minutes ago
  •  ...experienced Senior Automation Engineer with strong expertise in Python programming, UNIX/Linux shell scripting, software deployment...  ..., and Linux server administration. The role will focus on developing and maintaining automation solutions for infrastructure patching... 

    KTek Resourcing LLC

    Winnipeg, MB
    49 minutes ago
  • $100 per hour

     ...We are looking for developers who have a software project they personally...  ...this project, you will use an AI coding assistant to work on...  ...generated coding responses. Evaluate which response is more useful,...  ...Requirements: Experienced software developer with a personal software... 
    Hourly pay
    Contract work
    Freelance
    Remote work
    Worldwide
    10 hours per week

    Liftedanupworkcompany

    Winnipeg, MB
    48 minutes ago
  •  ...consistent studio culture across teams. Job Description The Python Software Developer designs, develops, integrates, and maintains software...  ...of Artificial Intelligence in Recruitment Rodeo FX may use AI‑based tools to support certain steps of the recruitment process... 
    Internship
    Local area

    Rodeo FX Group

    Winnipeg, MB
    49 minutes ago
  •  ...2026SKILLS REQUIRED: Must have strong and 5-7 years' experience in Python coding.Excellent communication skills and understanding.EEOC...  ...applicants will receive consideration for employment.DISCLAIMER AI Usage Policy: Pacer Group uses AI to assist in screening applications... 
    3 days per week

    Pacer Group

    Winnipeg, MB
    50 minutes ago
  •  ...: 5+ years of professional experience in software development. Strong proficiency in Python (FastAPI, Flask, asyncio, pandas, etc.). Hands-on experience with AWS services related to AI/ML and serverless architectures. Strong understanding of LLMs, transformers, embeddings... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    51 minutes ago
  •  ...to work in technology at an investment bank?We are seeking a Python Developer with a proven track record of large scale distributed systems...  ...aspects of the project life cycle and including proof-of-concept evaluations, coding, designing, testing, implementing, and deploying. In... 
    Long term contract
    Full time
    Local area
    Worldwide

    mthree Recruiting Portal

    Winnipeg, MB
    50 minutes ago
  •  ...PandasIntermediate NumPyAdvanced SQL / OracleAdvanced Apache SparkStrong coding and Big Data processing experience is mandatoryNOW HIRING PYTHON DEVELOPER Client: CitiRole: Python DeveloperExperience: 10+ YearsLocation: Mississauga, CanadaEmployment Type: Full-Time /... 
    Full time

    SIDRAM TECHNOLOGIES

    Winnipeg, MB
    53 minutes ago
  • $100k - $120k per year

    Are you a full stack developer who wants to build reliable, production...  ...hiring an Intermediate Full Stack Python Developer to join an...  ...production conditionsSomeone who uses AI coding tools with discipline,...  ...on AI tools, and new ones are evaluated as soon as they appearA... 
    Night shift
    3 days per week

    STACK IT Recruitment

    Winnipeg, MB
    49 minutes ago
  •  ...About the RoleWe are seeking a Fullstack Developer (Python) to join our Market team. You will work...  ...We are building a new team, you will use AI to break down boundaries and deliver...  ...Ability to analyze technical problems, evaluate possible solutions, and seek guidance when... 
    Full time
    Work at office
    Flexible hours

    AlayaCare

    Winnipeg, MB
    52 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Python Developer-Ai Evaluation. Be the first to apply!