Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Copy Of Software Developer - Ai Coding Assistant Evaluation

$100 per hour

Liftedanupworkcompany

We are looking for developers who have a software project they personally own, such as a side project, personal tool, or open-source library.In this project, you will use an AI coding assistant to work on your existing software project. This may involve building new features, fixing bugs, refactoring code, or writing documentation. As you work, you will be presented with two versions of the AI assistant's response and asked to select the one that works better, along with a short explanation of your choice.What You'll Do:
Bring and work on a software project that you personally own and maintain in a Git repository.Use an AI coding assistant to build features, fix bugs, refactor code, and improve documentation.Review and compare two versions of AI-generated coding responses.Evaluate which response is more useful, accurate, and effective for your project.Provide clear, honest feedback explaining why you selected one response over the other.Work comfortably with terminal commands and Git during project sessions.Follow project guidelines and ensure that no passwords, API keys, or other people's personal information are included in your sessions.Requirements:
Experienced software developer with a personal software project that you own and maintain in a Git repository.Comfortable working with terminal commands and Git.Has a computer running macOS, Linux, or Windows with WSL2.Able to review and evaluate AI-generated code and coding suggestions.Strong written communication skills, with the ability to explain decisions clearly and briefly.Able to provide independent and honest feedback without using AI assistance to write evaluation responses.Nice to Haves:
Experience maintaining open-source software projects.Experience building personal tools, applications, libraries, or other software projects.Familiarity with AI coding assistants and developer productivity tools.Experience with software debugging, feature development, code refactoring, and documentation.Fully remote freelance opportunity.
Worldwide applicants are welcome, subject to project eligibility.Rate: Up to $100 per hour.Expected Workload:
Approximately 10-39 hours per week, depending on project needs.Work volume may fluctuate throughout the contract.Payments will be released weekly as a lump sum for work completed during the previous week.AI usage during the project will be covered, so candidates will not need to pay for an AI subscription or API usage.Project Eligibility and Ownership Requirements:
Candidates must bring a software project they personally and solely own.Open-source projects must have an approved license. Projects with multiple maintainers may require additional confirmation.Projects owned by an employer, client, university, or startup are not eligible.Projects covered by an NDA are not eligible.Projects involving AI model training or evaluation, machine learning infrastructure, security exploit tooling, or the processing of other people's personal data are not eligible.The client's team must review and approve the project before work begins.Selected candidates must sign contributor terms before starting.Important Privacy and Participation Notes:
Transcripts from project sessions will be used to improve AI models. Once submitted, these transcripts cannot be withdrawn.Only project session transcripts will be shared, not the rest of the candidate's software project.Ratings and written feedback provided by candidates will become part of the project's deliverables.Candidates must not include passwords, API keys, or other people's personal information in their sessions.All ratings and written evaluations must be completed independently, without AI assistance.Important: An active Upwork contract is required before candidates can receive onboarding instructions, access to the evaluation platform, or payment for the project. Candidates should accept the contract offer once received.Due to the high volume of applicants being contacted, the team may not be able to respond to every individual message. Thank you for your understanding.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Copy Of Software Developer - Ai Coding Assistant Evaluation in Winnipeg, MB vacancy
  • Use an AI coding assistant on your personally owned software project while comparing generated solutions and explaining your decisions clearly.This fully remote freelance project suits experienced software developers maintaining a Git repository. You will build features, fix... 
    Suggested
    Freelance
    Remote work

    Liftedanupworkcompany

    Winnipeg, MB
    1 hour ago
  • Evaluate AI-generated code remotely for Alignerr while applying software engineering, debugging, and code review expertise. Work flexibly on an hourly contract from Calgary.Alignerr seeks Software Engineers to build, evaluate, and improve AI-generated code. You will write solutions... 
    Suggested
    Hourly pay
    Contract work
    Remote work

    Alignerr Corp.

    Winnipeg, MB
    1 hour ago
  • Evaluate AI-generated code remotely from Canada using software expertise, detailed rubrics, and strong written communication skills. Flexible contract work offers 20+ hours weekly.As a Senior Software Engineer AI Data contributor, you will assess coding agents through codebases... 
    Suggested
    Ongoing contract
    Contract work
    For contractors
    Remote work
    Flexible hours

    OpenTrain AI, Inc.

    Winnipeg, MB
    1 hour ago
  • Use AI coding assistants, Java, and Spring Boot daily at Accommodations Plus International to build tested backend services and APIs.This Senior Backend Developer position combines hands-on software development with practical AI-assisted workflows. You will design, implement... 
    Suggested

    Accommodations Plus International

    Winnipeg, MB
    1 hour ago
  • Turing, based in San Francisco, is hiring a Software Engineering evaluator to create cutting-edge datasets for...  ...large language models. You will curate code examples, provide precise solutions,...  ..., Java, Rust, and Go, while evaluating AI-generated code for efficiency and reliability... 
    Suggested
    Contract work

    Turing Enterprises, Inc.

    Winnipeg, MB
    1 hour ago
  • # Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. · , CABack to resultsPython Developer-AI...  ...DescriptionFreelancing Opportunity: We are hiring Senior Software Engineers - Python / TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on improving AI models... 
    Hourly pay
    Contract work
    Temporary work
    Freelance
    Immediate start
    Remote work

    Linuxassociation

    Winnipeg, MB
    1 hour ago
  •  ...G2i Inc. is seeking a Senior Software Engineer, AI Training, to help evaluate the quality of AI-assisted coding interactions. This is a remote contract role with flexible hours and weekly commitment. You will review how models think like engineers, assess explanations,... 
    Contract work
    Remote work
    Flexible hours

    G2i Inc.

    Winnipeg, MB
    1 hour ago
  • Use AI coding agents to deliver reliable applications at Remitly, with measurement, prompt iteration...  ...ownership from requirements onward.This Software Engineer II role focuses on directing AI...  ...and ship complete solutions. You will evaluate generated output against security,... 

    Remitly

    Winnipeg, MB
    1 hour ago
  •  ...straight to your home. Employee and Family Assistance Program (EFAP) - You and your family...  ...for a passionate and experienced Software Developer with expertise in .NET to join our team....  ...business objectives. • Participate in code reviews to ensure high-quality, maintainable... 

    Price Industries Limited

    Winnipeg, MB
    3 days ago
  •  ...speaks to you, we need you!We are currently looking for an AI Software Developer to join our AI team. This position reports to the AI...  ...integrating MCP (Model Context Protocol) serversExperience with AI evaluation, observability, or LLMOps/MLOps practicesExperience with... 
    Work at office
    Work from home
    Worldwide

    Stingray

    Winnipeg, MB
    1 hour ago
  •  ...straight to your home. Employee and Family Assistance Program (EFAP) - You and your family...  ...free Tea and Coffee Job Title: Software Developer Location: Winnipeg Department: Business...  ...development, and the thoughtful use of AI-assisted development tools to explore ideas... 

    Price Industries Limited

    Winnipeg, MB
    3 days ago
  • Build the systems that power digital ad delivery, using AI coding tools as a core part of your daily workflow.Remote — from Victoria, BC Full-time, permanent (35 hrs/week) NOC 21232 — Software developers and programmersAdButler is an ad serving and management platform built... 
    Permanent employment
    Full time
    Remote work
    Worldwide

    Adbutler

    Winnipeg, MB
    1 hour ago
  • Software Developer - Applied AIRemote, Ontario Technology Remote Full-time About Blue JBlue J is the leading generative AI solution for tax professionals and one of Canada's fastest-growing...  ...about shaping the future of AI-assisted tax research. Your work will... 
    Long term contract
    Full time
    Immediate start
    Remote work

    Blue J Legal

    Winnipeg, MB
    1 hour ago
  • Quest Software is seeking an experienced Senior Software Developer to help bring AI-powered coding practices into an established on-premises enterprise software product. This role combines strong hands-on C#/.NET and C++ development with practical experience using AI coding... 
    Work at office
    Remote work
    Worldwide
    Flexible hours

    Quest Software

    Winnipeg, MB
    1 hour ago
  •  ...Alignerr is seeking Software Engineers in Calgary for a fully remote, flexible contract role. You will build, evaluate, and improve AI-generated code, helping train AI systems to think like real developers. The role involves hands-on coding, code review, and providing expert... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    Alignerr Corp.

    Winnipeg, MB
    1 hour ago
  • Lead agentic AI development as a Senior Software Developer with Euna Grants in hybrid Oakville, Ontario, using C# and .NET expertise daily.At L3, you will anchor...  ..., prompts, and escalation paths with clarity. AI-assisted development is central to the day-to-day workflow.Key Responsibilities... 

    Euna Solutions

    Winnipeg, MB
    1 hour ago
  • Create AI-orchestrated workflow experiences for Asana users in Vancouver, combining clean code, thoughtful testing, and product-focused engineering...  ...hybrid.Asana is hiring Software Engineers for high-impact...  ...product surfaces, trust systems, evaluation, and observability across... 
    Work at office

    Asana, Inc.

    Winnipeg, MB
    1 hour ago
  •  ...straight to your home. Employee and Family Assistance Program (EFAP) - You and your family...  ...to be a part of that. Lab Systems Software Developer We are looking for a Software Developer...  ...clean, efficient, and well-documented code • Document system architecture, workflows... 

    Price Industries Limited

    Winnipeg, MB
    3 days ago
  • We are seeking an Intermediate Software Developer experienced in development within on-premise or cloud development environments who can build product features primarily by directing AI coding agents through a plan-first, test-verified workflow — writing specs and plans, reviewing... 
    Flexible hours

    Motorola Solutions Inc

    Winnipeg, MB
    1 hour ago
  • Shape AI-assisted software solutions as a Senior Software Developer at MNP, applying systems thinking and enterprise development expertise. Work across backend and frontend technologies.Within MNP’s Technology - Development team, you will translate business processes and challenges... 

    Mnp Llp

    Winnipeg, MB
    1 hour ago
  •  ...themselves, everyone is welcome. Motive are seeking a Senior AI Software Developer to join our Iron Man project being developed using Unreal...  ...other developers on the AI team and participate in design and code reviews Work closely with QV and technical leadership to ensure... 
    Local area

    Electronic Arts

    Winnipeg, MB
    1 hour ago
  • Safe Software is looking for an experienced developer to join our Cloud Applications team and take a leading technical role in our FME AI Service, AI Assist Plugin, and future AI product offerings. This is deliberately a hybrid role. We need the software engineering depth... 
    Seasonal work
    Immediate start
    Remote work
    Flexible hours

    Safe Software

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

     ...inference for the world's most dynamic AI companies, like Cursor, Notion,...  ...infrastructure, and seamless developer tooling, we enable companies...  ...tooling to keep it accurate as code moves). Internal MCP servers...  ...rollout, operation, measurement. Evaluate and integrate third-party AI... 
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  • $180k - $220k per year

    Position: AI/ML Platform Software Developer Location: Calgary, Alberta or Remote — Canada Experience: 8+ years software development;...  ...capabilities from proof of concept through production, including evaluation, monitoring, iteration, reliability, and operational... 
    Full time
    Remote work

    Cornerbridge Talent Partners

    Winnipeg, MB
    1 hour ago
  • Build AI-enhanced products remotely from Canada using Java, Spring...  ...TypeScript, and React. Shape software for distributors and...  ...connected workflows.As an AI Product Developer at DemandBridge, you will help...  ..., and deployment practicesUse coding agents to improve development... 
    Remote work

    DemandBridge

    Winnipeg, MB
    1 hour ago
  •  ...be themselves, everyone is welcome.Motive are seeking a Senior AI Software Developer to join our Iron Man project being developed using Unreal...  ...other developers on the AI team and participate in design and code reviewsWork closely with QV and technical leadership to ensure... 

    Motive

    Winnipeg, MB
    1 hour ago
  •  ...Café offers free Tea and Coffee. ERP Software Developer An ERP Software Developer designs, develops...  ...to end-users. • Continuously evaluate and improve existing ERP systems to enhance...  .... • Document development processes, coding standards, and technical specifications.... 

    Price Industries Limited

    Winnipeg, MB
    3 days ago
  • $180k - $200k per year

     ...Job Title: Staff Data Scientist (AI & Machine Learning) Location: Vancouver, BC – 3 days...  ...and instill a rigorous engineering culture (code quality, reproducibility, and TDD) within the...  ...Must Have 10+ years of experience in software or data science, with at least 8+ years... 
    3 days per week

    TEEMA Group

    Winnipeg, MB
    3 days ago
  • Build advanced AI solutions for Smile Digital Health, using RAG, semantic matching, and...  ...scalable healthcare products.This Senior Software Developer works with Smile Labs in the Product...  ...and prototype emerging technologiesConduct code reviews, pair programming, and problem analysisSupport... 

    Smile Digital Health

    Winnipeg, MB
    1 hour ago
  •  ...to your home. • Employee and Family Assistance Program (EFAP) - You and your family will...  ...Price Café offers free Tea and Coffee. Software Developer – Antec Controls The Systems...  ...indicators. • Writing clean and scalable code, following code best practices. • Troubleshooting... 

    Price Industries Limited

    Winnipeg, MB
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Copy Of Software Developer - Ai Coding Assistant Evaluation. Be the first to apply!