Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Copy Of Software Developer - Ai Coding Assistant Evaluation

$100 per hour

Liftedanupworkcompany

We are looking for developers who have a software project they personally own, such as a side project, personal tool, or open-source library.In this project, you will use an AI coding assistant to work on your existing software project. This may involve building new features, fixing bugs, refactoring code, or writing documentation. As you work, you will be presented with two versions of the AI assistant's response and asked to select the one that works better, along with a short explanation of your choice.What You'll Do:
Bring and work on a software project that you personally own and maintain in a Git repository.Use an AI coding assistant to build features, fix bugs, refactor code, and improve documentation.Review and compare two versions of AI-generated coding responses.Evaluate which response is more useful, accurate, and effective for your project.Provide clear, honest feedback explaining why you selected one response over the other.Work comfortably with terminal commands and Git during project sessions.Follow project guidelines and ensure that no passwords, API keys, or other people's personal information are included in your sessions.Requirements:
Experienced software developer with a personal software project that you own and maintain in a Git repository.Comfortable working with terminal commands and Git.Has a computer running macOS, Linux, or Windows with WSL2.Able to review and evaluate AI-generated code and coding suggestions.Strong written communication skills, with the ability to explain decisions clearly and briefly.Able to provide independent and honest feedback without using AI assistance to write evaluation responses.Nice to Haves:
Experience maintaining open-source software projects.Experience building personal tools, applications, libraries, or other software projects.Familiarity with AI coding assistants and developer productivity tools.Experience with software debugging, feature development, code refactoring, and documentation.Fully remote freelance opportunity.
Worldwide applicants are welcome, subject to project eligibility.Rate: Up to $100 per hour.Expected Workload:
Approximately 10-39 hours per week, depending on project needs.Work volume may fluctuate throughout the contract.Payments will be released weekly as a lump sum for work completed during the previous week.AI usage during the project will be covered, so candidates will not need to pay for an AI subscription or API usage.Project Eligibility and Ownership Requirements:
Candidates must bring a software project they personally and solely own.Open-source projects must have an approved license. Projects with multiple maintainers may require additional confirmation.Projects owned by an employer, client, university, or startup are not eligible.Projects covered by an NDA are not eligible.Projects involving AI model training or evaluation, machine learning infrastructure, security exploit tooling, or the processing of other people's personal data are not eligible.The client's team must review and approve the project before work begins.Selected candidates must sign contributor terms before starting.Important Privacy and Participation Notes:
Transcripts from project sessions will be used to improve AI models. Once submitted, these transcripts cannot be withdrawn.Only project session transcripts will be shared, not the rest of the candidate's software project.Ratings and written feedback provided by candidates will become part of the project's deliverables.Candidates must not include passwords, API keys, or other people's personal information in their sessions.All ratings and written evaluations must be completed independently, without AI assistance.Important: An active Upwork contract is required before candidates can receive onboarding instructions, access to the evaluation platform, or payment for the project. Candidates should accept the contract offer once received.Due to the high volume of applicants being contacted, the team may not be able to respond to every individual message. Thank you for your understanding.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Copy Of Software Developer - Ai Coding Assistant Evaluation in Winnipeg, MB vacancy
  • Use an AI coding assistant on your personally owned software project while comparing generated solutions and explaining your decisions clearly.This fully remote freelance project suits experienced software developers maintaining a Git repository. You will build features, fix... 
    Suggested
    Freelance
    Remote work

    Liftedanupworkcompany

    Winnipeg, MB
    2 hours ago
  • Evaluate AI-generated code remotely for Alignerr while applying software engineering, debugging, and code review expertise. Work flexibly on an hourly contract from Calgary.Alignerr seeks Software Engineers to build, evaluate, and improve AI-generated code. You will write solutions... 
    Suggested
    Hourly pay
    Contract work
    Remote work

    Alignerr Corp.

    Winnipeg, MB
    2 hours ago
  • Evaluate AI-generated code remotely from Canada using software expertise, detailed rubrics, and strong written communication skills. Flexible contract work offers 20+ hours weekly.As a Senior Software Engineer AI Data contributor, you will assess coding agents through codebases... 
    Suggested
    Ongoing contract
    Contract work
    For contractors
    Remote work
    Flexible hours

    OpenTrain AI, Inc.

    Winnipeg, MB
    2 hours ago
  • Use AI coding assistants, Java, and Spring Boot daily at Accommodations Plus International to build tested backend services and APIs.This Senior Backend Developer position combines hands-on software development with practical AI-assisted workflows. You will design, implement... 
    Suggested

    Accommodations Plus International

    Winnipeg, MB
    2 hours ago
  • Turing, based in San Francisco, is hiring a Software Engineering evaluator to create cutting-edge datasets for...  ...large language models. You will curate code examples, provide precise solutions,...  ..., Java, Rust, and Go, while evaluating AI-generated code for efficiency and reliability... 
    Suggested
    Contract work

    Turing Enterprises, Inc.

    Winnipeg, MB
    2 hours ago
  • # Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. · , CABack to resultsPython Developer-AI...  ...DescriptionFreelancing Opportunity: We are hiring Senior Software Engineers - Python / TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on improving AI models... 
    Hourly pay
    Contract work
    Temporary work
    Freelance
    Immediate start
    Remote work

    Linuxassociation

    Winnipeg, MB
    2 hours ago
  •  ...straight to your home. Employee and Family Assistance Program (EFAP) - You and your family...  ...for a passionate and experienced Software Developer with expertise in .NET to join our team....  ...business objectives. • Participate in code reviews to ensure high-quality, maintainable... 

    Price Industries Limited

    Winnipeg, MB
    3 days ago
  •  ...straight to your home. Employee and Family Assistance Program (EFAP) - You and your family...  ...free Tea and Coffee Job Title: Software Developer Location: Winnipeg Department: Business...  ...development, and the thoughtful use of AI-assisted development tools to explore ideas... 

    Price Industries Limited

    Winnipeg, MB
    3 days ago
  •  ...G2i Inc. is seeking a Senior Software Engineer, AI Training, to help evaluate the quality of AI-assisted coding interactions. This is a remote contract role with flexible hours and weekly commitment. You will review how models think like engineers, assess explanations,... 
    Contract work
    Remote work
    Flexible hours

    G2i Inc.

    Winnipeg, MB
    2 hours ago
  •  ...speaks to you, we need you!We are currently looking for an AI Software Developer to join our AI team. This position reports to the AI...  ...integrating MCP (Model Context Protocol) serversExperience with AI evaluation, observability, or LLMOps/MLOps practicesExperience with... 
    Work at office
    Work from home
    Worldwide

    Newfoundland Capital Corporation Limited

    Winnipeg, MB
    2 hours ago
  • Quest Software is seeking an experienced Senior Software Developer to help bring AI-powered coding practices into an established on-premises enterprise software product. This role combines strong hands-on C#/.NET and C++ development with practical experience using AI coding... 
    Work at office
    Remote work
    Worldwide
    Flexible hours

    Quest Software

    Winnipeg, MB
    2 hours ago
  • Software Developer - Applied AIRemote, Ontario Technology Remote Full-time About Blue JBlue J is the leading generative AI solution for tax professionals and one of Canada's fastest-growing...  ...about shaping the future of AI-assisted tax research. Your work will... 
    Long term contract
    Full time
    Immediate start
    Remote work

    Blue J Legal

    Winnipeg, MB
    2 hours ago
  •  ...straight to your home. Employee and Family Assistance Program (EFAP) - You and your family...  ...to be a part of that. Lab Systems Software Developer We are looking for a Software Developer...  ...clean, efficient, and well-documented code • Document system architecture, workflows... 

    Price Industries Limited

    Winnipeg, MB
    3 days ago
  • Lead agentic AI development as a Senior Software Developer with Euna Grants in hybrid Oakville, Ontario, using C# and .NET expertise daily.At L3, you will anchor...  ..., prompts, and escalation paths with clarity. AI-assisted development is central to the day-to-day workflow.Key Responsibilities... 

    Euna Solutions

    Winnipeg, MB
    2 hours ago
  • Create AI-orchestrated workflow experiences for Asana users in Vancouver, combining clean code, thoughtful testing, and product-focused engineering...  ...hybrid.Asana is hiring Software Engineers for high-impact...  ...product surfaces, trust systems, evaluation, and observability across... 
    Work at office

    Asana, Inc.

    Winnipeg, MB
    2 hours ago
  •  ...Alignerr is seeking Software Engineers in Calgary for a fully remote, flexible contract role. You will build, evaluate, and improve AI-generated code, helping train AI systems to think like real developers. The role involves hands-on coding, code review, and providing expert... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    Alignerr Corp.

    Winnipeg, MB
    2 hours ago
  •  ...themselves, everyone is welcome. Motive are seeking a Senior AI Software Developer to join our Iron Man project being developed using Unreal...  ...other developers on the AI team and participate in design and code reviews Work closely with QV and technical leadership to ensure... 
    Local area

    Electronic Arts Ltd

    Winnipeg, MB
    2 hours ago
  • $180k - $220k per year

    Position: AI/ML Platform Software Developer Location: Calgary, Alberta or Remote — Canada Experience: 8+ years software development;...  ...capabilities from proof of concept through production, including evaluation, monitoring, iteration, reliability, and operational... 
    Full time
    Remote work

    Cornerbridge Talent Partners

    Winnipeg, MB
    2 hours ago
  • $180k - $200k per year

     ...Job Title: Staff Data Scientist (AI & Machine Learning) Location: Vancouver, BC – 3 days...  ...and instill a rigorous engineering culture (code quality, reproducibility, and TDD) within the...  ...Must Have 10+ years of experience in software or data science, with at least 8+ years... 
    3 days per week

    TEEMA Group

    Winnipeg, MB
    3 days ago
  •  ...Café offers free Tea and Coffee. ERP Software Developer An ERP Software Developer designs, develops...  ...to end-users. • Continuously evaluate and improve existing ERP systems to enhance...  .... • Document development processes, coding standards, and technical specifications.... 

    Price Industries Limited

    Winnipeg, MB
    3 days ago
  • Shape AI-assisted software solutions as a Senior Software Developer at MNP, applying systems thinking and enterprise development expertise. Work across backend and frontend technologies.Within MNP’s Technology - Development team, you will translate business processes and challenges... 

    Mnp Llp

    Winnipeg, MB
    2 hours ago
  • $165k - $330k per year

     ...inference for the world's most dynamic AI companies, like Cursor, Notion,...  ...infrastructure, and seamless developer tooling, we enable companies...  ...tooling to keep it accurate as code moves). Internal MCP servers...  ...rollout, operation, measurement. Evaluate and integrate third-party AI... 
    Flexible hours

    Baseten

    Winnipeg, MB
    2 hours ago
  •  ...be themselves, everyone is welcome.Motive are seeking a Senior AI Software Developer to join our Iron Man project being developed using Unreal...  ...other developers on the AI team and participate in design and code reviewsWork closely with QV and technical leadership to ensure... 

    Motive

    Winnipeg, MB
    2 hours ago
  •  ...to your home. • Employee and Family Assistance Program (EFAP) - You and your family will...  ...Price Café offers free Tea and Coffee. Software Developer – Antec Controls The Systems...  ...indicators. • Writing clean and scalable code, following code best practices. • Troubleshooting... 

    Price Industries Limited

    Winnipeg, MB
    3 days ago
  • Build high-quality software with Java, Python, and AI-assisted development technologies in CN’s hybrid work model. Deliver applications across project, enhancement...  ...Development role requires more than five years of developer experience. You will analyze functional specifications,... 

    CN

    Winnipeg, MB
    2 hours ago
  • Build advanced AI solutions for Smile Digital Health, using RAG, semantic matching, and...  ...scalable healthcare products.This Senior Software Developer works with Smile Labs in the Product...  ...and prototype emerging technologiesConduct code reviews, pair programming, and problem analysisSupport... 

    Smile Digital Health

    Winnipeg, MB
    2 hours ago
  • Build Windows-based AI solutions with C/C++ and Python at Lenovo Research’s On-Device Intelligence...  ...a recent college graduate or early-career Software Engineer for on-device intelligence...  ...product teams.Key Responsibilities: Develop and maintain software for Windows-based... 

    Lenovo Group

    Winnipeg, MB
    2 hours ago
  • Apply software development expertise at CN, using AI-assisted coding tools and modern techniques in a hybrid office environment. Build quality solutions across assigned deliverables.This Specialist Software Development role supports application development, implementation, and... 
    Work at office

    Canadian National Inc.

    Winnipeg, MB
    2 hours ago
  •  ...platform configuration tools. Develop and maintain C#/.NET components...  ...reporting needs. Build AI-enabled business solutions, workflow...  ...standards for version control, code review, testing, deployment,...  ...'s degree in Computer Science, Software Development, Information Technology... 
    Long term contract
    Flexible hours

    Banque-Laurentienne-a007109

    Winnipeg, MB
    2 hours ago
  • Build TypeScript agentic and RAG systems remotely in Ontario for Blue J, advancing AI-assisted tax research from Toronto-connected teams.As a seasoned Software Developer, you will design and implement critical Tax Intelligence capabilities. Your work spans distributed systems... 
    Remote work

    Blue J Legal

    Winnipeg, MB
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Copy Of Software Developer - Ai Coding Assistant Evaluation. Be the first to apply!