caferemote
Lifted (an Upwork Company)

Copy of Software Developer – AI Coding Assistant Evaluation

Remote Canada Contract $100 / hour Posted 20h ago
Apply now
Work from
Canada
Contract
Contract
Salary
$100 / hour
Posted
9 November 2026
Apply by
8 January 2027

We are looking for developers who have a software project they personally own, such as a side project, personal tool, or open-source library.

In this project, you will use an AI coding assistant to work on your existing software project. This may involve building new features, fixing bugs, refactoring code, or writing documentation. As you work, you will be presented with two versions of the AI assistant's response and asked to select the one that works better, along with a short explanation of your choice.

Responsibilities

  • Bring and work on a software project that you personally own and maintain in a Git repository.
  • Use an AI coding assistant to build features, fix bugs, refactor code, and improve documentation.
  • Review and compare two versions of AI-generated coding responses.
  • Evaluate which response is more useful, accurate, and effective for your project.
  • Provide clear, honest feedback explaining why you selected one response over the other.
  • Work comfortably with terminal commands and Git during project sessions.
  • Follow project guidelines and ensure that no passwords, API keys, or other people's personal information are included in your sessions.

Requirements

  • Experienced software developer with a personal software project that you own and maintain in a Git repository.
  • Comfortable working with terminal commands and Git.
  • Has a computer running macOS, Linux, or Windows with WSL2.
  • Able to review and evaluate AI-generated code and coding suggestions.
  • Strong written communication skills, with the ability to explain decisions clearly and briefly.
  • Able to provide independent and honest feedback without using AI assistance to write evaluation responses.

Nice to have

  • Experience maintaining open-source software projects.
  • Experience building personal tools, applications, libraries, or other software projects.
  • Familiarity with AI coding assistants and developer productivity tools.
  • Experience with software debugging, feature development, code refactoring, and documentation.
  • Fully remote freelance opportunity.
  • Worldwide applicants are welcome, subject to project eligibility.
  • Rate: Up to $100 per hour.
  • Expected Workload: Approximately 10–39 hours per week, depending on project needs.
  • Work volume may fluctuate throughout the contract.
  • Payments will be released weekly as a lump sum for work completed during the previous week.
  • AI usage during the project will be covered, so candidates will not need to pay for an AI subscription or API usage.

Project Eligibility and Ownership Requirements

  • Candidates must bring a software project they personally and solely own.
  • Open-source projects must have an approved license. Projects with multiple maintainers may require additional confirmation.
  • Projects owned by an employer, client, university, or startup are not eligible.
  • Projects covered by an NDA are not eligible.
  • Projects involving AI model training or evaluation, machine learning infrastructure, security exploit tooling, or the processing of other people's personal data are not eligible.
  • The client's team must review and approve the project before work begins.
  • Selected candidates must sign contributor terms before starting.

Important Privacy and Participation Notes

  • Transcripts from project sessions will be used to improve AI models. Once submitted, these transcripts cannot be withdrawn.
  • Only project session transcripts will be shared, not the rest of the candidate's software project.
  • Ratings and written feedback provided by candidates will become part of the project's deliverables.
  • Candidates must not include passwords, API keys, or other people's personal information in their sessions.
  • All ratings and written evaluations must be completed independently, without AI assistance.

Important: An active Upwork contract is required before candidates can receive onboarding instructions, access to the evaluation platform, or payment for the project. Candidates should accept the contract offer once received.

Due to the high volume of applicants being contacted, the team may not be able to respond to every individual message. Thank you for your understanding.

An enterprise client is seeking experienced software developers to participate in an AI training project focused on testing and evaluating AI coding assistants.

The project aims to improve AI coding tools by gathering feedback from developers as they work on their own software projects and compare different AI-generated solutions.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Lifted (an Upwork Company)

View company →

Senior Web Designer

Lifted (an Upwork Company)
Remote United States Contract

We are looking for a Senior Web Designer with a strong creative vision, excellent visual design skills, and a portfolio that demonstrates expertise in art…

11h ago Design

Genie 4 Users Needed for Video Testing Project

Lifted (an Upwork Company)
Remote United States Contract

For each case, you will: Use the provided English prompt and first-frame image in Genie 4. Follow the corresponding timeline and action instructions exactly,…

yesterday Quality Assurance

#140205 - Product Manager

Lifted (an Upwork Company)
Remote Anguilla, Antigua and Barbuda, Argentina, Aruba, Bahamas, Barbados, Belize, Bermuda, Bolivia, Bonaire, Sint Eustatius and Saba, Brazil, Cayman Islands, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Falkland Is Contract

Key Responsibilities Serve as the primary point of coordination between business stakeholders and the development team, coordinating day-to-day activities…

yesterday Product

Similar remote jobs

Browse all →

Solution Consultant / Solution Engineer - Retail Enterprise Software

DemandTec
Remote United States Full-time

Role Summary The Solution Consultant is the retail pricing and trade promotion business expert in our sales cycle. Working alongside Account Executives, you will shape opportunities from…

8h ago Software Development

Sr. Software Engineer, Ruby on Rails

CentralReach
Remote USA Full-time $120K – $180K / year

CentralReach is a leading provider of autism and IDD care software for Applied Behavior Analysis (ABA), multidisciplinary therapy, and special education. Trusted by more than 200,000 users,…

8h ago Software Development

Business Systems Engineer

ClickUp
Remote USA Full-time $144K – $181K / year

At ClickUp, we're building the future of work: the first truly converged AI workspace unifying tasks, docs, chat, calendar, and enterprise search, all supercharged by context-driven AI. We…

8h ago Software Development

Software Engineer, Data Integration

Bayesian Health
Remote USA Full-time

Software Engineer, Data Integration In Brief We're a rapidly growing startup on a mission to make healthcare proactive by empowering physicians, nurses, and care team members with real-time…

8h ago Software Development

Senior Software Engineer, Operations Tools & Al Enablement

Serve Robotics
Remote USA Full-time $180K – $200K / year

At Serve Robotics , we’re reimagining how things move in cities. Our personable sidewalk robot is our vision for the future. It’s designed to take deliveries away from congested…

8h ago Software Development

eLearning Developer, Articulate Rise Contractor

CrossFit
Remote USA Contract

CrossFit is looking to contract an eLearning Developer to audit, improve, and rebuild our library of existing online courses. You will evaluate 13 courses, ranging from two to eight…

8h ago Software Development

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.