caferemote
Lifted (an Upwork Company)

Copy of Software Developer – AI Coding Assistant Evaluation

Remote India Contract $100 / hour Posted 11 days ago
Apply now
Work from
India
Contract
Contract
Salary
$100 / hour
Posted
10 November 2026
Apply by
9 January 2027

We are looking for developers who have a software project they personally own, such as a side project, personal tool, or open-source library.

In this project, you will use an AI coding assistant to work on your existing software project. This may involve building new features, fixing bugs, refactoring code, or writing documentation. As you work, you will be presented with two versions of the AI assistant's response and asked to select the one that works better, along with a short explanation of your choice.

Responsibilities

  • Bring and work on a software project that you personally own and maintain in a Git repository.
  • Use an AI coding assistant to build features, fix bugs, refactor code, and improve documentation.
  • Review and compare two versions of AI-generated coding responses.
  • Evaluate which response is more useful, accurate, and effective for your project.
  • Provide clear, honest feedback explaining why you selected one response over the other.
  • Work comfortably with terminal commands and Git during project sessions.
  • Follow project guidelines and ensure that no passwords, API keys, or other people's personal information are included in your sessions.

Requirements

  • Experienced software developer with a personal software project that you own and maintain in a Git repository.
  • Comfortable working with terminal commands and Git.
  • Has a computer running macOS, Linux, or Windows with WSL2.
  • Able to review and evaluate AI-generated code and coding suggestions.
  • Strong written communication skills, with the ability to explain decisions clearly and briefly.
  • Able to provide independent and honest feedback without using AI assistance to write evaluation responses.

Nice to have

  • Experience maintaining open-source software projects.
  • Experience building personal tools, applications, libraries, or other software projects.
  • Familiarity with AI coding assistants and developer productivity tools.
  • Experience with software debugging, feature development, code refactoring, and documentation.
  • Fully remote freelance opportunity.
  • Worldwide applicants are welcome, subject to project eligibility.
  • Rate: Up to $100 per hour.
  • Expected Workload: Approximately 10–39 hours per week, depending on project needs.
  • Work volume may fluctuate throughout the contract.
  • Payments will be released weekly as a lump sum for work completed during the previous week.
  • AI usage during the project will be covered, so candidates will not need to pay for an AI subscription or API usage.

Project Eligibility and Ownership Requirements

  • Candidates must bring a software project they personally and solely own.
  • Open-source projects must have an approved license. Projects with multiple maintainers may require additional confirmation.
  • Projects owned by an employer, client, university, or startup are not eligible.
  • Projects covered by an NDA are not eligible.
  • Projects involving AI model training or evaluation, machine learning infrastructure, security exploit tooling, or the processing of other people's personal data are not eligible.
  • The client's team must review and approve the project before work begins.
  • Selected candidates must sign contributor terms before starting.

Important Privacy and Participation Notes

  • Transcripts from project sessions will be used to improve AI models. Once submitted, these transcripts cannot be withdrawn.
  • Only project session transcripts will be shared, not the rest of the candidate's software project.
  • Ratings and written feedback provided by candidates will become part of the project's deliverables.
  • Candidates must not include passwords, API keys, or other people's personal information in their sessions.
  • All ratings and written evaluations must be completed independently, without AI assistance.

Important: An active Upwork contract is required before candidates can receive onboarding instructions, access to the evaluation platform, or payment for the project. Candidates should accept the contract offer once received.

Due to the high volume of applicants being contacted, the team may not be able to respond to every individual message. Thank you for your understanding.

An enterprise client is seeking experienced software developers to participate in an AI training project focused on testing and evaluating AI coding assistants.

The project aims to improve AI coding tools by gathering feedback from developers as they work on their own software projects and compare different AI-generated solutions.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Lifted (an Upwork Company)

View company →

Native French (Canadian) Speakers for AI Training

Lifted (an Upwork Company)
Remote Canada Contract

The client is not just looking for professional actors. This opportunity is also a great fit if you have a background in: Call centers or customer support…

5 days ago Data

Copy of Senior Web Designer

Lifted (an Upwork Company)
Remote United States Contract

We are looking for a Senior Web Designer with a strong creative vision, excellent visual design skills, and a portfolio that demonstrates expertise in art…

9 days ago Design

Senior Web Designer

Lifted (an Upwork Company)
Remote United States Contract

We are looking for a Senior Web Designer with a strong creative vision, excellent visual design skills, and a portfolio that demonstrates expertise in art…

11 days ago Design

Copy of Software Developer – AI Coding Assistant Evaluation

Lifted (an Upwork Company)
Remote Canada Contract $100 / hour

We are looking for developers who have a software project they personally own, such as a side project, personal tool, or open-source library. In this project,…

11 days ago Software Development

Similar remote jobs

Browse all →

Forward Deployed Engineer

Tailscale
Remote United Kingdom Full-time

Thank you for considering Tailscale . If this job description resonates with you, please apply. Frequently cited statistics show that people who identify with historically marginalized…

1h ago Software Development

Senior Network Security Engineer

BlueVoyant
Remote United States Full-time

Position: Senior Network Security Engineer Reports To: Director, Global Security Engineering Department: Security Engineering Location: Remote, US – East Coast Work Authorization: US…

1h ago Software Development

Mainframe Modernization Architect

Ensono
Remote United States Full-time $156K – $210K / year

Expert Technology Consultant – Mainframe Modernization Senior Architect At Ensono , our Purpose is to be a relentless ally, disrupting the status quo and unleashing our clients to Do…

2h ago Software Development

Senior Technical Marketing Engineer

Zscaler
Remote United States Full-time $143K – $205K / year

Zscaler (NASDAQ: ZS) accelerates digital transformation so customers can be more agile, efficient, resilient, and secure. The Zscaler Zero Trust Exchange platform protects thousands of…

2h ago Software Development

Implementation Manager, SMB

ServiceTitan
Remote United States Full-time $78K – $125K / year

Who We Are: We're Aspire, the leading SaaS provider for the landscaping and commercial cleaning industries and a proud member of the ServiceTitan family since 2021. Our cloud-based business…

2h ago Software Development

Staff Software Developer

Vena Solutions
Remote Canada Full-time CAD 129K – CAD 174K / year

This is a flexible position and has the option of working in our Toronto office full time, hybrid throughout the week or working entirely remotely within Canada. As a Staff Software…

2h ago Software Development

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.