Remote Software Engineers Needed to Help Evaluate Advanced AI Systems

Are you an experienced software engineer who enjoys thinking deeply about code—not just writing it, but explaining why it works?

This remote contract opportunity allows skilled engineers to contribute to the development of next-generation AI systems by helping evaluate how they reason, explain technical concepts, and make judgment calls in real-world coding scenarios.

This is not a traditional software development role. Instead of shipping features or fixing production bugs, you’ll focus on reasoning, clarity, and technical explanation—core skills that great engineers already use every day.

About the Project

The project involves creating and reviewing code-related question-and-answer datasets used to evaluate AI systems.

These datasets are designed to measure:

• Natural-language reasoning

• Explanation quality

• Technical judgment in developer conversations

Tasks are presented as chat-style prompts that mirror real developer questions. Each prompt includes all relevant context inline, such as code snippets, logs, error messages, or requirements.

Executable correctness is not the primary goal—clear reasoning and explanation are.

What You’ll Be Doing

As a contributor, you will:

• Craft realistic developer prompts across areas like:

  • Code review

  • Debugging

  • Error diagnosis

  • Configuration and system behavior

• Adapt real-world pull requests into authentic coding scenarios

• Write technically accurate, well-reasoned responses

• Demonstrate strong explanation skills and clear thought processes

Who This Role Is For

This opportunity is ideal for professionals with:

• 2+ years of experience in software engineering, technical research, or educational content development

• A Bachelor’s degree in Computer Science, Software Engineering, or a related field
  (Advanced degrees are a plus)

• Strong proficiency in one or more of the following:

  • Python

  • JavaScript

  • Java

  • C++

• Hands-on experience debugging, testing, and validating code

• Comfort with technical writing and attention to detail

Project Details

• Start Date: Immediate

• Duration: 1–2 months (with possible extensions)

• Time Commitment:

  • Part-time: 15–25 hours per week

  • Flexibility to work up to 40 hours per week if desired

• Work Style: Fully remote, self-managed schedule

Application Process

The application process is straightforward:

1. Submit your resume

2. Complete a short 15-minute AI-based interview to discuss your background and interest

3. Receive follow-up communication within a few days with next steps and onboarding details

Contract & Payment Information

• Independent contractor role

• Fully remote work on your own schedule

• Weekly payments via Stripe or Wise, based on completed work

• Project length may be extended, shortened, or concluded early depending on performance and project needs

• No access to confidential or proprietary information from any employer or client

Note: This role does not support H1-B or STEM OPT candidates at this time.

Why This Opportunity Matters

This role gives experienced engineers a rare chance to apply their expertise beyond traditional development—helping shape how intelligent systems understand, reason, and communicate about code.

If you enjoy problem-solving, explaining complex ideas clearly, and contributing to the future of AI, this opportunity is worth your time.

👉 Apply today and put your engineering skills to work in a new way.