SWE Bench Engineer - C#

Analyze GitHub issues and assess LLM performance in real code.

About Turing
Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. You’ll be at the forefront of evaluating how LLMs interact with real code, influencing the future of AI-assisted software development. This is a unique opportunity to blend practical software engineering with AI research.

About the Role:

We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality

What does day-to-day look like:

  • Analyze and triage GitHub issues across trending open-source libraries.
  • Set up and configure code repositories, including Dockerization and environment setup.
  • Evaluating unit test coverage and quality.
  • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
  • Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.

Required Skills:

  • Minimum 2+ years of overall experience
  • Strong experience with at least one of the following languages: C++
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to understand and navigate complex codebases.
  • Comfortable running, modifying, and testing real-world projects locally.
  • Experience contributing to or evaluating open-source projects is a plus.

Nice to Have:

  • Previous participation in LLM research or evaluation projects.
  • Experience building or testing developer tools or automation agents.

Perks of Freelancing With Turing:

  • Work in a fully remote environment.
  • Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details:

  • Commitments Required: Minimum 40 hours per week with overlap of 4 hours with PST.
  • Employment type: Contractor assignment (no medical/paid leave)
  • Duration of contract: 2-3 weeks; [expected start date is next week]
  • Payment: $25 per approved task
  • Location: India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, Mexico, LATAM

Evaluation Process (approximately 75 mins) :

  • Assessment based review

Skills:

C++

Back to blog

Other Jobs To Apply

Technology Field Engineer

Remote Solutions Consultant, Commercial (Equity Included)

VIP Account Manager, Michigan

[Hiring] AR RCM Specialist @ResMed

Account Manager, Digital Ads & Growth Partnerships

Director, People Platform & Self-Service Experience

Lead, Salesforce Service Cloud

Manager, People Shared Services

Contact Center Specialist II (Remote) - Must Live In WA

Physician Services Coder II (Remote)

Remote Medicare Call Center Pro - Inbound Support

Associate Director, Commercial Learning - Field Skills

Project Engineering Specialist

WORK PREPARATOR/SCHEDULER

Field Service Technician – Power Generation

Senior Key Accounts Leader – Advanced Detection (Remote)

Maintenance and Service Technician III

Account Director, Destination Sales

Remote Squarespace Live Chat Specialist

CrowdStrike Platform Resident Consultant (Remote)

Communications Specialist

Remote HubSpot Marketing Operations Specialist

[Remote] Overnight Customer Experience Representative, Brokerage Services

Twitter (X) Content Manager

[Remote] Senior Designer, Gameplay

Solutions Engineer, SMB – Phoenix Market Remote

Remote Security Coordinator I

Remote-Ready Customer Programs Manager

Image Project Lead - East Coast

Customer Service Rep / Pizza Maker Store (08124)

Away from Home/Food Service Sales Representative, Cranston

Remote Cardiovascular Health & Science Specialist

Manager, AV Evaluation Framework

Regional Asset Protection Specialist – Multi-State

Software Engineer Principal (Remote)

Walmart Virtual Remote Jobs - Joblagii

Digital Channel Execution Consultant

Servicing Travel Advisor III - Chase Travel (Remote - Tempe, AZ)

Airbnb Host: Join a Fast-Growing AI Startup

Customer Experience Customer Success Specialist (Remote)

Salesforce Developer (Remote)

Netflix Remote Jobs From Home $23/Hour

Google Remote Work From Home In Arkansas

Senior Principal Engineer, Docker, Ecosystem

Detection & CorpSec Engineer (Remote)

Remote Project Manager, Atlas

Expert Marketing Operations Specialist – Adobe Marketo Automation & Salesforce Integration Expert (Part-Time Contract)

Senior Architect, Software Engineering - Austin, TX (Hybrid)

Sr Principal Software Engineer, Innovus — Physical Synthesis & Optimization

Director, Worldwide Partner Incentives and Investments

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...