Software Engineer (Codebase Deep Reasoning & Evaluation)

Remote Full-time
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description Mercor is seeking software engineers to support one of the world’s leading AI labs in advancing code understanding and reasoning capabilities for next-generation machine learning models. In this role, you’ll engage in real-world engineering work: Analyzing large, production-grade repositories to create and evaluate technically challenging coding questions. Systematically exploring multiple modules and connecting related functions across files. Assessing how advanced AI systems reason about architecture, data flow, and performance. Your ability to reason from evidence: citing specific files, functions, and line numbers will directly influence how these AI models learn to think like expert engineers. Qualifications 4+ years of elite software engineering experience at top-tier startups, quantitative trading firms, hedge funds, or similar high-performance environments. Experience using coding agents or LLMs as part of your engineering workflow (e.g., Copilot, Claude, GPT-4, or Replit Agents). Computer Science degree from a leading university or equivalent practical expertise. Fluent in Python and JavaScript/TypeScript, and can comfortably read Java, Go, or other modern languages (Rust, C++, C#). Demonstrate systematic exploration, examining multiple files and dependencies before forming conclusions. Practice evidence-based reasoning, grounding answers in specific code references rather than assumptions. Excel at cross-file synthesis, connecting distributed logic to explain how systems work end-to-end. Show strong architectural understanding, identifying patterns, abstractions, and design choices in complex codebases. Display intellectual honesty, acknowledging uncertainty when information is incomplete or ambiguous. Write clear, structured technical documentation, and communicate insights precisely and persuasively. Requirements Ability to work across diverse systems, including web APIs, backend services, CLI tools, data processing pipelines, frontend applications, and DevOps tooling. Experience with security, observability, and performance-critical architectures. Engagement Details This project will be a high-impact 24-hour sprint launching in the next 1–2 weeks. Compensation: Task-based pay (top performers previously earned $1,000+ during the sprint). Classification: Hourly contractor through Mercor. Payment: Weekly payouts via Stripe Connect. Company Description Mercor connects elite creative and technical talent with leading AI research labs, headquartered in San Francisco, CA. Our distinguished investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey. Apply today and redefine digital creativity alongside the teams building the future of intelligent software.
Apply Now →

Similar Jobs

Bioinformatics PhDs

Remote

Physics Expert

Remote

Software Engineer

Remote

Lead Full Stack Engineer

Remote

Marketing Assistant

Remote

Senior Product Manager

Remote

**Customer Service Representative – El Paso**

Remote

**Customer Service Specialist I – Remote Opportunity with blithequark's Healthcare Provider Network**

Remote

**Experienced Customer Service Representative and Administrative Assistant – Insurance and Financial Services**

Remote

**Experienced Administrative Assistant - Data Entry & Customer Service Representative (Part-Time Remote Opportunity)**

Remote

Experienced Remote Data Entry Clerk for Students – Flexible Full-Time Work from Home Opportunity with blithequark

Remote

Experienced Remote Customer Service Representative – Dream Vacation Planner and Travel Coordinator

Remote

Experienced Data Entry Consultant for Global Equity Management – Remote Work Opportunity with Competitive Hourly Rate and No Prior Experience Required

Remote

**Experienced Data Entry Clerk – Remote Customer Service and Operations Support**

Remote

Experienced Inbound Customer Service Representative – Delivering Exceptional Support and Sales Excellence for blithequark Appliance Owners

Remote

**Temporary Customer Service Representative - Hybrid Role at blithequark**

Remote

Early Childhood Literacy Specialist​/Per Diem – MySmartPros

Remote

Remote Work-From-Home Independent Contractor - Call Center Representative

Remote

Remote User Tester

Remote

Health Information Specialist I (Yonkers, NY)

Remote
← Back