Job Description:
• Design graduate- and research-level evaluation questions grounded in hardware and computer engineering domains
• Create tasks that require precise, step-by-step technical reasoning with verifiable ground-truth answers
• Develop multimodal prompts when appropriate
• Evaluate AI models on hardware- and systems-heavy reasoning tasks
• Identify and document model failure modes
• Provide authoritative solutions for each evaluation task
• Maintain detailed records of prompts, expected answers, and outcomes
Requirements:
• MS or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or a closely related field
• Strong expertise in at least two hardware- and systems-focused domains: Computer architecture, Hardware systems and performance analysis, VLSI design, digital logic, Embedded systems, Operating systems, Compilers or systems programming
• Proven experience in technical research, evaluation, or rigorous problem formulation in academic, lab, or production environments
• Strong programming skills (especially Python, C or C++)
• Excellent written communication skills and strong attention to technical detail
Benefits:
• Contractor assignment (no medical/paid leave)
• Flexible work arrangements
Apply Now
Apply Now