Senior Software Engineer

Responsibilities

• Evaluate AI-generated coding interactions from end to end.
• Judge whether outputs are useful, correct at a high level, and aligned with strong engineering judgment.
• Assess the quality of explanations, preambles, reasoning, and generated code.
• Distinguish between different levels of response quality and define what makes an interaction excellent.
• Provide clear, opinionated written feedback on what worked, failed, or felt misleading.
• Help establish quality standards for tools such as Cursor, OpenAI Codex, and Claude Code.
• Record short video explanations of evaluation feedback.

Requirements

• Senior, Staff, or Principal-level software engineering experience, or equivalent experience.
• Strong background in TypeScript/JavaScript or Python.
• Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.
• Deep familiarity with modern AI-assisted development workflows.
• Ability to evaluate code without executing it or reviewing every line.
• Strong written and spoken English at B2 level or above.
• Comfort giving direct, opinionated feedback and making subjective but rigorous judgments.
• High standards for software engineering quality.

Benefits

• Remote worldwide contract engagement.
• Flexible workload of 10–20 hours per week.
• Ongoing projects lasting approximately two weeks to a few months, with new projects available to successful evaluators.
• Rate of $100–$200 per hour depending on experience and location.
• Start as soon as the take-home evaluation is cleared and a project seat is available.
• No interview; selection consists of a take-home evaluation exercise with a recorded Loom walkthrough.