Senior Software Engineer

This role is for one of our clients Pay: 30–100/hour Job Type: Contractor (~15 hrs a week) Location: Remote Schedule: Flexible, you pick the hours and days (including weekends if desired) Required Skills: Python3, Java, Rust, Algorithms, Basics of C++, TypeScript, Bug fixing, Feature implementation, Codebase refactoring, Performance optimization We are seeking an experienced Senior Software Engineer to contribute to the training and evaluation of next-generation artificial intelligence systems. This role is ideal for engineers with strong backend development expertise, excellent problem-solving abilities, and a proven track record of building reliable, scalable, and high-performance software. You will design realistic and challenging coding tasks that assess AI systems' ability to implement features, fix bugs, refactor existing code, and optimize application performance. You will also develop deterministic verification mechanisms that accurately validate solutions, accepting reasonable implementations that meet the requirements while rejecting incorrect or incomplete submissions.

The role requires strong software engineering judgment, extensive debugging experience, and a solid understanding of testing methodologies. Previous AI experience is not required; your technical expertise and independent judgment are what matter most.

Requirements Key

Responsibilities Coding Task Development: Design challenging, real-world software engineering problems involving feature implementation, bug fixes, code refactoring, and performance optimization. Reference Solution Development: Create high-quality reference implementations that demonstrate correct, efficient, and maintainable approaches to solving technical problems. Automated Verification: Build deterministic verifiers, validation scripts, and comprehensive test cases to evaluate solution correctness and ensure reliable task assessment. Backend Engineering: Apply expertise in backend development, scalable services, APIs, asynchronous processing, and distributed systems to create realistic engineering challenges. Debugging and Troubleshooting: Analyze complex software defects, investigate system bottlenecks, and identify root causes of unexpected behavior. Testing Strategy and Quality Assurance: Design effective testing strategies, develop and maintain large test suites, diagnose flaky tests, and improve overall software quality. Code Review: Evaluate code for correctness, readability, maintainability, performance, security, and adherence to engineering best practices. Refactoring and Optimization: Develop tasks that assess an AI system's ability to improve legacy code, simplify complex implementations, and optimize resource utilization. Technical Reasoning Assessment: Evaluate AI-generated reasoning related to architecture, debugging, algorithms, system design, and implementation decisions. Technical Documentation: Document task requirements, expected behavior, test coverage, solution approaches, and verification criteria clearly and consistently. Continuous Improvement: Analyze model failures and refine coding tasks and evaluation methods to improve the quality and reliability of AI-generated software. Required

Qualifications Strong professional experience in software engineering, particularly backend development and production-grade systems. Proficiency in one or more programming languages, including Java, Node.js, Go, Rust, TypeScript, Python, C++, or similar technologies. Proven experience designing, building, and maintaining scalable services and APIs. Strong understanding of data structures, algorithms, system design, and fundamental computer science concepts. Extensive experience with debugging, troubleshooting, performance optimization, and code review. Practical experience with automated testing, test design, and software quality assurance. Ability to identify implementation defects, edge cases, inefficient algorithms, and architectural weaknesses. Strong understanding of code