is a global multilingual contact center focused on remote work solutions and long-term collaboration. We promote flexibility...
application codebase Write tests that accept all correct solutions and reject incorrect ones - neither too strict (breaking..., don't miss bad solutions, and don't break on good ones Review code written by agents, analyze why an agent failed...
tasks, contributors may: Generate prompts that challenge AI;Evaluate AI-generated solutions for correctness...
tasks, contributors may: Design rigorous mathematics problems reflecting professional practice;Evaluate AI solutions...
tasks, contributors may: Generate prompts that challenge AI;Evaluate AI-generated solutions for correctness...
tasks, contributors may: Generate prompts that challenge AI;Evaluate AI-generated solutions for correctness, assumptions...
solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale...
application codebase Write tests that accept all correct solutions and reject incorrect ones - neither too strict (breaking..., don't miss bad solutions, and don't break on good ones Review code written by agents, analyze why an agent failed...
tasks, contributors may: Generate prompts that challenge AI;Evaluate AI-generated solutions for correctness, assumptions...
;Python proficiency for writing reference solutions;Fluency with — or strong willingness to independently learn...