and require numerical methods or iterative solutions;Develop problems involving system design, optimization, and analysis;Base... problems on real research challenges or practical applications from engineering practice;Verify solutions using Python...
tasks, contributors may: Design rigorous Computer Science problems reflecting professional practice;Evaluate AI solutions...
tasks, contributors may: Generate prompts that challenge AI;Evaluate AI-generated solutions for correctness...
tasks, contributors may: Generate prompts that challenge AI;Evaluate AI-generated solutions for correctness...
by an AI agent Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict... nor too lenient Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine...
field;2+ years of research, applied, or teaching experience;Python proficiency for writing reference solutions;Fluency...
solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale...
tasks, contributors may: Design rigorous Computer Science problems reflecting professional practice;Evaluate AI solutions...
tasks, contributors may: Design rigorous Computer Science problems reflecting professional practice;Evaluate AI solutions...
tasks, contributors may: Generate prompts that challenge AI;Evaluate AI-generated solutions for correctness, assumptions...