Help review the quality and fairness of challenging tasks used to evaluate AI systems. You will inspect task instructions, model execution traces and grading behavior, then explain whether a result reflects genuine model performance or an i...
Help review the quality and fairness of challenging tasks used to evaluate AI systems. You will inspect task instructions, model execution traces and grading behavior, then explain whether a result reflects genuine model performance or an i...
Help review the quality and fairness of challenging tasks used to evaluate AI systems. You will inspect task instructions, model execution traces and grading behavior, then explain whether a result reflects genuine model performance or an i...
Help review the quality and fairness of challenging tasks used to evaluate AI systems. You will inspect task instructions, model execution traces and grading behavior, then explain whether a result reflects genuine model performance or an i...
, Braintrust, Arize Phoenix, DeepEval, Ragas, or similar). Experience building LLM-as-judge graders and validating judge/human...
framework (LangSmith, Langfuse, Weave, Braintrust, Arize Phoenix, DeepEval, Ragas, or similar). - Experience building LLM...
- Eval and tracing tools such as Braintrust, Langfuse, or LangSmith - You've been an early engineer at a startup before...
, Ragas, DeepEval, Braintrust, Evidently, etc.) - Knowledge of embeddings, search, reranking, or hybrid retrieval...
, Ragas, DeepEval, Braintrust, Evidently, etc.) - Knowledge of embeddings, search, reranking, or hybrid retrieval...
, or integrations with tools like Slack, Gmail, Notion, or Linear Eval and tracing tools such as Braintrust, Langfuse, or LangSmith...