Staff Forward Deployed Engineer, AI Simulation
, growth capital-backed company in 2022, funded by leading investors and supported by a braintrust of industry leaders...
, growth capital-backed company in 2022, funded by leading investors and supported by a braintrust of industry leaders...
ADK, Mastra, Claude Agent SDK), observability and evals tooling (e.g., Langfuse, LangSmith, Braintrust), MCP... execution. Nice to Have Experience with AI evaluation tooling (Langfuse, LangSmith, Braintrust, or custom eval frameworks...
., LangGraph, Google ADK, Mastra, Claude Agent SDK), observability and evals tooling (e.g., Langfuse, LangSmith, Braintrust), MCP... execution. Nice to Have: Experience with AI evaluation tooling (Langfuse, LangSmith, Braintrust, or custom eval frameworks...
., LangGraph, Google ADK, Mastra, Claude Agent SDK), observability and evals tooling (e.G., Langfuse, LangSmith, Braintrust), MCP... execution. Nice to Have: Experience with AI evaluation tooling (Langfuse, LangSmith, Braintrust, or custom eval frameworks...
evaluation frameworks, LLM observability tools (e.g., LangSmith, Braintrust, Humanloop), or building internal evaluation...
, retrieval accuracy, cost and downstream AI application performance using tools like Braintrust and StatSig in partnership...
such as OpenTelemetry, Langfuse, LangSmith, Braintrust, Helicone, Datadog, Grafana, or similar tooling experience building internal...
, identity, or threat detection Experience with agent evaluation frameworks (Anthropic's evals, Braintrust, Langfuse, Arize...
make sense. Experience with eval frameworks (Promptfoo, Braintrust, DeepEval, LangSmith, OpenAI Evals, Anthropic’s eval...
, Braintrust, or similar platforms. Excellent communication and stakeholder management skills, with the ability to engage...