Background in developer platform or internal tooling engineering Experience with eval frameworks: RAGAS, LangSmith, Braintrust...
such as LiteLLM, LangSmith, Arize, Braintrust Engineering experience with databases such as Snowflake, Postgres, MySQL, Redis...
platform. You will own the end-to-end observability stack for AI (with Braintrust as foundational platform), enabling product..., and performance. Own the AI observability platform, implementing tools such as Braintrust and Langfuse to support tracing...
platforms (e.g., Braintrust). Build the playbooks and tools that enable all teams at Notion to build AI products. Skills...
and evaluation frameworks (e.g. AWS Step Functions, Google Cloud Workflows, Dagster, Braintrust) While this role will not require...
using tools such as Arize Phoenix, Langfuse, Braintrust, Freeplay, or similar. Expert in CDK for python and/or TypeScript...
), from foundation model APIs to evaluation tools (e.g., Braintrust, Pydantic, InspectAI), as well as retrieval and deployment frameworks... lunch will turn into a lively debate about Weights and Biases v. Braintrust capabilities. You’ll have some solo heads down...