and evaluation tools (e.g., LangSmith, Arize, HoneyHive, or custom OpenTelemetry implementations). Experience establishing 'Golden...
tooling. Nice to Haves Experience with agent evaluation and LLM observability tooling (LangSmith, LangFuse, Arize...
tooling. Nice to Haves Experience with agent evaluation and LLM observability tooling (LangSmith, LangFuse, Arize...
& Observability Experience with Fiddler AI or comparable agent/model monitoring tools (e.g., LangSmith, Arize, Weights & Biases...
such as Arize or Fiddler to validate and monitor AI-enabled solutions. Integration & API Design: Postman or Swagger/OpenAPI for API...
such as Arize or Fiddler to validate and monitor AI-enabled solutions. Integration & API Design: Postman or Swagger/OpenAPI for API...
) Langfuse, LangSmith, Arize, or equivalent LLM-as-judge evaluators, CI/CD eval gates Leadership Demonstrated track record...
, Arize AI, LangChain, Weights & Biases, Honeycomb, Databricks, Snowflake. BEST-FIT CANDIDATE: 3-7 yrs;end-to-end full...
) Langfuse, LangSmith, Arize, or equivalent LLM-as-judge evaluators, CI/CD eval gates Leadership Demonstrated track record...
tracing and observability (e.g., LangSmith, Arize Phoenix, or Weights & Biases) to track reasoning paths, tool-calling success...