tooling. Nice to Haves Experience with agent evaluation and LLM observability tooling (LangSmith, LangFuse, Arize...
tooling. Nice to Haves Experience with agent evaluation and LLM observability tooling (LangSmith, LangFuse, Arize...
& Observability Experience with Fiddler AI or comparable agent/model monitoring tools (e.g., LangSmith, Arize, Weights & Biases...
such as Arize or Fiddler to validate and monitor AI-enabled solutions. Integration & API Design: Postman or Swagger/OpenAPI for API...
such as Arize or Fiddler to validate and monitor AI-enabled solutions. Integration & API Design: Postman or Swagger/OpenAPI for API...
) Langfuse, LangSmith, Arize, or equivalent LLM-as-judge evaluators, CI/CD eval gates Leadership Demonstrated track record...
, Arize AI, LangChain, Weights & Biases, Honeycomb, Databricks, Snowflake. BEST-FIT CANDIDATE: 3-7 yrs;end-to-end full...
) Langfuse, LangSmith, Arize, or equivalent LLM-as-judge evaluators, CI/CD eval gates Leadership Demonstrated track record...
tracing and observability (e.g., LangSmith, Arize Phoenix, or Weights & Biases) to track reasoning paths, tool-calling success...
and AI observability platforms such as Arize. Experience with automated machine learning, hyperparameter optimization, experiment...