& Observability Experience with Fiddler AI or comparable agent/model monitoring tools (e.g., LangSmith, Arize, Weights & Biases...
such as Arize or Fiddler to validate and monitor AI-enabled solutions. Integration & API Design: Postman or Swagger/OpenAPI for API...
such as Arize or Fiddler to validate and monitor AI-enabled solutions. Integration & API Design: Postman or Swagger/OpenAPI for API...
) Langfuse, LangSmith, Arize, or equivalent LLM-as-judge evaluators, CI/CD eval gates Leadership Demonstrated track record...
, Arize AI, LangChain, Weights & Biases, Honeycomb, Databricks, Snowflake. BEST-FIT CANDIDATE: 3-7 yrs;end-to-end full...
) Langfuse, LangSmith, Arize, or equivalent LLM-as-judge evaluators, CI/CD eval gates Leadership Demonstrated track record...
tracing and observability (e.g., LangSmith, Arize Phoenix, or Weights & Biases) to track reasoning paths, tool-calling success...
changes. Working fluency with at least one eval or LLM observability platform: Braintrust, LangSmith, Langfuse, Arize Phoenix...
, DataRobot, DataBricks), model monitoring (AWS Model Monitor, MLFlow, NannyML, FiddlerAI, Arize) and related tools for model...
such as Arize and Kubeflow to assess solutions built with third-party large language models and internally developed machine..., AI model documentation, or evaluation and observability platforms such as Arize, Datadog, LangSmith, or Braintrust...