such as LangSmith, Langfuse, Braintrust, or Arize Phoenix. Experience leading or delivering a legacy-system or cloud migration...
Kendra or OpenSearch. Understanding of AI observability and evaluation tools such as LangSmith, Langfuse, or Arize. Strong...
evaluating agent behavior and implementing observability tools such as OpenTelemetry, LangSmith, or Arize Phoenix.Experience...
and evaluation platforms such as LangSmith, Arize, Helicone, Weights & Biases, or OpenTelemetry. Experience leading technical...
, drift detection, and error rates. Implement observability and monitoring solutions using Arize or similar ML/LLM...
, Arize AI, or other LLM observability platforms. Experience with Docker, Kubernetes, CI/CD, and cloud-native deployments...
tooling (e.g., Braintrust, Arize, MLflow, LangSmith, or similar). Experience with cloud-based testing platforms and tools...
/Arize Phoenix, and LangSmith/Langfuse (or equivalent tooling). Experience : 5+ years of software engineering experience...
, code execution, document processing LangSmith, Arize, or custom eval tooling for agents Experience with OpenAI Assistants...
, including logging, metrics, distributed tracing, and agent or LLM evaluation tools such as Datadog, Arize, or equivalent...