: eval dataset design, tracing, LLM-as-judge scoring, and regression testing, with tools such as Langfuse or Arize Phoenix...
. Familiarity with eval and observability tooling (e.g., Braintrust, LangSmith, Arize, Weave, Promptfoo) or experience building...
such as LangSmith, Arize, or Braintrust, and with OpenTelemetry-based tracing. Experience designing A/B tests for AI features...
, and microservices. Experience with LLM observability and evaluation tooling such as LangSmith, Arize, or Braintrust...
. Familiarity with eval and observability tooling (e.g., Braintrust, LangSmith, Arize, Weave, Promptfoo) or experience building...
experience. Familiarity with GenAI evaluation and LLM observability (OpenTelemetry, MLflow Tracing, Arize, or comparable...
. Experience with tracing and observability tools such as Arize Phoenix. Chase is a leading financial services firm, helping...
tracing observability tools such as Arize Phoenix. Familiarity with machine learning frameworks such as PyTorch or scikit...
). Skills & Knowledge Professional experience with evaluation and observability frameworks like LangSmith, Arize Phoenix...
such as Arize Phoenix. Familiarity with machine learning frameworks such as PyTorch or scikit-learn, including adapting and fine...