changes. Working fluency with at least one eval or LLM observability platform: Braintrust, LangSmith, Langfuse, Arize Phoenix...
, DataRobot, DataBricks), model monitoring (AWS Model Monitor, MLFlow, NannyML, FiddlerAI, Arize) and related tools for model...
such as Arize and Kubeflow to assess solutions built with third-party large language models and internally developed machine..., AI model documentation, or evaluation and observability platforms such as Arize, Datadog, LangSmith, or Braintrust...
and evaluation platforms such as LangSmith, Langfuse, Arize, or similar tools. Experience deploying containerized applications using...
, and tracing for GenAI systems (e.g., LangSmith, Arize Phoenix, Weights & Biases, OpenTelemetry) Vector databases, embedding...
, LangChain, LangGraph, Langfuse, Arize, LangSmith, Humanloop, Ragas, DeepEval, Phoenix, or similar technologies. Deep...
in production (e.g. LangSmith, Arize, Datadog, Azure Monitor etc.). Familiarity with LLM fine-tuning approaches including...
Science or equivalent experience. Preferred Experience: AI tracing tools (LangSmith, Arize, HoneyHive) Compensation...
production systems, including managing model lifecycle, evaluation infrastructure (e.g., LangSmith, Arize Phoenix, LangFuse...
AI observability (OBS) layers tailored for LLMs. Implement specialized tools (e.g., LangSmith, Phoenix, Arize) to track token...