tooling (e.g., Braintrust, Arize, MLflow, LangSmith, or similar). Experience with cloud-based testing platforms and tools...
, code execution, document processing LangSmith, Arize, or custom eval tooling for agents Experience with OpenAI Assistants...
, including logging, metrics, distributed tracing, and agent or LLM evaluation tools such as Datadog, Arize, or equivalent...
, throughput, reliability, resource utilization, and cost Familiarity with OpenTelemetry, OpenInference, Datadog, Arize, LangSmith...
, Arize, Weights & Biases, Datadog), GitHub Copilot, Amazon Q, API design, software engineering fundamentals, testing...
platforms such as LangSmith, Langfuse, TruLens, Arize/Phoenix, or custom evaluation and monitoring tooling. Experience testing...
$25K-$35K;1 seat(s). TARGET COMPANIES (suggested): Decagon, Sierra, Scale AI, Databricks, Arize AI, Robust Intelligence...
, Scale AI, Databricks, Arize AI, Robust Intelligence, Palantir. BEST-FIT CANDIDATE: 12+ (org scaling) yrs;scaled eng org...
, Arize AI, LangChain, Vercel, Grafana Labs. BEST-FIT CANDIDATE: 3+ AE yrs;technical-buyer selling;verifiable quota;self...
AI and comparable platforms (LangSmith, Arize, Weights & Biases, Helicone). Define and track agent performance metrics: accuracy...