monitoring frameworks for model performance, data quality, and risk typology drift;implement advanced analytics to detect...
, LIME, bias metrics, drift/calibration). Partner with creative and UX teams to produce visually compelling and context... or Medicaid/Medicare domains and equity or evaluation methods Experience integrating ML outputs into dashboards (SHAP, drift...
in production. Investigate failure modes, edge cases, and drift (e.g., low-quality responses, latency spikes, low adoption...
. Diagnose systemic issues (drift, feedback loops, cold start, pacing imbalance, auction inefficiencies) and lead cross...
-on familiarity with LLMOps/MLOps practices: evaluation harnesses, monitoring, drift detection, data pipelines, and human-in-the-loop...
systems: MLflow (or equivalent), feature stores, model registry, drift detection, automated testing. Engineer solutions...
, patching, and vulnerability management Drive automation for drift detection, patching, remediation, and compliance reporting...
Build evaluation loops (precision/recall, calibration, drift, human-in-the-loop) and publish dashboards/SLOs...
of AI pipelines, encompassing logging, tracing, and metrics to detect drift, anomalies, or performance bottlenecks. Security, Privacy...
environment drift by leveraging and improving infrastructure as code and configuration management processes. May collaborate...