: evaluation harnesses, monitoring and drift detection, data pipelines, and human-in-the-loop processes. Familiarity...
for reliability, accuracy, latency, drift, hallucinations, and business KPIs Required Qualifications 7 10+ years of experience...
Terraform plan/apply failures and resolve configuration drift. Refactor legacy or manual Azure resources into Terraform-managed...
for orchestrating AI tools and context. ML Techniques: Isolation Forest, PSI/KSI drift detection, model retraining. Vision Models: ViT...
/test/scan/deploy;enforce drift remediation and environment promotion to improve developer experience. Operate container...
models, including dataset integrity, bias checks, model drift monitoring, and functional/non-functional validation.../evaluation, drift monitoring), and AI-assisted testing concepts (prioritization, flaky test detection, anomaly detection...
. Monitor production systems: model drift, performance degradation, operational/logging/metrics, and incident response...
ecosystem. Implement model monitoring, drift detection, and continuous retraining strategies. Evaluate and operationalize new...
detection, exploit signal monitoring. Build AI-specific incident playbooks: hallucination incidents, governance policy drift...
, and ensure consistent deployment and drift detection. Provide rapid activation for global events, codify response playbooks...