experimentation and learning loops for AI experiences (A/B tests, offline evaluations) and instrument telemetry to monitor drift...
) Ability to embed security controls into CI/CD pipelines and platform guardrails. Familiarity with configuration‑drift...
in production: feature engineering, model serving, monitoring, and drift detection. Ability to assess emerging AI capabilities...
lifecycle: traditional ML: performance, drift, data quality, latency GenAI/agents: quality/safety metrics, grounding.../citation quality, tool-call reliability, latency/cost, and drift in retrieval inputs define retraining and incident playbooks...
model performance in production and manage model drift, retraining, and rollback strategies. Use critical thinking...
performance, data drift, and model health, and support model retraining and improvements Contribute to new data science...
cases. Continuously monitor and improve model performance through drift detection, retraining automation and impact...). Strong grasp of model evaluation, drift monitoring and explainability best practices. Experience with Agile development...
- Lead CI/CD for ML systems. - Implement model versioning, monitoring, and drift detection. - Drive observability...
) with zero configuration drift and secure defaults. - Secure by Default: Champion security across the platform. Implement zero...
, part measurements, and visual checks to confirm machining consistency and identify process drift before defects occur...