evidently-drift-detector

Solid

Evidently AI skill for data drift detection, model performance monitoring, target drift analysis, and automated reporting for ML systems in production.

AI & Automation 1,160 stars 71 forks Updated today MIT

Install

View on GitHub

Quality Score: 96/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Evidently Drift Detector Detect data drift, monitor model performance, and generate automated reports using Evidently AI. ## Overview This skill provides comprehensive capabilities for ML monitoring using Evidently AI. It enables detection of data drift, concept drift, target drift, and model performance degradation in production ML systems. ## Capabilities ### Data Drift Detection - Feature-level drift detection - Dataset-level drift analysis - Multiple drift detection methods (KS, PSI, Wasserstein, etc.) - Distribution visualization - Drift magnitude quantification ### Model Performance Monitoring - Classification metrics tracking - Regression metrics tracking - Performance degradation detection - Slice-based analysis - Error analysis ### Target Drift Analysis - Target distribution changes - Label drift detection - Prediction drift monitoring - Class balance monitoring ### Automated Reporting - HTML report generation - JSON metrics export - Dashboard integration - Custom metric creation - Test suite execution ### Production Monitoring - Real-time monitoring integration - Alerting threshold configuration - Time-series drift tracking - Batch comparison analysis ## Prerequisites ### Installation ```bash pip install evidently>=0.4.0 ``` ### Optional Dependencies ```bash # For Spark support pip install evidently[spark] # For specific visualizations pip install plotly nbformat ``` ## Usage Patterns ### Basic Data Drift Report ```python from evidently import Colum...

Details

Author
a5c-ai
Repository
a5c-ai/babysitter
Created
4 months ago
Last Updated
today
Language
JavaScript
License
MIT

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

model-drift-detector

Detect model drift detector operations. Auto-activating skill for ML Deployment. Triggers on: model drift detector, model drift detector Part of the ML Deployment skill category. Use when working with model drift detector functionality. Trigger with phrases like "model drift detector", "model detector", "model".

2,274 Updated today
jeremylongshore
AI & Automation Listed

datarobot-model-monitoring

Tools and guidance for monitoring model performance, tracking data drift, managing model health, and detecting prediction anomalies. Use when monitoring deployed models, tracking drift, or investigating prediction anomalies.

16 Updated 2 days ago
datarobot-oss
DevOps & Infrastructure Solid

detecting-infrastructure-drift

This skill enables Claude to detect infrastructure drift from a desired state. It uses the `drift-detect` command to identify discrepancies between the current infrastructure configuration and the intended configuration, as defined in infrastructure-as-code tools like Terraform. Use this skill when the user asks to check for infrastructure drift, identify configuration changes, or ensure that the current infrastructure matches the desired state. It is particularly useful in DevOps workflows for maintaining infrastructure consistency and preventing configuration errors. Trigger this skill when the user mentions "drift detection," "infrastructure changes," "configuration drift," or requests a "drift report."

2,274 Updated today
jeremylongshore
DevOps & Infrastructure Solid

drift-detection

Detect, classify, and automate Terraform drift detection in CI — scheduled plans, drift metrics, cloud-native audit log correlation.

15 Updated today
sawrus
AI & Automation Solid

arize-observability

Arize AI skill for production ML monitoring, embedding drift, and performance analysis.

1,160 Updated today
a5c-ai