mlflow-experiment-tracker

Solid

MLflow integration skill for experiment tracking, model registry, and artifact management. Enables LLMs to log experiments, compare runs, manage model lifecycle, and retrieve artifacts through the MLflow API.

AI & Automation 1,160 stars 71 forks Updated today MIT

Install

View on GitHub

Quality Score: 96/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# MLflow Experiment Tracker Integrate with MLflow for comprehensive ML experiment tracking, model registry operations, and artifact management. ## Overview This skill provides capabilities for interacting with MLflow's tracking server and model registry. It enables automated experiment logging, run comparison, model versioning, and artifact retrieval within ML workflows. ## Capabilities ### Experiment Management - Create and manage experiments - Start and end runs programmatically - Set experiment tags and descriptions - List and search experiments ### Parameter and Metric Logging - Log hyperparameters for reproducibility - Track metrics during training (loss, accuracy, etc.) - Log batch metrics with timestamps - Set run tags for organization ### Artifact Management - Log model artifacts (serialized models, checkpoints) - Store datasets and data samples - Save plots and visualizations - Retrieve artifacts from completed runs ### Model Registry Operations - Register trained models - Manage model versions - Transition models between stages (Staging, Production, Archived) - Add model descriptions and tags ### Run Comparison and Analysis - Compare metrics across runs - Search runs by parameters/metrics - Retrieve best performing runs - Generate comparison visualizations ## Prerequisites ### MLflow Installation ```bash pip install mlflow>=2.0.0 ``` ### MLflow Tracking Server Configure tracking URI: ```python import mlflow mlflow.set_tracking_uri("http://localhost:5000"...

Details

Author
a5c-ai
Repository
a5c-ai/babysitter
Created
4 months ago
Last Updated
today
Language
JavaScript
License
MIT

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Featured

mlflow

Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow - framework-agnostic ML lifecycle platform

27,705 Updated today
davila7
AI & Automation Solid

mlflow

Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow - framework-agnostic ML lifecycle platform

9,182 Updated 1 months ago
Orchestra-Research
AI & Automation Solid

setting-up-experiment-tracking

This skill automates the setup of machine learning experiment tracking using tools like MLflow or Weights & Biases (W&B). It is triggered when the user requests to "track experiments", "setup experiment tracking", "initialize MLflow", or "integrate W&B". The skill configures the necessary environment, initializes the tracking server (if needed), and provides code snippets for logging experiment parameters, metrics, and artifacts. It helps ensure reproducibility and simplifies the comparison of different model runs.

2,274 Updated today
jeremylongshore
AI & Automation Solid

mlflow-tracking-setup

Configure mlflow tracking setup operations. Auto-activating skill for ML Training. Triggers on: mlflow tracking setup, mlflow tracking setup Part of the ML Training skill category. Use when working with mlflow tracking setup functionality. Trigger with phrases like "mlflow tracking setup", "mlflow setup", "mlflow".

2,274 Updated today
jeremylongshore
AI & Automation Listed

implementing-mlops

Strategic guidance for operationalizing machine learning models from experimentation to production. Covers experiment tracking (MLflow, Weights & Biases), model registry and versioning, feature stores (Feast, Tecton), model serving patterns (Seldon, KServe, BentoML), ML pipeline orchestration (Kubeflow, Airflow), and model monitoring (drift detection, observability). Use when designing ML infrastructure, selecting MLOps platforms, implementing continuous training pipelines, or establishing model governance.

368 Updated 5 months ago
ancoleman