modal

# Modal ## Overview Modal is a cloud platform for running Python code serverlessly, with a focus on AI/ML workloads. Key capabilities: - **GPU compute** on demand (T4, L4, A10, L40S, A100, H100, H200, B200) - **Serverless functions** with autoscaling from zero to thousands of containers - **Custom container images** built entirely in Python code - **Persistent storage** via Volumes for model weights and datasets - **Web endpoints** for serving models and APIs - **Scheduled jobs** via cron or fixed intervals - **Sub-second cold starts** for low-latency inference Everything in Modal is defined as code — no YAML, no Dockerfiles required (though both are supported). ## When to Use This Skill Use this skill when: - Deploy or serve AI/ML models in the cloud - Run GPU-accelerated computations (training, inference, fine-tuning) - Create serverless web APIs or endpoints - Scale batch processing jobs in parallel - Schedule recurring tasks (data pipelines, retraining, scraping) - Need persistent cloud storage for model weights or datasets - Want to run code in custom container environments - Build job queues or async task processing systems ## Installation and Authentication ### Install ```bash uv pip install modal ``` ### Authenticate Prefer existing credentials before creating new ones: 1. Check whether `MODAL_TOKEN_ID` and `MODAL_TOKEN_SECRET` are already present in the current environment. 2. If not, check for those values in a local `.env` file and load them if appropria...