media-processing

Featured

Ingest and process media files (video, audio, image)

AI & Automation 954 stars 145 forks Updated today MIT

Install

View on GitHub

Quality Score: 92/100

Stars 20%
99
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

Ingest and track processing of media files (video, audio, images) through a configurable 3-phase pipeline. ## End-to-End Workflow The processing pipeline follows a sequential 3-phase flow: 1. **Ingest** (`ingest_media`) - Register a media file, detect MIME type, extract duration, deduplicate by content hash. 2. **Preprocess** (`extract_keyframes`) - Detect dead time, segment the video into windows, extract downscaled keyframes, build a subject registry, and write a pipeline manifest. 3. **Map** (`analyze_keyframes`) - Send each segment's frames to Gemini 2.5 Flash with assistant-provided extraction instructions and a JSON Schema for guaranteed structured output. Supports concurrency pooling, cost tracking, resumability, and automatic retries. 4. **Reduce / Query** (`query_media`) - Send all map output to Claude for intelligent analysis and Q&A. Supports arbitrary natural language queries about video content. 5. **Clip** (`generate_clip`) - Extract video clips around specific moments. The processing pipeline service (`services/processing-pipeline.ts`) orchestrates phases 2-4 automatically with retries, resumability, and cancellation support. ## Tools ### ingest_media Register a media file for processing. Accepts an absolute file path, validates the file exists, detects MIME type, extracts duration (for video/audio via ffprobe), and registers the asset with content-hash deduplication. ### media_status Query the processing status of a media asset. Returns the asset meta...

Details

Author
vellum-ai
Repository
vellum-ai/vellum-assistant
Created
5 months ago
Last Updated
today
Language
TypeScript
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

ai-generated-media-pipeline

Turn AI-generated clips and stills into production web hero assets — generate via Higgsfield/Runway/Sora/Veo/Kling (video) and Nano Banana/Flux/Seedream (image), ideally through an MCP so the agent produces assets in-loop, then encode them web-ready (AV1/H.264, faststart, poster extraction, frame sequences) within a weight and licensing budget. Use when sourcing a hero video/background loop/scroll frame-sequence from AI tools, or preparing any generated media for the web. Feeds cinematic-hero-sections (which consumes the assets). Triggers on "Higgsfield", "Nano Banana", "AI hero video", "generate a background video", "Runway/Sora/Veo/Kling", "encode video for web", "ffmpeg hero", "loopable clip", "poster frame".

0 Updated 2 days ago
BenMacDeezy
Data & Documents Solid

full-pipeline

Run the complete end-to-end production pipeline — parse, match, compose, copy, preview, review, finalize.

22 Updated today
indranilbanerjee
AI & Automation Solid

video-ingest

Ingests a video's content (YouTube and similar) for agent context, routing by capability, task need, and video length — a natively multimodal engine (Gemini via agy or the Gemini API) for direct-URL and long video, Claude vision over ffmpeg-extracted frames when no such engine is present, yt-dlp captions when the transcript alone suffices, and the logged-in claude-in-chrome session for auth-gated videos. The governor cross-checks any multimodal comprehensive-read. Triggered by "ingest this video", "what does this video show", "get the transcript from this YouTube video", "video-ingest".

8 Updated today
chrono-meta