video-watching

# Video Watching Turn a video into something an AI can fully reason about: a **time-mapped transcript** with **what's on screen described inline at the same timestamps**. The output is one self-contained file dropped **next to the source video**, so any model (our cloud, this session, anything) can read the whole video without the binary. The clever part: **transcript first, then YOU decide which frames to look at.** You don't blindly OCR every frame. You read the transcript, see where the speaker references something visual ("as you can see here", "this screen", "the chart"), look up that moment in `frames.json`, and open only those frames. ## The loop (do these in order) ### 0. Get the video Ask for the path or link if not given. Local files work today. Remote links (YouTube etc.) need `yt-dlp` (`brew install yt-dlp`) — the engine auto-downloads if it's installed. ### 1. Run the engine (mechanical — one command) ```bash .claude/skills/video-watching/scripts/transcribe.sh "/abs/path/to/video.mov" # language auto-detects — no need to pass it. Override only if auto mislabels a # short/ambiguous clip: ./transcribe.sh "/abs/path/clip.mp4" tr ``` **Pick the mode for the kind of video — this matters most for app/UI recordings:** - **Talking-head / lecture / ad creative** → the default is right. Scene-detect + a 10s gap-fill catches the visuals. - **App screen-recording / onboarding funnel / UI walkthrough** → add `--mode ui`. App screens linger 3–5s and change by **t...