scrape-websitelisted

# Scrape a website ## Trigger Extracting content from a single web page — an article, product page, documentation, or any URL. ## Workflow 1. Verify anakin-cli is authenticated by running `anakin status`. 2. Create the output directory if it doesn't exist: ```bash mkdir -p .anakin ``` 3. Determine the output filename from the URL (use domain and path): - `https://docs.react.dev/learn` -> `.anakin/docs.react.dev-learn.md` - `https://example.com/pricing` -> `.anakin/example.com-pricing.md` 4. Check if `$ARGUMENTS` contains `--browser`. If the URL is a known SPA/JS-heavy site (React apps, Next.js, Angular, etc.), add `--browser` automatically. 5. Run the scrape: ```bash anakin scrape "$ARGUMENTS" -o .anakin/<filename>.md ``` 6. Check the output file size and read incrementally: ```bash wc -l .anakin/<filename>.md && head -80 .anakin/<filename>.md ``` 7. Summarize the content for the user. If the page is long, highlight the key sections and offer to read specific parts. ## Commands ```bash # Clean readable text (default) anakin scrape "<url>" -o .anakin/output.md # Structured data anakin scrape "<url>" --format json -o .anakin/output.json # Full API response with HTML and metadata anakin scrape "<url>" --format raw -o .anakin/output.json # JavaScript-heavy or single-page app sites anakin scrape "<url>" --browser -o .anakin/output.md # Geo-targeted scraping anakin scrape "<url>" --country gb -o .anakin/output.md # Custom timeout for slow