omniroute-web-fetch

Solid

Fetch a URL and convert to clean markdown via OmniRoute proxying Jina Reader, Firecrawl, raw HTML strip. Use when the user wants to ingest a webpage as markdown for context in an LLM conversation.

AI & Automation 5,612 stars 967 forks Updated today MIT

Install

View on GitHub

Quality Score: 91/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
68
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# OmniRoute — Web Fetch Requires `OMNIROUTE_URL` and `OMNIROUTE_KEY`. See [entry-point SKILL](https://raw.githubusercontent.com/diegosouzapw/OmniRoute/main/skills/omniroute/SKILL.md) for setup. ## Endpoint - `POST $OMNIROUTE_URL/v1/web/fetch` ## Discover ```bash curl $OMNIROUTE_URL/v1/models/web | jq '.data[] | select(.kind == "webFetch")' ``` ## Example ```bash curl -X POST $OMNIROUTE_URL/v1/web/fetch \ -H "Authorization: Bearer $OMNIROUTE_KEY" \ -H "Content-Type: application/json" \ -d '{ "model": "jina/reader", "url": "https://anthropic.com", "format": "markdown" }' ``` Response: `{ url, title, markdown, links?:[...], images?:[...] }` ## Parameters | Field | Type | Description | | -------- | ------ | ----------------------------------------------------------------------- | | `model` | string | Provider from `/v1/models/web` (e.g. `jina/reader`, `firecrawl/scrape`) | | `url` | string | URL to fetch | | `format` | string | `markdown` (default), `html`, `text` | ## Errors - `400 invalid_url` → URL must be http/https - `403 blocked` → provider blocked by target site; try a different model - `503` → provider unavailable; try another model in `/v1/models/web`

Details

Author
diegosouzapw
Repository
diegosouzapw/OmniRoute
Created
3 months ago
Last Updated
today
Language
TypeScript
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

omniroute-web-search

Web search via OmniRoute proxying Tavily, Brave Search, SerpAPI, Exa with auto-fallback. Use when the user wants live web search results, current news, or facts that may be beyond the LLM training cutoff.

5,612 Updated today
diegosouzapw
AI & Automation Solid

omniroute

Entry point for OmniRoute — local/remote AI gateway with OpenAI-compatible REST for chat, image, TTS, STT, embeddings, web search, web fetch, MCP, A2A. Use when the user mentions OmniRoute, OMNIROUTE_URL, or wants AI without writing provider boilerplate. This skill covers setup + indexes capability skills; fetch the relevant capability SKILL.md from the URLs below when needed.

5,612 Updated today
diegosouzapw
Data & Documents Listed

fetching-blocked-urls

Retrieve clean markdown from URLs when web_fetch fails. Converts pages via Jina AI reader service with automatic retry. Use when web_fetch or curl returns 403, blocked, paywall, timeout, JavaScript-rendering errors, or empty content or user explicitly suggests using jina.

124 Updated 3 days ago
oaustegard
Data & Documents Listed

fetch-url-as-markdown

Fetch a web page (URL) and return clean Markdown via local trafilatura, with Exa MCP as a fallback for JS-rendered or anti-bot pages. Use when the user asks to read, fetch, scrape, summarize, or quote a URL — prefer this over the built-in WebFetch tool. Don't use for binary files (PDFs, images, archives) or for fetching API/JSON endpoints.

77 Updated 6 days ago
CodeAlive-AI
Data & Documents Listed

ghostfetch

Stealthy web fetcher that bypasses anti-bot protections. Fetches content from sites like X.com and converts to clean Markdown for AI agents.

5 Updated 6 days ago
iArsalanshah