brightdata-local-search

# Bright Data Local Search Run powerful web searches locally using Bright Data's SERP API. This skill sets up the [unfancy-search](https://github.com/yaronbeen/unfancy-search) pipeline — a local search engine with query expansion, multi-engine SERP retrieval, RRF reranking, deduplication, and domain clustering. **Important: This skill uses the LOCAL version only. Do not use the hosted endpoint.** ## Prerequisites - [Bright Data](https://brightdata.com) account with SERP API access - [Anthropic API key](https://console.anthropic.com) (for query expansion, optional) - Docker (recommended) or Node.js 18+ with pnpm ## Setup ### Step 1: Clone and Configure ```bash git clone https://github.com/yaronbeen/unfancy-search.git cd unfancy-search cp .env.example .env ``` ### Step 2: Set Environment Variables Edit `.env` with your credentials: ```env BRIGHT_DATA_API_TOKEN=your_brightdata_token BRIGHT_DATA_SERP_ZONE=serp_api1 ANTHROPIC_API_KEY=your_anthropic_key # Optional: enables AI query expansion ``` Get your Bright Data token from: https://brightdata.com (SERP API section) ### Step 3: Start the Local Server **Docker (recommended):** ```bash docker compose up -d # Server runs at http://localhost:3000 ``` **Node.js:** ```bash pnpm install pnpm dev # Server runs at http://localhost:3000 ``` ## API Endpoints All requests go to `http://localhost:3000`: | Endpoint | Method | Description | |----------|--------|-------------| | `/api/search` | POST | Start a search job | | `...