pipecat-friday-agent

# Pipecat Friday Agent ## Overview This skill provides a blueprint for building **F.R.I.D.A.Y.** (Replacement Integrated Digital Assistant Youth), a local voice assistant inspired by the tactical AI from the Iron Man films. It uses the **Pipecat** framework to orchestrate a low-latency pipeline: - **STT**: OpenAI Whisper (`whisper-1`) or `gpt-4o-transcribe` - **LLM**: Google Gemini 2.5 Flash (via a compatibility shim) - **TTS**: OpenAI TTS (`nova` voice) - **Transport**: Local Audio (Hardware Mic/Speakers) ## When to Use This Skill - Use when you want to build a real-time, conversational voice agent. - Use when working with the Pipecat framework for pipeline-based AI. - Use when you need to integrate multiple providers (Google and OpenAI) into a single voice loop. - Use when building Iron Man-themed or tactical-themed voice applications. ## How It Works ### Step 1: Install Dependencies You will need the Pipecat framework and its service providers installed: ```bash pip install pipecat-ai[openai,google,silero] python-dotenv ``` ### Step 2: Configure Environment Create a `.env` file with your API keys: ```env OPENAI_API_KEY=your_openai_key GOOGLE_API_KEY=your_google_key ``` ### Step 3: Run the Agent Execute the provided Python script to start the interface: ```bash python scripts/friday_agent.py ``` ## Core Concepts ### Pipeline Architecture The agent follows a linear pipeline: `Mic -> VAD -> STT -> LLM -> TTS -> Speaker`. This allows for granular control over each...