phone-agent
Run a real-time AI phone agent using Twilio, Deepgram, and ElevenLabs. Handles incoming calls, transcribes audio, generates responses via LLM, and speaks back via streaming TTS. Use when user wants to: (1) Test voice AI capabilities, (2) Handle phone calls programmatically, (3) Build a conversational voice bot.
npx skills add majiayu000/claude-skill-registry --skill phone-agent --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Phone Agent Skill Runs a local FastAPI server that acts as a real-time voice bridge. ## Architecture ``` Twilio (Phone) <--> WebSocket (Audio) <--> [Local Server] <--> Deepgram (STT) | +--> OpenAI (LLM) +--> ElevenLabs (TTS) ``` ## Prerequisites 1. **Twilio Account**: Phone number + TwiML App. 2. **Deepgram API Key**: For fast speech-to-text. 3. **OpenAI API Key**: For the conversation logic. 4. **ElevenLabs API Key**: For realistic text-to-speech. 5. **Ngrok** (or similar): To expose your local port 8080 to Twilio. ## Setup 1. **Install Dependencies**: ```bash pip install -r scripts/requirements.txt ``` 2. **Set Environment Variables** (in `~/.moltbot/.env`, `~/.clawdbot/.env`, or export): ```bash export DEEPGRAM_API_KEY="your_key" export OPENAI_API_KEY="your_key" export ELEVENLABS_API_KEY="your_key" export TWILIO_ACCOUNT_SID="your_sid" export TWILIO_AUTH_TOKEN="your_token" export PORT=8080 ``` 3. **Start the Server**: ```bash python3 scripts/server.py ``` 4. **Expose to Internet**: ```bash ngrok http 8080 ``` 5. **Configure Twilio**: - Go to your Phone Number settings. - Set "Voice & Fax" -> "A Call Comes In" to **Webhook**. - URL: `https://<your-ngrok-url>.ngrok.io/incoming` -
- Architecture
- Prerequisites
- Setup
- Usage
- Customization
pip install -r scripts/requirements.txt export DEEPGRAM_API_KEY="your_key" export OPENAI_API_KEY="your_key" export ELEVENLABS_API_KEY="your_key" export TWILIO_ACCOUNT_SID="your_sid" export TWILIO_AUTH_TOKEN="your_token" export PORT=8080 python3 scripts/server.py ngrok http 8080
What does the phone-agent skill do?
Run a real-time AI phone agent using Twilio, Deepgram, and ElevenLabs. Handles incoming calls, transcribes audio, generates responses via LLM, and speaks back via streaming TTS. Use when user wants to: (1) Test voice AI capabilities, (2) Handle phone calls programmatically, (3) Build a conversational voice bot.
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill phone-agent --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.