🎉 v0.1.0

🤖 SIP Enabled AI Agent

🤖

ROBO CODED — This release was made with AI and may not be 100% sane. But the code does work! 🎉

Release Date: November 30, 2025
License: AGPL-3.0
Platform: NVIDIA DGX Spark (Grace Blackwell GB10)

🚀 Overview

The first public release of SIP AI Assistant — a voice-powered AI assistant that answers phone calls, understands natural language, and performs actions through an extensible plugin system.

Built for the NVIDIA DGX Spark with 128GB unified memory, this system runs entirely on local infrastructure with no cloud dependencies for voice processing or LLM inference.

✨ Highlights

┌─────────────────────────────────────────────────────────────┐
│ 📞 SIP AI Assistant v0.1.0                                  │
├─────────────────────────────────────────────────────────────┤
│ ✅ Full SIP/RTP voice call handling                        │
│ ✅ Real-time STT via Whisper (Speaches)                    │
│ ✅ Natural TTS via Kokoro (Speaches)                       │
│ ✅ LLM integration (vLLM, OpenAI, Ollama)                  │
│ ✅ 10 built-in tools                                        │
│ ✅ Plugin system for custom tools                          │
│ ✅ REST API for outbound calls                             │
│ ✅ Scheduled & recurring calls                             │
│ ✅ Customizable phrases                                     │
│ ✅ Full observability stack                                 │
└─────────────────────────────────────────────────────────────┘

🔧 Built-in Tools

🌐 REST API

Scheduled Calls

# One-time call
curl -X POST http://localhost:8080/schedule \
  -d '{"extension": "1001", "tool": "WEATHER", "at_time": "07:00"}'

# Recurring daily
curl -X POST http://localhost:8080/schedule \
  -d '{"extension": "1001", "tool": "WEATHER", "at_time": "07:00", "recurring": "daily"}'

# Weekdays only
curl -X POST http://localhost:8080/schedule \
  -d '{"extension": "1001", "message": "Stand up time!", "at_time": "09:00", "recurring": "weekdays"}'

🗣️ Customizable Phrases

Configure the assistant's personality via environment variables or JSON:

Environment Variables:

PHRASES_GREETINGS=["Hello!","Hi there!","Hey!"]
PHRASES_GOODBYES=["Goodbye!","Take care!"]
PHRASES_ACKNOWLEDGMENTS=["Okay.","Got it.","Sure."]
PHRASES_THINKING=["One moment.","Let me check."]
PHRASES_ERRORS=["Sorry, I didn't catch that."]
PHRASES_FOLLOWUPS=["Anything else?"]

JSON File (data/phrases.json):

{
  "greetings": ["Beep boop! What do you want, human?"],
  "goodbyes": ["Bye, meatbag!"],
  "errors": ["My audio sensors must be malfunctioning."]
}

🔌 Plugin System

Create custom tools with Python:

from tool_plugins import BaseTool, ToolResult, ToolStatus

class MyTool(BaseTool):
    name = "MY_TOOL"
    description = "Does something cool"
    
    parameters = {
        "input": {"type": "string", "required": True}
    }
    
    async def execute(self, params):
        return ToolResult(
            status=ToolStatus.SUCCESS,
            message=f"You said: {params['input']}"
        )

📊 Observability

Key Metrics:

• sip_agent_calls_total — Total calls handled
• sip_agent_call_duration_seconds — Call duration histogram
• sip_agent_tool_calls_total — Tool invocations by name
• sip_agent_stt_latency_seconds — Speech-to-text latency
• sip_agent_tts_latency_seconds — Text-to-speech latency
• sip_agent_llm_latency_seconds — LLM response latency

🏗️ Architecture

flowchart LR
    subgraph Caller
        Phone[📱 SIP Phone]
    end
    
    subgraph Agent["🤖 SIP AI Agent"]
        SIP[SIP Client]
        Audio[Audio Pipeline]
        Tools[Tool Manager]
        API[REST API]
    end
    
    subgraph Services
        LLM[🧠 LLM Server]
        Speaches[🎤 Speaches]
    end
    
    Phone <-->|SIP/RTP| SIP
    SIP <--> Audio
    Audio <--> Speaches
    Audio <--> Tools
    Tools <--> LLM
    API <--> Tools

🖥️ System Requirements

Recommended: NVIDIA DGX Spark

┌─────────────────────────────────────────────────────────────┐
│ 🟢 NVIDIA DGX Spark                                         │
├─────────────────────────────────────────────────────────────┤
│ 🧠 Grace Blackwell GB10 Superchip                          │
│ 💾 128GB Unified Memory                                     │
│ ⚡ 1 PFLOP AI Performance                                   │
└─────────────────────────────────────────────────────────────┘

Minimum Requirements

Software Dependencies

📦 Installation

# Clone repository
git clone https://github.com/your-org/sip-agent.git
cd sip-agent

# Configure
cp sip-agent/.env.example sip-agent/.env
nano sip-agent/.env

# Start
docker compose up -d

# Verify
curl http://localhost:8080/health

📚 Documentation

Full documentation available at sip-agent.readme.io

⚠️ Known Limitations

• WebSocket realtime STT mode is experimental (use STT_MODE=batch for stability)
• Maximum concurrent calls limited by LLM server capacity
• Weather tool requires Tempest station (or customize for other APIs)
• Some TTS voices may struggle with unusual words or names

🔜 Roadmap

🙏 Acknowledgments

• NVIDIA DGX Spark — AI supercomputer platform
• Speaches — Unified STT/TTS server
• PJSIP — SIP stack
• FastAPI — REST API framework
• WeatherFlow Tempest — Weather data

📜 License

SPDX-License-Identifier: AGPL-3.0-or-later

This program is free software: you can redistribute it and/or modify
it under the terms of the GNU Affero General Public License as published
by the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.

📞 Support

SIP AI Assistant v0.1.0

Made with ❤️ and 🤖

Now go make some calls! 📞