livekit/agents

原文摘要

A framework for building realtime voice AI agents 🤖🎙️📹 Looking for the JS/TS library? Check out AgentsJS What is Agents? The Agent Framework is designed for building realtime, programmable participants that run on servers. Use it to create conversational, multi-modal voice agents that can see, hear, and understand. Features Flexible integrations : A comprehensive ecosystem to mix and match the right STT, LLM, TTS, and Realtime API to suit your use case. Integrated job scheduling : Built-in task scheduling and distribution with dispatch APIs to connect end users to agents. Extensive WebRTC clients : Build client applications using LiveKit's open-source SDK ecosystem, supporting all major platforms. Telephony integration : Works seamlessly with LiveKit's telephony stack , allowing your agent to make calls to or receive calls from phones. Exchange data with clients : Use RPCs and other Data APIs to seamlessly exchange data with clients. Semantic turn detection : Uses a transformer model to detect when a user is done with their turn, helps to reduce interruptions. MCP support : Native support for MCP. Integrate tools provided by MCP servers with one line of code. Builtin test framew…