Telnyx LLM

Telnyx Inference exposes hosted language models through an OpenAI-compatible Chat Completions API. The plugin is a thin wrapper over the shared Chat Completions client pointed at https://api.telnyx.com/v2/ai, so streaming and tool calling work the same as any other Chat Completions provider.

Vision Agents uses Stream Video for real-time WebRTC transport by default. External WebRTC transports are supported as well. Most AI providers offer free tiers to get started.

Get your Telnyx API key from the Telnyx Mission Control Portal.

Telnyx also provides speech-to-text, text-to-speech, and PSTN telephony. You can use all four in the same agent.

Installation

uv add "vision-agents[telnyx]"

Quick start

from vision_agents.core import Agent, User
from vision_agents.plugins import getstream, smart_turn, telnyx

agent = Agent(
    edge=getstream.Edge(),
    agent_user=User(name="Assistant", id="agent"),
    instructions="You are a helpful voice assistant.",
    stt=telnyx.STT(),
    llm=telnyx.LLM(),
    tts=telnyx.TTS(),
    turn_detection=smart_turn.TurnDetection(),
)

Set TELNYX_API_KEY in your environment or pass api_key directly.

Parameters

Name	Type	Default	Description
`model`	`str`	`"meta-llama/Llama-3.3-70B-Instruct"`	Model id as served by Telnyx Inference
`api_key`	`str`	`None`	API key (defaults to `TELNYX_API_KEY` env var)
`base_url`	`str`	`"https://api.telnyx.com/v2/ai"`	API base URL
`client`	`AsyncOpenAI`	`None`	Pre-configured client (overrides `api_key` and `base_url`)
`tools_max_rounds`	`int`	`3`	Maximum calling rounds for multi-hop tool calls

Model ids come from the Telnyx catalogue at GET /v2/ai/models and are not validated locally.

Function calling

@agent.llm.register_function(description="Get weather for a location")
async def get_weather(location: str) -> str:
    return f"The weather in {location} is sunny and 30°C"

See the Function Calling guide for details.

Next steps

Telnyx STT

Streaming speech-to-text

Telnyx TTS

Streaming text-to-speech

Telnyx Telephony

PSTN calls via Call Control

Function Calling

⌘I

Overview

Language Models

Realtime

Speech-to-Text

Text-to-Speech

Vision & Video

Avatars

Turn Detection

Infrastructure

Edge Transport

Telephony

Custom Integrations

Installation

Quick start

Parameters

Function calling

Next steps

Telnyx STT

Telnyx TTS

Telnyx Telephony

Function Calling

​Installation

​Quick start

​Parameters

​Function calling

​Next steps

Telnyx STT

Telnyx TTS

Telnyx Telephony

Function Calling

Installation

Quick start

Parameters

Function calling

Next steps