Vision Agents uses Stream Video for real-time WebRTC transport by default. External WebRTC transports are supported as well. Most AI providers offer free tiers to get started.
Installation
getstream.Edge(), so both extras are required.
Environment Variables
bedrock:InvokeModelWithBidirectionalStream).
Quick Start
Parameters
Nova Behavior
instructionsare required before the model accepts user input.- Text-only prompts may not produce audio — use audio input for reliable responses.
- Function calling may require at least one audio content block before text tool calls work reliably.
Automatic Reconnection
AWS Bedrock has an 8-minute connection limit. The plugin handles this automatically:- After 5 minutes of connection age (configurable via
reconnect_after_minutes) and more than 3 seconds since last audio activity, reconnects during a quiet moment - After 7 minutes of connection age, forces reconnect regardless of audio activity
Voice Activity Detection
The plugin uses Silero VAD to track incoming user speech for reconnection timing. Agent audio output updates activity separately. Silero warmup is handled automatically by the Agent lifecycle.Function Calling
Register tools on the LLM before the agent connects:Next Steps
Build a Voice Agent
Get started with voice
Function Calling
Tools and MCP integration