Introducing Speech Engine

ElevenLabs Speech Engine adds real-time voice to your own chat agent or LLM. ElevenLabs handles speech-to-text, turn-taking, text-to-speech and browser playback while your server owns the agent logic and streams response text over a Speech Engine WebSocket. Use it when you want voice on a custom runtime rather than a fully hosted ElevenAgents configuration.

ElevenAgents

  • Text behavior overrides: Added text_behavior_overrides, a per-ConversationInitiationSource map of BehaviorOverride objects with optional verbosity, output_format and interaction_budget fields for channel-specific agent behavior.
  • Integration sources: Added Intercom, Telegram and Freshdesk.
  • OTLP conversation traces: Get conversation details now accepts an optional format query parameter. Set format=otlp_traces to return OTLP-compatible trace data alongside the standard conversation payload.
  • ASR keyword overrides: Added ASRConversationalConfigOverride and ASRConversationalConfigOverrideConfig schemas with optional keywords arrays, wired into conversation config client override models.
  • Webhook auth metadata: Webhook tool configuration schemas now expose optional auth_resolved_params (string array) documenting URL placeholders resolved from the auth connection.

Music

  • Generation mode: Added MusicGenerationMode (track, loop, ambience) and an optional generation_mode field on music prompt request bodies.
  • Video to music model: Video to music (POST /v1/music/video-to-music) now accepts optional model_id (string, default music_v1).

ElevenCreative Studio

  • Conversion credits: Chapter and voice conversion statistics response models now include optional credits_needed_to_convert (integer) indicating credits required before conversion.

Workspaces

  • Resource types: Added studio_projects to WorkspaceResourceType.

SDK Releases

Python SDK

  • v2.50.0 - Regenerated the SDK for the May 25, 2026 API schema.
  • v2.49.1 - Updated Speech Engine API calls to return the full response object.
  • v2.49.0 - Regenerated the SDK for the May 18–25, 2026 API schema, including ElevenAgents text behavior overrides, music generation_mode, and workspace studio_projects.

JavaScript SDK

  • v2.50.0 - Added missing Music API methods and tests, and regenerated the SDK for the May 25, 2026 API schema.
  • v2.49.1 - Updated Speech Engine API calls to return the full response object.
  • v2.49.0 - Regenerated the SDK for the May 18–25, 2026 API schema, including ElevenAgents text behavior overrides, music generation_mode, and workspace studio_projects.

Packages

API

Updated Endpoints and Schemas

ElevenAgents

  • Get conversation details - GET /v1/convai/conversations/{conversation_id}
    • Added optional format query parameter; otlp_traces returns OTLP-compatible trace data
  • Agent configuration schemas
    • Added text_behavior_overrides map keyed by ConversationInitiationSource with BehaviorOverride values (verbosity, output_format, interaction_budget)
  • ConversationInitiationSource enum
    • Added intercom_integration, telegram_integration and freshdesk_integration
  • ASR override schemas
    • Added ASRConversationalConfigOverride and ASRConversationalConfigOverrideConfig with optional keywords (array of strings)
  • Webhook tool schemas
    • Added optional auth_resolved_params (string array) on webhook configuration models

Music

  • Video to music - POST /v1/music/video-to-music
    • Added optional model_id (string, default music_v1)
  • Music prompt request schemas
    • Added optional generation_mode referencing MusicGenerationMode (track, loop, ambience)

ElevenCreative Studio

  • Chapter and voice conversion statistics schemas
    • Added optional credits_needed_to_convert (integer)

Workspaces

  • WorkspaceResourceType enum
    • Added studio_projects