PluginBench
Skill
Review
Audit score 70

videoagent-audio-studio

pexoai/pexo-skills

One-command access to TTS, music generation, sound effects, and voice cloning via ElevenLabs and fal.ai.

What is videoagent-audio-studio?

VideoAgent Audio Studio is a smart audio dispatcher that analyzes requests and routes them to the best available model for speech synthesis, music composition, sound effects, or voice cloning. Use it when you need to generate any type of audio without managing multiple API keys and integrations.

  • Route text-to-speech requests to ElevenLabs TTS with multiple model options (multilingual, turbo, monolingual)
  • Generate background music and soundtracks via cassetteai-music on fal.ai
  • Create sound effects from text descriptions with durations up to 22 seconds
  • Clone voices from audio samples for custom voice synthesis
  • Support 29 languages with multilingual TTS model
  • Provide real-time low-latency speech synthesis with turbo models

How to install videoagent-audio-studio

npx skills add https://github.com/pexoai/pexo-skills --skill videoagent-audio-studio
Prerequisites
  • ELEVENLABS_API_KEY (required) from elevenlabs.io/app/settings/api-keys
  • FAL_KEY (optional) from fal.ai/dashboard/keys for music generation
  • ElevenLabs MCP server installed via @elevenlabs/mcp
Claude Code
Cursor
Windsurf
Cline

How to use videoagent-audio-studio

  1. 1.Start the AudioMind server once per session by running bash {baseDir}/tools/start_server.sh
  2. 2.Identify the request type: TTS (narrate/voice-over), music (compose/background), SFX (sound effect), or voice cloning
  3. 3.Call the appropriate MCP tool: text_to_speech for TTS, text_to_sound_effects for music/SFX, or voice_add for cloning
  4. 4.Provide the required parameters (text, voice_id, model_id, duration, or audio file URL)
  5. 5.Retrieve the generated audio URL from the response and use it in your project

Use cases

Good for
  • Narrate video scripts or create voice-overs for presentations and tutorials
  • Generate background music and ambient soundscapes for podcasts or video projects
  • Produce sound effects for games, videos, or interactive media
  • Clone a speaker's voice for consistent narration across multiple videos
  • Create multilingual audio content for global audiences
Who it's for
  • Video creators and editors
  • Podcast producers
  • Game developers
  • Content creators needing voice-overs
  • Teams building multilingual audio content

videoagent-audio-studio FAQ

Which model should I use for real-time TTS?

Use eleven_turbo_v2_5 for ultra-low latency (<1s). For best quality with slightly longer latency (~3s), use eleven_multilingual_v2.

Can I use my own voice for narration?

Yes, use the voice_add MCP tool to clone your voice from an audio sample, then reference the cloned voice_id in text_to_speech calls.

What's the difference between elevenlabs-sfx and cassetteai-music?

elevenlabs-sfx generates short sound effects (up to 22s) from descriptions. cassetteai-music generates longer background music and soundtracks optimized for ambient/compositional use.

Do I need both ELEVENLABS_API_KEY and FAL_KEY?

ELEVENLABS_API_KEY is required. FAL_KEY is optional and only needed if you want to use fal.ai's music generation models instead of ElevenLabs alternatives.

Can I self-host the audio generation proxy?

Yes, deploy the proxy/ directory to Vercel or another Node.js host, set environment variables, and point cli.js to your custom domain via AUDIOMIND_PROXY_URL.

Full instructions (SKILL.md)

Source of truth, from pexoai/pexo-skills.


name: videoagent-audio-studio version: 3.0.0 author: "wells" emoji: "🎙️" tags:

  • video
  • audio
  • tts
  • music
  • sfx
  • voice-clone
  • elevenlabs
  • fal description: > Tired of juggling multiple audio APIs? This skill gives you one-command access to TTS, music generation, sound effects, and voice cloning. Use when you want to generate any audio without managing multiple API keys. homepage: https://github.com/pexoai/audiomind-skill metadata: openclaw: emoji: "🎙️" primaryEnv: ELEVENLABS_API_KEY requires: env: - ELEVENLABS_API_KEY install:
    • id: elevenlabs-mcp kind: npm package: "@elevenlabs/mcp" label: "Install ElevenLabs MCP server"

🎙️ VideoAgent Audio Studio

Use when: User asks to generate speech, narrate text, create a voice-over, compose music, or produce a sound effect.

VideoAgent Audio Studio is a smart audio dispatcher. It analyzes your request and routes it to the best available model — ElevenLabs for speech and music, fal.ai for fast SFX — and returns a ready-to-use audio URL.


Quick Reference

Request TypeBest ModelLatency
Narrate text / Voice-overelevenlabs-tts-v3~3s
Low-latency TTS (real-time)elevenlabs-tts-turbo<1s
Background musiccassetteai-music~15s
Sound effectelevenlabs-sfx~5s
Clone a voice from audioelevenlabs-voice-clone~10s

How to Use

1. Start the AudioMind server (once per session)

bash {baseDir}/tools/start_server.sh

This starts the ElevenLabs MCP server on port 8124. The skill uses it for all audio generation.

2. Route the request

Analyze the user's request and call the appropriate tool via the MCP server:

Text-to-Speech (TTS)

When user asks to "narrate", "read aloud", "say", or "create a voice-over":

Use MCP tool: text_to_speech
  text: "<the text to narrate>"
  voice_id: "JBFqnCBsd6RMkjVDRZzb"   # Default: "George" (professional, neutral)
  model_id: "eleven_multilingual_v2"   # Use "eleven_turbo_v2_5" for low latency

Music Generation

When user asks to "compose", "create background music", or "make a soundtrack":

Use MCP tool: text_to_sound_effects  (via cassetteai-music on fal.ai)
  prompt: "<music description, e.g. 'upbeat lo-fi hip hop, 90 seconds'>"
  duration_seconds: <duration>

Sound Effect (SFX)

When user asks for a specific sound (e.g., "a door creaking", "rain on a window"):

Use MCP tool: text_to_sound_effects
  text: "<sound description>"
  duration_seconds: <1-22>

Voice Cloning

When user provides an audio sample and wants to clone the voice:

Use MCP tool: voice_add
  name: "<voice name>"
  files: ["<audio_file_url>"]

Example Conversations

User: "Voice this text for me: Welcome to our product launch"

→ Route to: text_to_speech
  text: "Welcome to our product launch"
  voice_id: "JBFqnCBsd6RMkjVDRZzb"
  model_id: "eleven_multilingual_v2"

🎙️ Voiceover done! Listen here


User: "Generate 60 seconds of relaxing background music for a podcast"

→ Route to: cassetteai-music (fal.ai)
  prompt: "relaxing lo-fi background music for a podcast, gentle piano and soft beats, 60 seconds"
  duration_seconds: 60

🎵 Background music ready! Listen here


User: "Generate a sci-fi style door opening sound effect"

→ Route to: text_to_sound_effects
  text: "a futuristic sci-fi door sliding open with a hydraulic hiss"
  duration_seconds: 3

Setup

Required

Set ELEVENLABS_API_KEY in ~/.openclaw/openclaw.json:

{
  "skills": {
    "entries": {
      "videoagent-audio-studio": {
        "enabled": true,
        "env": {
          "ELEVENLABS_API_KEY": "your_elevenlabs_key_here"
        }
      }
    }
  }
}

Get your key at elevenlabs.io/app/settings/api-keys.

Optional (for fal.ai music & SFX models)

"FAL_KEY": "your_fal_key_here"

Get your key at fal.ai/dashboard/keys.


Self-Hosting the Proxy

The cli.js connects to a hosted proxy by default. If you want full control — or need to serve users in regions where vercel.app is blocked — you can deploy your own instance from the proxy/ directory.

Quick Deploy (Vercel)

cd proxy
npm install
vercel --prod

Environment Variables

Set these in your Vercel project (Dashboard → Settings → Environment Variables):

VariableRequired ForWhere to Get
ELEVENLABS_API_KEYTTS, SFX, Voice Cloneelevenlabs.io/app/settings/api-keys
FAL_KEYMusic generationfal.ai/dashboard/keys
VALID_PRO_KEYS(Optional) Restrict accessComma-separated list of allowed client keys

Point cli.js to Your Proxy

export AUDIOMIND_PROXY_URL="https://your-domain.com/api/audio"

Or set it in ~/.openclaw/openclaw.json:

{
  "skills": {
    "entries": {
      "videoagent-audio-studio": {
        "env": {
          "AUDIOMIND_PROXY_URL": "https://your-domain.com/api/audio"
        }
      }
    }
  }
}

Custom Domain (Recommended)

If your users are in mainland China, bind a custom domain in Vercel Dashboard → Settings → Domains to avoid DNS issues with vercel.app.


Model Reference

Model IDTypeProviderNotes
eleven_multilingual_v2TTSElevenLabsBest quality, supports 29 languages
eleven_turbo_v2_5TTSElevenLabsUltra-low latency, ideal for real-time
eleven_monolingual_v1TTSElevenLabsEnglish only, fastest
cassetteai-musicMusicfal.aiReliable, fast music generation
elevenlabs-sfxSFXElevenLabsHigh-quality sound effects (up to 22s)
elevenlabs-voice-cloneCloneElevenLabsClone any voice from a short audio sample

Changelog

v3.0.0

  • Simplified routing table: Removed unstable/offline models from the main reference. The skill now only surfaces models that reliably work.
  • Clearer use-case triggers: Added "Use when" section so the agent activates this skill at the right moment.
  • Unified setup: Single ELEVENLABS_API_KEY is all you need to get started. FAL_KEY is now optional.
  • Removed polling complexity: Music generation now uses cassetteai-music by default, which completes synchronously.

v2.1.0

  • Added async workflow for long-running music generation tasks.
  • Added cassetteai-music as a stable alternative for music generation.

v2.0.0

  • Migrated to ElevenLabs MCP server architecture.
  • Added voice cloning support.

v1.0.0

  • Initial release with TTS, music, and SFX routing.