speech-build_skill

Overview

This skill provides audio generation and transcription using Google's Gemini-TTS and Chirp 3 models. It supports single- and multi-speaker Text-to-Speech, Instant Custom Voice creation, and Speech-to-Text with optional diarization. The implementation relies on the google-genai and google-cloud-speech SDKs for robust, production-ready workflows.

How this skill works

The skill calls Gemini-TTS to generate audio from text, allowing voice selection, style control, and multi-speaker mixes. For transcription, it uses Chirp 3 (via google-cloud-speech) to produce transcripts with timestamps and optional speaker diarization. Typical flows instantiate a genai.Client for TTS and a speech_v2 client for STT, then send configuration objects that control response modality, voice config, and diarization.

When to use it

• Generate natural-sounding audio for UI narration, podcasts, or automated messages.
• Create custom or branded voices quickly using Instant Custom Voice features.
• Transcribe meetings, interviews, or call recordings with speaker diarization.
• Build multimodal experiences that need synchronized text and audio outputs.
• Prototype voice assistants or accessibility features requiring high-quality TTS/STT.

Best practices

• Choose an appropriate prebuilt voice and locale to match your audience and content tone.
• Control speaking style and pacing through the prompting guide and speech_config parameters.
• Use diarization for multi-speaker audio; split very long audio into segments to improve accuracy.
• Normalize audio input (sample rate, channels) and prefer WAV/FLAC for STT quality.
• Cache generated audio when reusing the same content to reduce cost and latency.

Example use cases

• Generate narrated product tours with a consistent branded voice using Gemini-TTS.
• Transcribe and diarize webinar recordings to produce searchable meeting notes.
• Create multi-character dialogue audio for games or interactive stories with multi-speaker TTS.
• Build a voice-over pipeline that converts blog posts into downloadable podcasts.
• Proof user-submitted audio by transcribing and aligning captions with timestamps.