Voice AICAN I VIBECODE
HeyGen?
BUILD FIRST
- A non-sensitive or read-only version of the core experience
- A manual review step wherever correctness or trust matters
- A narrow companion tool that removes a real piece of work
LEAVE FOR LATER
- Regulated decisions, payments, or irreversible actions
- Claims of correctness, compliance, or uptime that the MVP cannot support
- Sensitive integrations until security, support, and auditability are ready
RESEARCH NOTES
What this tool actually does.
HeyGen is a commercial AI video generation platform best known for lifelike avatar talking videos; voice AI is a feature layer rather than its core, which matches the 'not really a Voice AI product' verdict. Official pages describe an AI text-to-speech tool with 300+ voices in 175+ languages, a document-style text editor with per-line tone, pacing, and emotion control, instant voice cloning from ~30-second samples, pro clones from a few minutes of audio, and AI dubbing across 177+ languages. Cloned voices drive avatar videos (Avatar V model) with synced lip movement and HD/4K export. Cloning is consent-first: HeyGen verifies voice ownership before training, applies SOC 2 Type II and GDPR controls, and states it never uses customer voice data to train shared AI voices. Its developer API (developers.heygen.com) covers browsing voices, POST /v3/voices to design a voice from a text descripti
RESEARCHED BUILD PROMPT
Give this to your coding agent.
Build 'Script-to-Spoke', a HeyGen-style web app for the script-to-AI-narration workflow, scoped to voice (not a full avatar studio). Workflow: a user pastes/types a script; picks a stock voice from a browsable, filterable library (language, style, age, accent) or uploads a short sample (>=30s) behind an explicit consent checkbox to create a voice clone; edits tone, pacing, and emotion per line; previews synthesized audio; exports MP3/WAV narration or renders an MP4 with the transcript as captions and a placeholder presenter frame (no real lip-sync). Requirements: React/Next.js frontend with a document-style script editor; backend (Node or Python) that proxies a commercial TTS/voice-clone provider (e.g., ElevenLabs or Azure Speech) with voice metadata search in a database; async job queue with status polling for clone training and rendering; consent capture and sample upload before cloning. Do not copy HeyGen's brand, logo, voices, avatars, or UI. Out of scope: photorealistic avatar generation, video translation/dubbing pipeline, public voice marketplace, mobile apps, multi-tenant billing, enterprise SSO. Deliver a README with setup steps, required env vars/API keys, and limitations (paid-API costs, rate limits, consent and data-compliance obligations).