How AI video ads are made: models, voice and lip-sync

An AI video ad is a chain of six or seven models, each with its own cost and its own way of failing. Here is the chain, link by link.

A film crew shooting a scene with a camera mounted on a crane
Photo: Vssun, CC BY-SA 3.0, via Wikimedia Commons

AI video ads are made by chaining separate models: a language model drafts the script, a video model (such as Google's Veo) generates footage from text or product images, an avatar model renders a presenter, a text-to-speech or cloned voice reads the lines, a dubbing step translates them, and a lip-sync model reshapes the mouth to match the new audio. A human then edits, checks claims and adds the required AI label. Each link is cheap on its own; quality problems come from where the links join.

Key takeaways
  • Seven stages: script, visuals, avatar, voice, dubbing, lip-sync, then human edit and label.
  • Wav2Lip (IIIT Hyderabad, 2020) is the lip-sync method most tools build on; it scored a sync error of 6.386 against 6.736 for real video.
  • 1,704 hours from 10,496 speakers in 22 languages: the IndicVoices-R corpus behind better Indian TTS.
  • $205M HeyGen ARR by June 2026 (Sacra estimate) shows how fast avatar video went mainstream.
  • Most visible failures happen at the joins: dubbing timing, lip-sync on synthetic voices, product drift.

The marketing pitch says "type a prompt, get an ad". The practitioners in the r/AskMarketing thread on agency AI tools said something more useful: helpful, yes; magic, no.

The top answer described a lean stack (a chat model for drafts, a research tool, a design tool for clean-up, a video tool for quick ad variations) and the habit of testing many tools but keeping one or two. That is the right frame. Below I take the pipeline apart stage by stage, with the research behind the hardest stages and the numbers Indian brands have published.

What are the stages of an AI video ad pipeline?

A typical AI video ad pipeline has seven stages: script, visual generation, presenter or avatar, voice, translation and dubbing, lip-sync, and final edit with compliance. Not every ad uses every stage; a product-only reel skips the avatar and lip-sync entirely.

1. Scriptlanguage model2. Visualstext/image to video3. Avatardigital presenter4. VoiceTTS or clone5. Dubbingtranslate + re-voice6. Lip-syncmouth to new audio7. Edit + labelhuman, compliancehuman review loop: claims, faces, pronunciation, brand
The AI video ad pipeline. Most visible failures happen at stages 3, 5 and 6, where one model's output becomes another model's input.
StageTool typeWhat it does wellTypical failure
ScriptLarge language modelMany hook and angle variants fastGeneric claims, made-up product facts, flat Hinglish
VisualsText-to-video and image-to-video (Veo and similar)Short product and lifestyle shots from stillsWarped hands and text, product shape drift between shots
AvatarPresenter video platforms (HeyGen, Synthesia)Talking-head explainers in many languagesStiff gestures, the "uncanny" look that lowers trust
VoiceText-to-speech and voice cloningClean narration, consistent brand voiceWrong stress on Indian names and numbers, robotic pacing
DubbingSpeech translation + re-voicingOne shoot into many languagesLiteral translation, timing that runs longer than the shot
Lip-syncAudio-driven mouth generation (Wav2Lip lineage)Matching mouths to new audioBlurry mouth region, drift on fast speech and side angles
Edit and labelHuman editor + platform toolsPacing, brand fit, legal checksSkipped under deadline pressure

How do video models turn a product photo into an ad?

Image-to-video models take one or more stills and a text prompt and generate a few seconds of motion that keeps the subject recognisable.

Generation moves inside the ad platforms

  • Google: Asset Studio in Google Ads launched formally on 10 September 2025 with Veo-based video generation alongside Imagen 4, and by May 2026 Veo was available in Asset Studio and Video Builder for making video from images and text prompts.
  • Meta: it built generative creative tools into Advantage+ and has reported that more than a million advertisers made over 15 million ads with those tools in a single month.

The ad platforms want generation inside the buying tool because, as I explain in how Meta Andromeda picks ads, their delivery systems now reward a steady supply of distinct creatives.

The story

In late June 2024, at the Cannes Lions festival, Toys"R"Us premiered a one-minute brand film about its founder, Charles Lazarus, and the birth of its mascot, Geoffrey the Giraffe. It was billed as the first brand film made with OpenAI's Sora, which was then open only to alpha testers.

The agency Native Foreign made it, with its chief creative officer Nik Kleverov directing and Toys"R"Us Studios president Kim Miller Olko as executive producer. The team went from concept to finished film in a few weeks, generating hundreds of iterative shots and cutting them down to a few dozen. It was not pure AI: the film used corrective visual effects and an original score by Aaron Marsh of the band Copeland. The generator made the shots; people chose, fixed and scored them.

Marketing Dive: Toys R Us uses OpenAI's Sora for a brand film (Jun 2024)

Where video models still fail

What these models still get wrong is consistency. A bottle that is 330 ml in shot one can look taller in shot three; on-pack text often turns to near-letters.

For regulated categories (food, health, finance) that is a claims problem, not just an aesthetic one. The working rule is to generate motion around a real product image and never let the model redraw the label.

A dubbing room with a microphone, a script stand and a screen for synchronising voice to picture
A conventional dubbing room. AI dubbing compresses this step into translation, voice generation and lip-sync, but someone who speaks the language still has to listen.Photo: Andres Moreno, CC BY 2.0, via Wikimedia Commons

How do AI avatars work, and who sells them?

AI avatar platforms record a real person (or license a stock presenter), learn their face and voice, and then render new talking-head video from any script. They sell mostly to companies that need many explainer or training videos in many languages, and they are among the fastest-growing AI software businesses.

HeyGen annual recurring revenue (Sacra estimates)
See the data as a table
HeyGen ARR ($M)
End 20220.4
Mar 20231
Jul 20233
End 202319
End 202457.5
Sep 202595
End 2025123
Jun 2026205

Source: Sacra: HeyGen revenue, valuation and funding · Estimates by Sacra, not audited company figures.

Sacra estimates HeyGen went from about $0.4 million in annual recurring revenue at the end of 2022 to $205 million by June 2026.

Synthesia, the enterprise-focused rival, passed $100 million ARR in April 2025 and raised $200 million at a $4 billion valuation in January 2026, led by GV, according to TechCrunch. HeyGen's Creator plan was listed at $24 a month (about ₹2,000) with voice cloning included, which is why avatar ads went from agency novelty to something a two-person D2C team can run.

$0.4M to $205MHeyGen ARR, end 2022 to June 2026 (Sacra)
$100MSynthesia ARR passed, April 2025
~₹2,000HeyGen Creator plan a month, voice cloning included
$205MHeyGen ARR, June 2026 (Sacra estimate)
$4BSynthesia valuation, Jan 2026 (TechCrunch)
$24HeyGen Creator plan per month, with voice cloning (Sacra)
A film crew laying a camera dolly track and holding a reflector at an old stone pavilion at Chikkajala Fort near Bengaluru
A conventional shoot spends much of its budget on crew, track, lighting and logistics, as at this location shoot near Bengaluru. Avatar and image-to-video tools replace part of that, not the decisions.Photo: David Brossard, CC BY-SA 2.0, via Wikimedia Commons

How does AI lip-sync work?

AI lip-sync takes a video of a face and a new audio track, and regenerates only the lower half of the face, frame by frame, so mouth shapes match the new speech. The approach most tools build on was published in 2020 by researchers at IIIT Hyderabad as Wav2Lip.

The key idea in Wav2Lip was to train the generator against a separate, pre-trained "lip-sync expert" that judges whether audio and mouth movement match, rather than letting a generic discriminator learn that alongside the generator. The result was the first speaker-independent model whose lip-sync scores matched real, correctly synced video.

Wav2Lip: a generator trained by a lip-sync judgeFace frames,lower half maskedNew audio clipGeneratordraws a new mouthLip-sync expertfrozen, pre-trainedVisual qualitycriticsync and realism scores train the generatorOnly the lower face is regenerated; eyes, head and background stay from the source.After Prajwal et al., ACM Multimedia 2020.
The judge is trained first and then frozen, so the generator cannot learn to fool it with blurry mouths. That is why clean, front-facing source footage matters so much.
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The WildK R Prajwal, Rudrabha Mukhopadhyay, Vinay P. Namboodiri, C V Jawahar · ACM Multimedia 2020 (IIIT Hyderabad)

The authors trained Wav2Lip on the LRS2 dataset and tested on LRW, LRS2 and LRS3. On LRS2, Wav2Lip scored a lip-sync error distance of 6.386 (lower is better) against 6.736 for real videos and 10.33 for the earlier LipGAN; its confidence score was 7.789 against 7.838 for real video. In human evaluations, its output was preferred over prior methods and unsynced originals more than 90% of the time. Limit: the authors note room for improvement when lip-syncing text-to-speech audio, which is exactly the case in most AI ads, and the model regenerates only a face crop at modest resolution.

Read the paper (free)
Lip-sync error distance on the LRS2 test set (lower is better)
See the data as a table
Lip-sync error distance
Speech2Vid14.23
LipGAN10.33
Real synced video6.736
Wav2Lip6.386

Source: Prajwal et al., ACM Multimedia 2020 (IIIT Hyderabad)

Method (LRS2 test set)Lip-sync error distance (lower is better)Lip-sync confidence (higher is better)
Speech2Vid14.231.587
LipGAN10.333.199
Wav2Lip6.3867.789
Real synced video6.7367.838
6.386Wav2Lip sync error (lower is better)
6.736real synced video, for comparison
7.789Wav2Lip confidence vs 7.838 for real video

For an advertiser, the limit matters more than the headline. Lip-sync is strongest on a front-facing face with clean audio; it degrades on side angles, fast speech and synthetic voices.

How good is AI voice in Indian languages?

AI voice in Indian languages has improved fast because of open datasets, but quality still varies by language, and pronunciation of names, brands and numbers needs checking every time. The largest open dataset effort so far is IndicVoices-R.

IndicVoices-R, a massive multilingual multi-speaker speech corpus for scaling Indian TTSAshwin Sankar et al. · NeurIPS 2024 Datasets and Benchmarks

The team built a text-to-speech corpus of 1,704 hours from 10,496 speakers across all 22 scheduled Indian languages, and a benchmark for how well models generalise to voices they have not heard. They report quality on par with standard TTS datasets such as LJSpeech and LibriTTS, show that models trained on earlier data generalise poorly to new Indian voices, and release what they describe as the first TTS model covering all 22 languages. Limit: corpus quality is not the same as ad quality; a model can be intelligible and still sound wrong for a brand.

Read the paper (free)
1,704 hof speech in IndicVoices-R
10,496speakers
22Indian languages covered

In practice, treat every Indian-language voice-over as a draft until a native speaker has heard it, and expect more fixes in languages with less training data.

Code-mixed Hinglish, the way most Indian ads actually speak, is the hardest case for both translation and voice, because models trained on clean single-language text don't know where an Indian speaker would switch.

What does AI video production save, according to Indian brands?

Indian brands have reported large time and cost savings, but the numbers come from the brands and their agencies, not independent audits. A July 2025 Storyboard18 report collected several.

  • Tata Gluco+: the agency behind the campaign said an AI workflow using Runway, Leonardo.ai and ElevenLabs cut campaign turnaround by over 70%.
  • Emami DermiCool: Emami's marketing lead said the AI-made "Warriors" film cost 15–20% of a comparable CG-heavy film, an 80–85% saving.
  • Cadbury Silk (Mondelez India): a Valentine's Day campaign turned consumer-submitted moments into over 500,000 unique animated videos.
  • Siyaram: its agency estimated savings of 30–40% and stressed that AI is not plug-and-play.
70%+faster: Tata Gluco+
15-20%of CG cost: Emami DermiCool
500,000+animated videos: Cadbury Silk
30-40%estimated saving: Siyaram

My own numbers point the same way: in my marketing work, AI workflows cut production cycle time by about 60%. The saving is real, but it moves the bottleneck to briefing, review and approvals. The story of the Cadbury "Not just a Cadbury ad" campaign shows the same point: the hard part was the idea and the permissions, not the rendering.

Cost per ad variant: shoot vs AI pipeline

Do AI video ads need a label?

On Meta, yes in many cases: ads created or significantly edited with Meta's own generative AI tools get an "AI info" label, and Meta has said it will also label ads made with third-party AI tools when industry-standard signals detect them. If the ad shows an AI-generated photorealistic person, the label sits next to "Sponsored" instead of inside the menu.

Meta's policy page dates from February 2025 and was updated in June 2026. Beyond platform rules, Indian advertising law still applies to whatever the ad claims, and a synthetic presenter making a testimonial-style claim is still a testimonial. The trust cost of getting this wrong is the subject of what AI slop ads cost a brand.

How should a small team set up an AI video workflow?

Start with one repeatable format, one tool per stage, and a review checklist, then add languages and variants once the first format holds up. The weekly AI ad creative pipeline post sets out the full cadence, and AI video ad tools ranked by price compares the tools.

  1. Lock the inputs. Real product photos from several angles, an approved claims sheet, a pronunciation list for brand and product names.
  2. Generate around the product, not the product. Let video models create scenes and motion; composite the real pack shot on top.
  3. Shoot a sync-ready master. If you use a founder or presenter, record a few clean, front-facing minutes for avatar and lip-sync work.
  4. Dub with a native reviewer. One reviewer per language checks meaning, tone and numbers before render.
  5. Label and log. Keep a record of which tools touched each ad, for platform labels and any later dispute.

This is how I build creative systems now: a small team, clear inputs, and AI doing the repetitive production. The work page has the longer story.

Questions people ask

Can you make a full TV-quality ad with AI alone?

Indian brands such as Emami have released largely AI-made films, but the published accounts still describe creative teams, agencies and editing behind them. For short social ads, AI can produce most of the footage; for hero brand films, it currently works best for specific shots, worlds that would be expensive to build, and language versions.

Do AI avatar ads perform worse than real people?

I could not find a reliable public benchmark, and the performance claims that exist come from the platforms and tool vendors themselves. Test an avatar version against a real-presenter version on the same script and audience before scaling either.

Which part of the pipeline fails most often?

The joins: dubbing that runs longer than the shot, lip-sync on synthetic audio (which the Wav2Lip authors flagged as the hardest case), and product details that drift between generated shots. Budget review time for these specifically.

Is it legal to clone a voice for ads in India?

Use only voices you have explicit, written permission to clone, for stated uses. Consumer-protection rules on endorsements apply to whatever a synthetic voice claims. Take legal advice for anything beyond your own team's voices.

Sources

  1. Prajwal et al.: A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild, ACM Multimedia (2020)
  2. Sankar et al.: IndicVoices-R, NeurIPS Datasets and Benchmarks (2024)
  3. Sacra: HeyGen revenue, valuation and funding (2026)
  4. TechCrunch: Synthesia hits $4B valuation (2026)
  5. PPC Land: Asset Studio gets Gemini Omni and one-click creative testing (2026)
  6. Engineering at Meta: Andromeda and generative AI ad creation figures (2024)
  7. Meta: Generative AI transparency in Meta's ads products (2025, updated 2026)
  8. Storyboard18: Campaign turnaround down 70%, production costs cut by 85% (2025)
  9. Marketing Dive: Toys R Us uses OpenAI's Sora for a brand film (Jun 2024, source for the story)
AI video adsgenerative videolip-syncvoice cloningdubbingVeoHeyGen
Sapta

Sapta (Saptarshi Sarkar) is a mechanical engineer turned marketer in Bengaluru and a solo touring rider. He writes the seven Saptaverse blogs. Work with him or read more of Marketblog.

Keep reading in Marketblog

From the other blogs