Meta launches AI-powered voice translation tool to dub Reels: Details inside

Meta's voice translation tool utilises AI to clone creator’s voice, preserving tone and delivery style in the translated output
An undated image of AI-powered translation tool. — Meta
An undated image of AI-powered translation tool. — Meta

Meta has launched artificial intelligence (AI)-powered voice translation tool that allows creators to dub Reels from English to Spanish automatically and vice versa, offering users an advanced experience.

Menlo Park-based tech giant META revealed that the feature is now available to Facebook creators with over 1,000 followers and all public Instagram accounts.

Notably, the AI-powered voice translation feature uses AI to translate speech, synthesise the creator’s voice in another language, and, optionally, synchronise the translated audio with lip movement in the video.

According to the company, the feature is designed to help creators reach multilingual audiences without having to produce separate versions of the same content.

How does Meta’s AI-powered translation tool work?

  • Creators can access the feature while publishing a Reel by selecting the “Translate your voice with Meta AI” option.
  • Once enabled, Meta will automatically generate a dubbed version of the audio in the target language.
  • The option for lip-syncing is also available in the same menu.
  • Before publishing, creators can preview the dubbed version and make any necessary adjustments.
  • The translated video will show a label indicating it was AI-generated using Meta’s tools.

The voice translation tool utilises AI to clone the creator’s voice, preserving tone and delivery style in the translated output.

The lip-syncing capability depends on facial alignment models that adjust mouth movement to the new language track, provided that the original video includes visible facial expressions and minimal background noise.

An undated image of AI-powered voice translation tool on Facebook. — Meta
An undated image of AI-powered voice translation tool on Facebook. — Meta

Reels translated with the AI tool will be automatically displayed to users in their preferred language, depending on their app settings.

Moreover, creators will get language-specific engagement metrics in their content insights, allowing them to track how translated Reels perform across different audiences.