
Google Translate is getting a big update that includes new AI capabilities, like a new Live Translate mode and easier language practice features.
The Live Translate tool allows conversations in real time with verbal and on-screen translations. After the user selects the languages they want to converse in, out of 70 languages like Arabic, French, Hindi, Korean, Spanish, and Tamil, the user will be able to speak back and forth as if the people were conversing in their native language.
Google notes that its system now is using advanced Gemini AI models, with improved translation quality, TTS quality, and improved multimodal translation.
This new upgrade applies not just to word-for-word translations. Machine learning is used to scan for accents, intonations, and pauses in conversation.
New speech recognition models will also allow the use of the feature in noisy environments! Live Translate is rolling out now to Google Translate on both Android and iOS in the US, Mexico, and India.
With Live Translate, Google is also rolling out a language learning mode. The user can practise a conversation by either selecting a goal or selecting a predefined suggestion like "Everyday interactions" or "Travel and transportation". The tool features different levels of language tasks from basic to advanced, and the user has the option to listen to or speak prompts with hints if help is needed.
The app also tracks your progress, giving you personalised sessions to build real-world communication skills.
Currently, this language practice feature is in beta and free for English speakers learning Spanish and French and for Spanish, French, and Portuguese speakers learning English.