- Google’s update to Gemini 1.5 Pro gives the model an ear.
- The model can now listen to uploaded audio files and generate information from content such as earnings calls or video audio without having to refer to a written transcript.
- Google is also making Gemini 1.5 Pro available as a public preview to those with access to Vertex AI
Capable of processing text, code, video, and now uploaded audio streams, including audio from video, Gemini 1.5 Pro can listen, analyse and extract information without a corresponding written record.
Gemini 1.5 Pro
Gemini is Google’s rebranded bot, previously called Bard, and Gemini 1.5 Pro is the latest iteration of the model made available to a limited number of developers in February of this year.
Google also announced it’ll make Gemini 1.5 Pro available to the public for the first time through its platform to build AI applications, Vertex AI. Gemini 1.5 Pro was first announced in February.
Google shared details of the update at its Cloud Next conference in Las Vegas. After calling Gemini Ultra LLM, which powers its Gemini advanced chatbot, the most powerful model in the Gemini family, Google is now calling Gemini 1.5 Pro its most powerful generative model.
The company adds that this version has better learning capabilities and requires no additional tweaking of the model.
Gemini 1.5 Pro is not available to users who do not have access to Vertex AI.
Also read: OpenAI voice-clone tool mimics your voice with 15-second sample
Text-to-image generation model Imagen 2
Gemini 1.5 Pro isn’t the only large AI model to get an update from Google.
Imagen 2 is a text-to-image generation model that will help enhance Gemini’s image generation capabilities, and will also add fixes and repairs that will allow users to add or remove elements from an image.
Many of the new features of Imagen, especially in painting and outpainting, have been part of other text-to-image models like Stability AI’s Stable Cascade and Getty’s Generative AI by iStock, not to mention wider consumer availability on newer Samsung Galaxy phones.
