Google’s Next Major AI Model Arrives to Combat New Offerings from OpenAI
On Wednesday, Google announced Gemini 2.0 Flash, a major update to its AI model that can natively generate images and audio in addition to text. This new feature is designed to combat the growing number of offerings from OpenAI, including their popular language model, GPT-4.
What’s New in Gemini 2.0 Flash?
Gemini 2.0 Flash is a significant upgrade over its predecessor, Gemini 1.5 Flash, which could only generate text and was not designed for demanding workloads. The new model can interact with third-party apps and services, allowing it to tap into Google Search, execute code, and more.
Native Image and Audio Generation
One of the most notable features of Gemini 2.0 Flash is its ability to natively generate images and audio in addition to text. This means that developers can use the model to create a wide range of multimedia content, from simple graphics to complex videos.
According to Google, the model can also ingest photos and videos, as well as audio recordings, to answer questions about them. For example, the model can be asked to describe what is happening in an image or video, or to summarize the main points of a conversation.
Audio Generation: A Key Feature
The other key feature of Gemini 2.0 Flash is its ability to generate high-quality audio. The model can narrate text using one of eight voices optimized for different accents and languages. This means that developers can use the model to create custom audio content, such as voice-overs or podcasts.
Multimodal API
To help developers build apps with real-time audio and video streaming functionality, Google is releasing an API called the Multimodal Live API. Using this API, developers can create real-time, multimodal apps that incorporate tools for tasks such as image and video analysis.
The Multimodal Live API supports natural conversation patterns, including interruptions, making it easier to build more interactive and user-friendly interfaces.
SynthID Technology: A Solution to Deepfakes
To address concerns about deepfakes, Google is using its SynthID technology to watermark all audio and images generated by Gemini 2.0 Flash. This means that the model’s outputs will be flagged as synthetic on software and platforms that support SynthID.
This is a major step towards preventing abuse of AI-generated content, which has become a growing concern in recent years.
Availability
An experimental release of Gemini 2.0 Flash will be available through the Gemini API and Google’s AI developer platforms, AI Studio and Vertex AI, starting today. However, the audio and image generation capabilities are launching only for "early access partners" ahead of a wide rollout in January.
In the coming months, Google says that it’ll make the model more widely available to developers, with plans to integrate it into various Google products and services.
Impact on the Industry
The release of Gemini 2.0 Flash is likely to have a significant impact on the AI industry, as it offers a range of new features and capabilities that will be attractive to developers and businesses alike.
With its ability to generate high-quality images and audio, the model is poised to revolutionize industries such as entertainment, education, and marketing.
