Google’s commitment to artificial intelligence (AI) took center stage during its recent Google I/O 2024 developer conference. With over 120 mentions of “AI” in the keynote, Google made it clear that AI is at the forefront of its innovation. Let’s dive into the most significant AI announcements from the event:

1. Generative AI in Search

At the Google I/O 2024, Google aims to revolutionize search results using generative AI. Imagine search pages that provide AI-generated summaries of reviews, discussions from platforms like Reddit, and personalized suggestions based on your query. This innovation promises to enhance the way we find information online.

2. Project Astra and Gemini Live

Gemini, Google’s AI-powered chatbot, is getting smarter. With Gemini Live, users can engage in voice chats, interrupting the chatbot to ask questions. Gemini adapts to speech patterns in real time and even understands users’ surroundings through smartphone photos or videos. Later this year, Gemini Live will identify objects within view, such as neighborhood landmarks or broken bicycle parts.

3. Google Veo

Challenging OpenAI’s Sora, Google introduces Veo—an AI model that generates 1080p video clips based on text prompts. Veo captures various visual styles, including landscapes and time lapses, while maintaining realism. Its understanding of camera movements and physics contributes to impressive video editing capabilities.

4. Ask Photos

Google Photos gets an AI boost with Ask Photos. This experimental feature allows users to search their photo collections using natural language queries. Leveraging Gemini’s understanding of content and metadata, Ask Photos streamlines photo discovery.

5. Gemini in Gmail

Gmail users will soon benefit from Gemini’s capabilities. Search, summarization, and drafting emails will become more efficient. Additionally, Gemini will assist with complex tasks like processing returns.

6. Detecting Scams During Calls

Google previews an AI-powered feature to identify potential scams during phone calls. By using Gemini Nano (the smallest version of Google’s generative AI), Android devices will listen for common conversation patterns and alert users.

7. AI for Accessibility

Google enhances TalkBack, an accessibility feature for Android users. Leveraging Gemini Nano, TalkBack will provide aural descriptions of objects for low-vision and blind users. For instance, it might describe clothing: “A close-up of a black and white gingham dress with a collar, long sleeves, and a big bow tied at the waist.”

At the Google I/O 2024 developer conference, Google recognizes the importance of AI in improving accessibility and user experiences, and these announcements demonstrate their commitment to pushing the boundaries of what AI can achieve.