Google announces new features for Android, including “AI automatically generates image descriptions” and “displays point cards and membership cards on smart watches”

https://blog.google/products/android/new-android-features-february-2024/

There are 9 new features added.

1: Long text summary & reply candidate suggestion by Android Auto
Using your smartphone while driving is prohibited, but you can at least read your emails using voice commands. However, if the email is long, it can be difficult to concentrate on driving and listen to the content.

Android Auto improves this by using AI to summarize long texts and suggest possible replies. Sharing itineraries and making phone calls will also become easier.

2: You can listen to explanations automatically generated by AI about photos and images.
Since 2018, Google has been offering Lookout, an app that provides information about the surroundings to visually impaired people.

Google announces “Lookout,” an app that acts as the “eyes” of visually impaired people and accurately conveys information about their surroundings – GIGAZINE

A new feature added to Lookout is the ability to listen to AI-generated descriptions of visuals embedded in photos, images, and messages. This feature is designed for the visually impaired community and will be rolled out globally in English.

3: Enhanced screen reader with Google Lens in Google Maps
“Google Lens” is a service that allows you to search for information about images you have taken. From October 2023, it will be possible to link with Google Maps, and when you launch Google Lens from the icon added to the Google Maps menu and take a picture of your surroundings with your smartphone camera, information on major spots will be displayed. It became.

This update enhances the Google Lens screen reader, allowing you to identify nearby public transit stations, restaurants, ATMs, etc. based on photos you take, and check business hours and reputation using TalkBack. It is now possible. You can also read out information such as directions.

4: Add handwritten annotations to Google Docs
You can now add handwritten annotations to Google Docs using your finger or stylus. When annotating, you can choose from a variety of markup tools, including colored pens and highlighters.

5: Spotify Connect can now be selected as the output destination in Spotify’s quick settings
When listening to music on Spotify, you can now select Spotify Connect as the output destination. Just like YouTube Music, you can now easily switch the music output to speakers, earphones, smart TV, etc.

6: See your health, wellness, and fitness data in one place
Health information collected from your favorite wearable devices and apps all trails , Oura Ring and my fitness pal Now visible in the “Me” tab in the Fitbit app.

7: Access your tickets and membership cards directly from your smartwatch
Smartwatches equipped with Wear OS now support Google Wallet Pass, which can read user cards and membership cards and use them as digital passes, allowing you to immediately display the necessary passes on your smartwatch. You can also hide unnecessary paths.

8: Display route guidance on smart watch
Google Maps in Wear OS now supports public transportation route guidance display, so you can now check the route to your destination, transfer times, etc. just on your smartwatch without having to take out your smartphone.

9: You can now chat directly with Gemini using Google Messages
You can communicate using the messaging app “Google Messages”