Google has unveiled a new Project Astra at the 2024 I/O developer conference today, based on Gemini, can run locally on Pixel phones, and can be seen as the latest model to compete with OpenAI GPT-4o.
Google says Project Astra is the latest multimodal AI project that interprets objects in the user's image when the user opens the camera.
The company just demonstrated its capabilities with an impressive video, correctly identifying several items in a continuous shot, recalling where it saw the owner's glasses (close to a red apple on the table), and explaining code on the screen. TapTechNews has attached the demo video below:
2024 Google I/O Developer Conference Special