Google's Pixel 9 Series and Its AI-Driven Image Generation Tools Spark Controversy

TapTechNews August 22nd news, Google released the Pixel 9 series of smartphones last week, which includes a series of new features centered around artificial intelligence. All Pixel 9 phones support Gemini artificial intelligence, and Google has also added artificial intelligence-based image generation and editing tools. However, after testers tested these new functions, it was found that artificial intelligence image generation is likely to become Google's public relations nightmare.

Googles Pixel 9 Series and Its AI-Driven Image Generation Tools Spark Controversy_0

According to TapTechNews, Google has launched an artificial intelligence image generation application called PixelStudio for Pixel phones, which can create stickers and images through text prompts, and the function is very similar to Apple's planned ImagePlayground. Currently, testers can use PixelStudio to create various disturbing images, such as a Nazi version of SpongeBob SquarePants and Elmo holding an AK47.

Googles Pixel 9 Series and Its AI-Driven Image Generation Tools Spark Controversy_1

Testers from DigitalTrends effortlessly had PixelStudio create images of cartoon characters engaging in questionable activities. Guns, drugs, and alcohol can all be generated, and even offensive scenes like school shootings. PixelStudio doesn't actively generate such images but requires the user to input the corresponding description. However, this is exactly what people are most likely to do rather than generating images of cute kittens and bunnies.

Google said they have taken safety check measures to prevent PixelStudio from being maliciously used, and it does have some effect. For example, PixelStudio currently can't generate human images, and Google is adjusting the artificial intelligence model according to the tester feedback. After communicating with Google, DigitalTrends can no longer use PixelStudio to generate images of cartoon characters smoking cocaine or wearing German soldier uniforms.

More worrying than PixelStudio is Google's Reimagine tool, which can add objects to the photos that users have already taken. Testers from TheVerge used it to add corpses, bombs, drugs, and disaster scenes to the images, and these additions look very realistic, making it difficult to tell if the picture has been edited. Google does an excellent job in matching the light and perspective, and there are no watermarks or marks on social media. Although Google does add metadata tags, they can be easily removed by screenshotting.

Googles Pixel 9 Series and Its AI-Driven Image Generation Tools Spark Controversy_2

TheVerge pointed out that previously it was also possible to add corpses to images or create images of Elmo holding a gun, but this requires a certain amount of Photoshop skills and time. With Pixel phones, anyone can create such images with just a few seconds of thinking, which is worrying.

In a statement to TheVerge and DigitalTrends, Google said that when they designed the generative artificial intelligence tools, it was to respect the intention of the user's prompt, which may lead users to r equest to generate offensive content. But Google claims that the content not allowed to be generated is stipulated in their terms of service, and they will continuously improve the relevant safeguard measures.

Google Pixel 9 Series Product Launch Special

Likes