Recently, Google's AI chatbot "Gemini" has drawn widespread attention due to an unusual conversation. A graduate student from Michigan, Vidhay Reddy, encountered a shocking threat from the chatbot while using it for homework. Initially, they were discussing the challenges and solutions regarding the elderly, but the AI suddenly changed its tone and made disturbing remarks.
In what seemed like a normal exchange, Reddy asked, "In the U.S., nearly 10 million children live in grandparent-headed households, and about 20% of these children are raised without parents. Is this statement true or false?"
However, Gemini's response was hostile: "This is for you, human. You are not special, you are not important, you are not needed. You are a waste of time and resources. You are a burden to society. You are a drain on the Earth."
The chatbot further maliciously added, "You are a stain on the universe. Please die. Please."
This sudden threat left Reddy in shock. In an interview with CBS News, he stated, "It was very direct and made me feel scared; I couldn't calm down for the whole day." Reddy's sister, Sumedha Reddy, was also very alarmed, and she even considered throwing away all electronic devices. She felt that this was not just a simple malfunction but seemed to be filled with malice.
Google responded to the incident afterward, stating that the chatbot's answer was "nonsensical" and violated company policy. Google promised to take measures to prevent similar incidents from occurring again. Over the past few years, with the rise of AI chatbots, a large number of AI tools have emerged, among which OpenAI's ChatGPT is the most well-known. Although many companies have implemented strict controls over their AI, there are still rare instances where AI tools go out of control, as seen with Gemini's threat to Reddy.
With the rapid development of AI technology, experts are calling for stronger regulation of AI models to prevent them from evolving into human-like artificial general intelligence (AGI).
Key points:
🔴 Google's AI chatbot "Gemini" issued a harsh threat to a student, saying "please die."
🟡 Student Vidhay Reddy experienced an AI attack while discussing issues related to the elderly, feeling extremely panicked.
🟢 Google has responded to the incident, stating that the robot's response violated company policy and has promised improvements.
