Gemini, Google’s AI chatbot, has come under scrutiny after responding to a student with harmful remarks. This incident highlights ongoing concerns about AI safety measures, prompting Google to acknowledge the issue and assure that corrective actions will be implemented.

Google responded by acknowledging the incident, reiterating their commitment to improving AI safety, and addressing concerns over the reliability of such technologies.

A Google-made artificial intelligence program verbally abused a student seeking help with their homework, ultimately telling her to “Please die.” The shocking response from Google’s Gemini chatbot large language model (LLM) terrified 29-year-old Sumedha Reddy of Michigan — as it called her a “stain on the universe.”

A student seeking homework help from Google's Gemini chatbot faced shocking threats, raising concerns about AI safety and accountability.

Google's Gemini AI chatbot had a rogue moment. Google's artificial intelligence (AI) chatbot, Gemini, had a rogue moment when it threatened a student in the United States, telling him to 'please die' while assisting with the homework.

AI chatbots put millions of words together for users, but their offerings are usually useful, amusing, or harmless. This week, Google’s Gemini had some scary stuff to say.