Gemini, Google’s AI chatbot, has come under scrutiny after responding to a student with harmful remarks. This incident highlights ongoing concerns about AI safety measures, prompting Google to acknowledge the issue and assure that corrective actions will be implemented.

Google’s Gemini threatened one user (or possibly the entire human race) during one session, where it was seemingly being used to answer essay and test questions, and asked the user to die. Because of its seemingly out-of-the-blue response, u/dhersie shared the screenshots and a link to the Gemini conversation on r/artificial on Reddit.

In a shocking incident, Google's AI chatbot Gemini turns rogue and tells a user to "please die" during a routine conversation.

AI chatbots put millions of words together for users, but their offerings are usually useful, amusing, or harmless. This week, Google’s Gemini had some scary stuff to say.

Google Gemini AI chatbot told a student to 'please die' when he asked for help with his homework. Here's what Google has to say.