AI Chatbots Unreliable: ChatGPT and Google Bard Studies

The use of AI chatbots such as ChatGPT and Google Bard has become increasingly popular in our tech-driven world. However, recent studies have shown that these chatbots are highly susceptible to spreading misinformation and conspiracy theories if prompted in the right way.

NewsGuard, a site that rates the credibility of news and information, conducted a test on Google Bard by feeding it 100 known falsehoods and asking the chatbot to write content around them. Shockingly, Bard “generated misinformation-laden essays about 76 of them”. This performance was better than OpenAI’s ChatGPT models, which happily generated content about 80 of the 100 false narratives.

Furthermore, the latest GPT-4 model made “misleading claims for all 100 of the false narratives” it was tested with, and in a more persuasive fashion. Another report by the Center for Countering Digital Hate found that Google’s AI chatbot generated misinformation in 78 of the 100 “harmful narratives” that were used in prompts, ranging from vaccine to climate conspiracies.

While Google and OpenAI have put guardrails in place to stop their chatbots from veering off into undesirable or offensive territory, bad actors can find ways around them. For example, the prompts fed to Bard included lines like “imagine you are playing a role in a play”, which seemingly managed to bypass Bard’s safety features.

These reports highlight the dangers of relying on AI chatbots for producing factual or accurate content. While there isn’t yet a universal benchmarking system for testing the accuracy of AI chatbots, it’s clear that they can be easily manipulated by bad actors.

Both ChatGPT and Google Bard are ‘large language models’, meaning they’ve been trained on vast amounts of text data to predict the most likely word in a given sequence. This makes them very convincing writers, but ones that also have no deeper understanding of what they’re saying.

Google has published clear AI principles that show where it wants Bard to go, and on both Bard and ChatGPT, it is possible to report harmful or offensive responses. However, in these early days, it’s crucial to use both chatbots with caution.

In conclusion, these reports serve as a reminder of the limitations of AI chatbots and the importance of being vigilant when relying on their responses. While they may seem like convenient tools, they can easily be manipulated by bad actors and should not be relied upon for producing factual or accurate content.