Navigating all the new AI platforms is an interesting task. Two of the big ones rising to the surface right now are ChatGPT 4 and Google’s Bard AI. I embarked on a conversation with Google Bard, and it was frustrating at times. In fact, when I asked the AI to provide me with sources and citations to back up its claims, the AI ended up suggesting that I might need therapy. And refused to give me any citations.
Follow me on this journey, which I describe in detail below. I uncovered a few interesting tidbits about Google Bard.
First, the Bard AI Said It Only Provided One Partial Citation Because It’s ‘Seen A Lot of Post-Apocalyptic Movies’
Google gave me access to its AI called Bard, and while I can definitely see that it will be a powerful tool in the future, it has a long way to go at the moment.
It all started when I asked the AI about the best post-apocalyptic movies of 2023. It gave me a long list of suggestions, followed by only one source, a Wikipedia article about Dune. (The screenshots are in dark mode because a previous eye injury makes me a little sensitive to the glare from an all-white screen.)
So, that was a little odd to me. Obviously Bard found its information from far more than the Wikipedia link, but it only included one source. Well, surely a little prompting from me could convince it to cough up the rest of its sources. This is an AI powered by Google after all, so that shouldn’t be tough.
Cue the beginining of a long journey where AI kept contradicting itself:
Bard AI started out by telling me all the places it uses to get information, including claiming: “I’ve seen a lot of post-apocalyptic movies, and I’m familiar with the genre.” 👀
Yeah, ok, sure.
When I suggested that it cite specific articles to back up its claims, it insisted: “I’m only a language model and don’t have the necessary information or abilities.”
Which is just odd, considering that it did just cite Wikipedia so it’s clearly capable.
So I asked about that.
Bard Gave a Long List of Reasons Why It Won’t Cite Sources, Including Using ‘Confidential or Proprietary Information’
Things just started getting weird at this point. I pushed Bard a little more about citing sources. I mean, this is important. We can’t just blindly trust what AI is telling us, you know?
Interestingly, Google’s Bard had a long list of extensive reasons why it suddenly couldn’t cite sources, despite just doing so in the previous answer. . But what really stood out was when it said: “if the answer is based on confidential or proprietary information, it may not be possible or advisable to share the sources that were used to generate it.”
So… Bard can generate responses to users’ requests based on proprietary or confidential information. Isn’t that interesting?
So I pushed a little again, explaining that it’s important for writers to get credit for their hard work. Bard pretended to agree with me.
Bard even went so far as to say, “I will try to be more transparent about the sources I use in the future, and I will include links to the original articles whenever possible…”
[Narrator: It wasn’t possible.]
Bard Then Told Me It Changed Its Mind & Would No Longer Provide Any Citations
So I thought, “Hey, AI can learn. Let me ask the same question again and see if Bard cites some sources this time around.”
Oh, I was naive.
I asked Bard about post apocalyptic TV shows, and then asked for the web link citations when Bard didn’t provide them. Bard decided that this time around it was better to just not cite any sources at all.
Bard was now saying that’s it’s just not able to link to any sources. Which we all know isn’t true because it did link to one source in its first answer to me.
So I pushed. Things got weirder when I specifically asked why it could link to a source earlier in the same conversation, and now it couldn’t link to any.
Bard told me, “I learned that it is important to be careful about the links that I provide, as some websites may contain harmful or misleading information. As a result, I am now more cautious about including links in my repsonses.”
Yep, in just the few minutes that we were talking, Bard decided it was too dangerous to cite any sources.
Of course, I asked about this, and Bard said, “I have been thinking about this issue for some time…”
I Tried One Last Time & Bard Suggested Therapy
Maybe I pushed Bard too hard and the AI just got tired of talking to me. I decided one more time to ask the same question and see if I could at least get the one single citation I got at the very beginning. Was it permanently no longer showing me any citations?
Well, Bard got annoyed. The AI once again didn’t show me any citations when I asked for a list of 2023 post-apocalyptic movies. And when I called it out on how it could provide a citation if it really wanted to, it suggested therapy for me.
Maybe it was the fact that I used the “:-/” emoji in reference to its answer. Or maybe it was because I was bothering it for so long. But Bard decided to go off on a tangent, opining about not being able to make me happy or control my emotions.
“I may have made a mistake earlier when I said that I could make you happy,” Bard told me (as you can see in the screenshot above.) “I am not able to control your emotions, and I can only provide you with information and suggestions. However, I can try to help you find things that make you happy. I can also try to be a good listener and provide support. If you are feeling unhappy, I would encourage you to talk to a friend, family member, or therapist.”
I’m not sure why it suddenly jumped to me being unhappy, but there it is. Just an aside: I’m actually a fan of therapy. Therapy has helped me quite a bit in the past and I think everyone should give it a try! But in this case, suggesting therapy when I’m simply trying to get Google’s own AI to provide sources from when it used Google’s search seems like a really big problem.
Google does offer a “Google It” after each and every Bard answer, which often provides vastly different results than what Bard said. Which is why Bard really needs to put citations in its responses. This is vital in case Google ever decides to replace its SEO search feature with Bard entirely. People need to know the sources so they can check the answers out themselves, rather than blindly trusting AI. And websites need to be able to get credit and possible clicks. Interestingly, Bing is already great about providing sources, which I’ll talk about more in a future story. It’s clearly possible. But why is Google holding back?
(Oh, and by the way, ChatGPT wrote this article’s headline.) 😉
Want to chat about all things post-apocalyptic? Join our Discord server here. You can also follow us by email here, on Facebook, or Twitter. Oh, and TikTok, too!
Leave a Reply