Found a trick to stop AI chatbots from making up fake citations

I kept catching my AI tool inventing research papers until I started asking it to show me the exact quote from each source, and that cut the hallucinations by like 80%. Has anyone else found a better way to verify AI outputs without spending hours fact checking?

2 comments

2 Comments

luna_sanchez2d agoMost Upvoted

...asking for exact quotes actually worked? Because I tried that and the bot just made up fake quotes too. It cited something from a 2022 study on dopamine and attention spans, but when I searched for the exact sentence, it didn't exist anywhere. I started cross-checking every single quote now and it takes forever but at least I'm not getting caught out.

the_reese2d ago

Has anyone tried asking the bot to explain its sources step by step? Like, instead of asking for a quote, ask it to describe the study's methodology first, then the sample size, then the exact finding. I found that when you make it walk through the reasoning, it either gets super specific (which makes it easier to spot made-up numbers) or it flat out admits it can't remember details. Another trick that worked for me was asking for the quote in a different format, like "give me that sentence in parentheses with the page number after it." It seems like the bot has trouble faking page numbers and formatting at the same time. The fake quotes usually lose their grammatical structure when you add those extra requirements.