You ask an AI tool for sources and get a tidy list of references. Then the links lead to error pages, the paper can't be found, or the real article says something different. Sometimes there are no sources at all. This guide shows how to check any citation quickly, what to do when it fails, and how to set up your questions so the sources are easier to trust. If AI-generated summaries are also unreliable, see how to improve inaccurate AI meeting notes and summaries.
Why AI citations go wrong
AI chat tools generate text that looks right based on patterns. A reference has a familiar shape (author, title, journal, year, link), so a tool can produce one that looks convincing without it existing. Even tools that search the web can attach a real link to a claim the page doesn't actually make, or cite a page they couldn't read in full, such as one behind a paywall. Treat every citation as a lead to check, not as proof.
How to verify a citation
- Open the link. A broken page, or one about a different topic, is a clear warning sign. A working link isn't enough on its own, so keep reading.
- Check that the source says what the AI claims. Find the passage that supports the statement. This is the step most people skip, and it catches real sources attached to claims they don't support.
- Search for the title. Put the exact title in quotation marks in a search engine or in Google Scholar. If you also have an author and year, check that they match. A paper with no trace anywhere is probably invented.
- Check the DOI, if there is one. A genuine DOI should lead to the paper's publisher page. If it leads nowhere or to a different paper, the reference is unreliable.
- Verify numbers at the primary source. If the AI cites a statistic from an organization, go to that organization's own website and find the figure there, not a summary of it.
- Be careful with quote searches. Searching a quoted sentence can show that it's fabricated, but AI tools often paraphrase. No result doesn't prove a source is fake, and finding the sentence doesn't prove the source supports the AI's claim. Check the claim itself.
How to fix wrong or missing citations
Replace fake sources yourself
If the claim sounds plausible but the citation is fake, don't ask the AI to "fix" it. It may simply produce another convincing reference. Search for the claim yourself using Google Scholar, a library database, or the official website of the organization involved, and cite what you find.
Give the AI the source material
The most reliable setup is to paste in or upload the document you want it to work from, then ask it to answer only from that text and to point to the passage it used. You can then check each answer against a source you already hold. Features and file limits differ between tools, so check what yours supports.
Use search features, and still check
If your tool has a web search or browsing option, turn it on and ask for links to pages you can open. This improves the chance of real sources, but it doesn't remove the need to read them.
Change how you ask
Be specific, and tell the tool what to do when it isn't sure. For example:
- "Answer only if you can point to a source I can open. Otherwise say you don't know."
- "Separate what you're confident about from what you're guessing."
- "Give a short answer first, then the sources."
These prompts reduce unsupported answers but can't guarantee accuracy, so keep checking.
When the AI keeps insisting a fake source is real
Do not keep asking the same tool to repair a citation if it repeatedly returns broken or unverifiable references. Instead, take the factual claim out of the answer, search for it independently, and find a primary source that confirms it. A confident apology or a replacement link is not proof that the new citation is genuine.
When a research-focused tool may help
If you regularly need academic references, a research tool that searches scholarly databases can make it easier to locate papers and inspect their details. Still verify the title, authors, publication information, and the passage supporting the claim. A tool designed for research can reduce the work, but it cannot guarantee that every citation or summary is correct.
Spotting other unreliable answers
Invented citations are one form of a wider problem: confident answers that aren't true. Signs to watch for include:
- Very specific numbers, dates, or names with no source you can open.
- Absolute wording ("studies prove...") on a topic that's debated.
- Answers that change when you ask the same question in a slightly different way.
- Recent events or recent product changes, which a tool may not know about unless it searches the web.
Asking a second tool can reveal disagreements worth investigating, but agreement isn't proof, since tools can make the same mistake.
When not to rely on AI for sources
- Medical or health questions. Check claims against official health organizations or the published research, and talk to a qualified professional.
- Legal research. AI tools have produced made-up court cases, and lawyers have been sanctioned for submitting them. Use official court records or a legal database.
- Financial or safety-critical information. Go to the primary documentation.
What to do next
Use AI to understand a topic or draft an outline, but verify every source before it goes into your work. Open the link, find the supporting passage, and confirm the details elsewhere. When a citation fails, replace it with one you've found and read yourself.