A high school educator uses an artificial intelligence tool to help create an assignment where students analyze a news article. To prepare for the assignment, the educator prompts the tool to summarize the news article. When reviewing the outcome, the educator notices that the summary included quotes that were not in the original article. What potential artificial intelligence limitation does this scenario describe?

Hallucination occurs when an AI tool generates information that is inaccurate, unsupported, or not present in the source material. Fabricated quotes are a clear example because the output appears plausible but cannot be verified in the original text. In Google Generative AI for Educators, this limitation requires careful review before using AI-generated content. Human oversight is necessary to check accuracy, source alignment, and classroom suitability.