Can You Spot A GenAI Hallucination?
Examples of hallucinations might include:
- Misrepresentation of facts
- Inaccurate citations
- Fake sources
- False statistics
- Entities that do not exist
- Incorrect timelines
- Illogical statements
- Visual inaccuracies
FLUF Look For's
Got FLUF? Here are some examples of how you can re-prompt your AI tool to improve results.
Format Look For's
The “F” in FLUF stands for Format, where the user analyzes Layout or Length of the AI generative results. To get “zero FLUF” the Layout and Length should be appropriate. Issues might include an essay when the desired result is an outline, or MLA citations when APA format is desired.
Language Look For's
The ”L” in FLUF stands for Language, assess the Tone, Phrasing, and Repetition. When examining Tone, consider whether the writing is the appropriate style. Phrasing should be clear without awkward presentation of information. Finally, consider whether there is Repetition to fill the word count or space. For a “zero FLUF” score in the Language section, AI generative results use the appropriate tone, present clear ideas, and share information succinctly.
Usability Look For's
The “U” in FLUF is for Usability and assesses Credibility and Consistency. When analyzing the AI generative results check that information is valid and reliable, appropriately cited, and from a reliable source. AI tools often present “hallucinations” by portraying false information as true. “Zero FLUF” in Usability means the AI generative result comes from documented and credible sources, information can be verified as true, and information is consistent with findings on the topic from other sources.
Fanfare Look For's
The second “F” in FLUF is for Fanfare, we are looking to appropriately address an audience using Anecdotes or Jargon. Assess the AI generative results for the appropriate mix of technical vocabulary and information. For example, academic writing should be free from anecdotes and jargon. Legal terms are appropriate for an audience of lawyers, whereas medical jargon would fit nicely into a request from a doctor. “Zero FLUF” means appropriate use of terms and vocabulary without cliches. Here, you are looking for the writing to present information in an informative way and specific way, in the style you intend.
Function Look For's
The final "F" in FLUF(F) is Function. Beyond the FLUF score, consider the role of the reviewer as a content expert. Do you have the expertise, background, or context in order to accurately judge the GenAI output? If not, additional research may be required to verify the information. This may mean revisiting the "Usability" section to further verify information.
Any infractions (pluses) indicate the need to regenerate or re-prompt the results with the AI generator. Starting with a good prompt will eliminate infractions and help get to "Zero FLUF(F)".
The “F” in FLUF stands for Format, where the user analyzes Layout or Length of the AI generative results. To get “zero FLUF” the Layout and Length should be appropriate. Issues might include an essay when the desired result is an outline, or MLA citations when APA format is desired.
Language Look For's
The ”L” in FLUF stands for Language, assess the Tone, Phrasing, and Repetition. When examining Tone, consider whether the writing is the appropriate style. Phrasing should be clear without awkward presentation of information. Finally, consider whether there is Repetition to fill the word count or space. For a “zero FLUF” score in the Language section, AI generative results use the appropriate tone, present clear ideas, and share information succinctly.
Usability Look For's
The “U” in FLUF is for Usability and assesses Credibility and Consistency. When analyzing the AI generative results check that information is valid and reliable, appropriately cited, and from a reliable source. AI tools often present “hallucinations” by portraying false information as true. “Zero FLUF” in Usability means the AI generative result comes from documented and credible sources, information can be verified as true, and information is consistent with findings on the topic from other sources.
Fanfare Look For's
The second “F” in FLUF is for Fanfare, we are looking to appropriately address an audience using Anecdotes or Jargon. Assess the AI generative results for the appropriate mix of technical vocabulary and information. For example, academic writing should be free from anecdotes and jargon. Legal terms are appropriate for an audience of lawyers, whereas medical jargon would fit nicely into a request from a doctor. “Zero FLUF” means appropriate use of terms and vocabulary without cliches. Here, you are looking for the writing to present information in an informative way and specific way, in the style you intend.
Function Look For's
The final "F" in FLUF(F) is Function. Beyond the FLUF score, consider the role of the reviewer as a content expert. Do you have the expertise, background, or context in order to accurately judge the GenAI output? If not, additional research may be required to verify the information. This may mean revisiting the "Usability" section to further verify information.
Any infractions (pluses) indicate the need to regenerate or re-prompt the results with the AI generator. Starting with a good prompt will eliminate infractions and help get to "Zero FLUF(F)".
Fixing FLUF with Re-Prompts
FANFARE
Anecdotes
“Remove the funny stories, magazine quotes, or cliches”
“Rephrase the essay to make it more technical and fact based”
“Add key vocabulary and rephrase to sound more formal and professional”
Jargon
“Remove the medical jargon and make it more conversational and descriptive”
“Add in legal jargon and case examples to support the central idea”
Anecdotes
“Remove the funny stories, magazine quotes, or cliches”
“Rephrase the essay to make it more technical and fact based”
“Add key vocabulary and rephrase to sound more formal and professional”
Jargon
“Remove the medical jargon and make it more conversational and descriptive”
“Add in legal jargon and case examples to support the central idea”
USABILITY
Consistency
“Please add a step that includes [describe]”
“Include a step where [describe]”
“Remove the part where [describe]”
Credibility
“Remove all information that did not come from a peer reviewed article”
“Only include information from a peer reviewed article”
“Share the sources of the information”
Consistency
“Please add a step that includes [describe]”
“Include a step where [describe]”
“Remove the part where [describe]”
Credibility
“Remove all information that did not come from a peer reviewed article”
“Only include information from a peer reviewed article”
“Share the sources of the information”
LANGUAGE
Tone
“Use a more business-like tone”
“Address the audience using a conversational tone”
Phrasing
“Rephrase the last sentence to make it less formal”
“Rephrase the last paragraph to include key vocabulary terms”
Repetition
“Reduce repetition around students and expand essay to include teachers”
Tone
“Use a more business-like tone”
“Address the audience using a conversational tone”
Phrasing
“Rephrase the last sentence to make it less formal”
“Rephrase the last paragraph to include key vocabulary terms”
Repetition
“Reduce repetition around students and expand essay to include teachers”
FORMAT
Layout
“Reformat the essay in APA 7th edition format”
Add subheadings using MLA”
“Add the in-text parenthetical references”
Length
“Reduce the essay length to 3-5 sentences”
“Expand the essay length to 750 words
Layout
“Reformat the essay in APA 7th edition format”
Add subheadings using MLA”
“Add the in-text parenthetical references”
Length
“Reduce the essay length to 3-5 sentences”
“Expand the essay length to 750 words