{"id":25536,"date":"2026-06-23T16:14:36","date_gmt":"2026-06-23T10:44:36","guid":{"rendered":"https:\/\/banitoday.com\/why-ai-sounds-certain-even-when-its-wrong-and-why-we-believe-it-india-news\/"},"modified":"2026-06-23T16:14:36","modified_gmt":"2026-06-23T10:44:36","slug":"why-ai-sounds-certain-even-when-its-wrong-and-why-we-believe-it-india-news","status":"publish","type":"post","link":"https:\/\/banitoday.com\/hi\/why-ai-sounds-certain-even-when-its-wrong-and-why-we-believe-it-india-news\/","title":{"rendered":"Why AI sounds certain even when it\u2019s wrong and why we believe it | India News"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div>\n<div class=\"e9jwa\">\n<div class=\"vdo_embedd\">\n<div class=\"GfdvZ\">\n<section class=\"_bIDB  clearfix id-r-component leadmedia undefined undefined  E9tg9 \" style=\"top:0px\">\n<div class=\"_bIDB\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">\n<div class=\"ypVvZ\">\n<div class=\"WGttI\"><img src=\"https:\/\/static.toiimg.com\/thumb\/msid-131932481,imgsize-1669149,width-400,height-225,resizemode-4\/131932481.jpg\" alt=\"Why AI sounds certain even when it\u2019s wrong and why we believe it\" title=\"(Representative Image)\" decoding=\"async\" fetchpriority=\"high\"\/><\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div><\/div>\n<\/div>\n<p>Hallucinations have recently been used to refer to a typical behavioral pattern that Generative Artificial Intelligence (AI) models exhibit.<span class=\"id-r-component br\" data-pos=\"1\"\/>AI hallucinations occur when a model generates a completely fabricated response. <!-- -->The plausible yet false answers have no ground in reality, or training data.<span class=\"id-r-component br\" data-pos=\"5\"\/>The most peculiar aspect of these hallucinations is the tone: the response, though misleading and invented, sounds completely confident. These responses show no shred of uncertainty, which often makes users inclined to believe the misinformation.<span class=\"id-r-component br\" data-pos=\"8\"\/>From recommending users put glue on their pizza to making up summer reading lists of books that do not exist (which made its way to a newspaper! ), AI hallucinations have been the subject of internet virality innumerable times over the past few years.<span class=\"id-r-component br\" data-pos=\"12\"\/>This strange phenomenon warrants dissection.<span class=\"id-r-component br\" data-pos=\"14\"\/><\/p>\n<div data-pos=\"0\" class=\"id-r-component iIpbx undefined  &#10;        \">\n<div><img decoding=\"async\" alt=\"WHAT ARE AI HALLUCINATIONS\" msid=\"131933961\" width=\"\" title=\"WHAT ARE AI HALLUCINATIONS\" placeholdersrc=\"https:\/\/static.toiimg.com\/photo\/83033472.cms\" imgsize=\"\" resizemode=\"4\" offsetvertical=\"0\" placeholdermsid=\"47529300\" type=\"thumb\" class=\"\" src=\"https:\/\/static.toiimg.com\/photo\/msid-131933961\/what-are-ai-hallucinations.jpg\" data-api-prerender=\"true\"\/><\/p>\n<p>WHAT ARE AI HALLUCINATIONS<\/p>\n<\/div>\n<\/div>\n<p><span class=\"id-r-component br\" data-pos=\"16\"\/><span class=\"strong\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">Why AI models hallucinate<\/span><span class=\"id-r-component br\" data-pos=\"18\"\/>Language models hallucinate because standard training and evaluation procedures reward guessing over acknowledging uncertainty, suggests a research paper published by scholars at OpenAI titled: <span class=\"em\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">\u2018Why language models hallucinate.\u2019<\/span><span class=\"id-r-component br\" data-pos=\"21\"\/>The paper explains it with an analogy: the multiple-choice question. A wild guess on an unknown question might be correct if luck is on one\u2019s side. Leaving it blank on the other hand? That guarantees a zero. Large Language Models (LLMS) are graded similarly, based on accuracy and the percentage of questions they get right.<span class=\"id-r-component br\" data-pos=\"25\"\/>This current evaluation method sets the wrong incentive, one that encourages guessing rather than an honest expression of uncertainty.<span class=\"id-r-component br\" data-pos=\"27\"\/>Furthermore, language models respond to prompts by predicting one word at a time. It is simply a question of probability and patterns. <!-- -->Mistakes are inevitable in such a process.<span class=\"id-r-component br\" data-pos=\"31\"\/><\/p>\n<div data-pos=\"0\" class=\"id-r-component iIpbx undefined  &#10;        \">\n<div><img decoding=\"async\" alt=\"WHY AI MODELS HALLUCINATE\" msid=\"131934015\" width=\"\" title=\"WHY AI MODELS HALLUCINATE\" placeholdersrc=\"https:\/\/static.toiimg.com\/photo\/83033472.cms\" imgsize=\"\" resizemode=\"4\" offsetvertical=\"0\" placeholdermsid=\"47529300\" type=\"thumb\" class=\"\" src=\"https:\/\/static.toiimg.com\/photo\/msid-131934015\/why-ai-models-hallucinate.jpg\" data-api-prerender=\"true\"\/><\/p>\n<p>WHY AI MODELS HALLUCINATE<\/p>\n<\/div>\n<\/div>\n<p><span class=\"id-r-component br\" data-pos=\"33\"\/><span class=\"strong\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">Worrisome patterns<\/span><span class=\"id-r-component br\" data-pos=\"35\"\/>In October 2024, Associated Press published an investigation on the usage of OpenAI\u2019s transcription tool Whisper in hospitals. It said that despite being pushed as having \u201chuman level robustness and accuracy,\u201d Whisper was often prone to making up chunks of text and even entire sentences that were never said in the first place.<span class=\"id-r-component br\" data-pos=\"37\"\/>Despite OpenAI\u2019s warning about not using Whisper in \u201chigh-risk domains,\u201d it was found to be used to transcribe doctor-patient consultations anyway, as it enabled medical providers to save time on report writing and note taking.<span class=\"id-r-component br\" data-pos=\"40\"\/>\u201cThose experts (more than a dozen software engineers, developers and academic researchers) said some of the invented text \u2014 known in the industry as hallucinations \u2014 can include racial commentary, violent rhetoric and even imagined medical treatments,\u201d stated the report.<span class=\"id-r-component br\" data-pos=\"42\"\/>The issue with AI-powered transcriptions is not just fabrication, but also bias. In the words of American linguist Mary Bucholtz, \u201cAll transcripts take sides, enabling certain interpretations, advancing particular interests, favoring specific speakers.\u201d<span class=\"id-r-component br\" data-pos=\"45\"\/>In May 2026, the accounting firm Ernst &amp; Young (EY) retracted a report flagged for citation errors, fake footnotes and statistics suspected to be hallucinated by AI. EY Canada\u2019s cybersecurity report on loyalty program safeguards had referred to studies that simply did not exist, revealed an investigation by GPTZero, an AI-detection startup.<span class=\"id-r-component br\" data-pos=\"47\"\/>The report titled \u2018Chasing the hallucinations\u2019 suggested how contradicting references, low-quality sources and out-of-date statistics are all AI indicators<span class=\"em\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">.<\/span> The report ended with a warning: \u201cFake information poisons the well and misleads future researchers, especially when published by a major consulting firm. Claude, ChatGPT, Perplexity all surface hallucinations from EY\u2019s flawed report.\u201d<span class=\"id-r-component br\" data-pos=\"52\"\/><\/p>\n<div data-pos=\"0\" class=\"id-r-component iIpbx undefined  &#10;        \">\n<div><img decoding=\"async\" alt=\"WHEN AI FAKES ITS SOURCES\" msid=\"131934080\" width=\"\" title=\"WHEN AI FAKES ITS SOURCES\" placeholdersrc=\"https:\/\/static.toiimg.com\/photo\/83033472.cms\" imgsize=\"\" resizemode=\"4\" offsetvertical=\"0\" placeholdermsid=\"47529300\" type=\"thumb\" class=\"\" src=\"https:\/\/static.toiimg.com\/photo\/msid-131934080\/when-ai-fakes-its-sources.jpg\" data-api-prerender=\"true\"\/><\/p>\n<p>WHEN AI FAKES ITS SOURCES<\/p>\n<\/div>\n<\/div>\n<p><span class=\"strong\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">How AI hallucinations affect academics, researchers<\/span><span class=\"id-r-component br\" data-pos=\"55\"\/>\u201cOn a number of occasions when I asked for references of books or <a href=\"https:\/\/timesofindia.indiatimes.com\/topic\/supreme-court\" styleobj=\"[object Object]\" class=\"\" commonstate=\"[object Object]\" frmappuse=\"1\">Supreme Court<\/a> cases, AI hallucinated and confidently provided incorrect citations which initially appeared accurate. <!-- -->But when I started checking from original sources, I found them inaccurate,\u201d said Prof (Dr) Anand Pradhan of Indian Institute of Mass Communication. \u201cA few times, it also confused the explanations of particular theories with the work of other scholars.\u201d<span class=\"id-r-component br\" data-pos=\"61\"\/>Researchers at GPTZero coined the term \u2018vibe citing\u2019 to refer to how generative AI models create citations or academic references that appear to be credible but are either misattributions or complete fabrications.<span class=\"id-r-component br\" data-pos=\"64\"\/>They have classified this phenomenon into three distinct patterns, where human errors are exempt:<span class=\"id-r-component br\" data-pos=\"66\"\/><\/p>\n<div class=\"cdatainfo   id-r-component \" data-pos=\"67\">\n<ol>\n<li>Entirely fabricated citations (fake authors, title or container\/locators)<\/li>\n<li>Two or more real references fused or misaligned (authors of one paper paired with the title of another)<\/li>\n<li>Real citations, heavily altered or paraphrased<\/li>\n<\/ol>\n<\/div>\n<p>Hallucinated citations not only call the integrity of the concerned work into question but also serve as a threat to the future of academia and research as a whole.<span class=\"id-r-component br\" data-pos=\"69\"\/>A Master\u2019s student speaks of persistent unease caused by the unreliability of AI-generated academic responses. \u201cGemini links the websites from which it generates its summaries. <!-- -->However, there have been so many times when I\u2019ve tried to access the link but it ended up not being open source so I couldn\u2019t fact-check. Other times, I see the website saying something completely different,\u201d said Ushasi Chowdhury, who is pursuing a Master\u2019s degree in English literature at Loreto College, Kolkata.<span class=\"id-r-component br\" data-pos=\"73\"\/>Ushasi said that whenever a concept in literature or philosophy needs to be referenced, a simple <a href=\"https:\/\/gadgetsnow.indiatimes.com\/brands\/Google\" styleobj=\"[object Object]\" class=\"\" commonstate=\"[object Object]\" target=\"\" frmappuse=\"1\">Google<\/a> search helps find websites for a quick and comprehensive understanding. <!-- -->Now that Google provides an AI-generated overview, sometimes it is convenient to read it from there, especially when there is a rush.<span class=\"id-r-component br\" data-pos=\"79\"\/>\u201cConstantly referring to 5 different books is a tedious process, sometimes I end up just going by what the Google AI-summary says,\u201d said the literature student. \u201cIt cannot be a blind trust but I am presented with an illusion of reassurance during circumstances where I don\u2019t have time to look through a lot of sources.\u201d<span class=\"id-r-component br\" data-pos=\"82\"\/>Dr Pradhan said that AI seems to be gradually improving accuracy. Even so, it is not yet 100% accurate and its responses still need to be verified, especially in journalism, academic and research contexts, warns the professor.<span class=\"id-r-component br\" data-pos=\"84\"\/><\/p>\n<div data-pos=\"0\" class=\"id-r-component iIpbx undefined  &#10;        \">\n<div><img decoding=\"async\" alt=\"HOW TO PROTECT YOURSELF\" msid=\"131934041\" width=\"\" title=\"HOW TO PROTECT YOURSELF\" placeholdersrc=\"https:\/\/static.toiimg.com\/photo\/83033472.cms\" imgsize=\"\" resizemode=\"4\" offsetvertical=\"0\" placeholdermsid=\"47529300\" type=\"thumb\" class=\"\" src=\"https:\/\/static.toiimg.com\/photo\/msid-131934041\/how-to-protect-yourself.jpg\" data-api-prerender=\"true\"\/><\/p>\n<p>HOW TO PROTECT YOURSELF<\/p>\n<\/div>\n<\/div>\n<p><span class=\"id-r-component br\" data-pos=\"86\"\/><span class=\"strong\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">Questioning and verification in the age of AI<\/span><span class=\"id-r-component br\" data-pos=\"88\"\/>It is established that any and all Artificial Intelligence models will sometimes confidently state falsehoods. At the same time, regarding convenience and haste, AI is invincible and cannot be done away with, says a growing consensus.<span class=\"id-r-component br\" data-pos=\"91\"\/>Tools of media literacy prove useful in this predicament.<span class=\"id-r-component br\" data-pos=\"93\"\/>What can help one mitigate the inaccuracy and misinformation is simply a process of vigorous, thorough fact-checking and verification. Not to trust any response given by an AI model blindly, no matter how plausible it sounds or how authoritatively the information it expressed\u2014even, and especially, if it supports one\u2019s preexisting notions.<\/div>\n<p><br \/>\n<br \/><a href=\"https:\/\/timesofindia.indiatimes.com\/india\/why-ai-sounds-certain-even-when-its-wrong-and-why-we-believe-it\/articleshow\/131932481.cms\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hallucinations have recently been used to refer to a typical behavioral pattern that Generative Artificial Intelligence (AI) models exhibit.AI hallucinations occur when a model generates a completely fabricated response. The plausible yet false answers have no ground in reality, or training data.The most peculiar aspect of these hallucinations is the tone: the response, though misleading [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":25537,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[133],"tags":[],"class_list":["post-25536","post","type-post","status-publish","format-standard","has-post-thumbnail","category-country"],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/banitoday.com\/hi\/wp-json\/wp\/v2\/posts\/25536","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/banitoday.com\/hi\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/banitoday.com\/hi\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/banitoday.com\/hi\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/banitoday.com\/hi\/wp-json\/wp\/v2\/comments?post=25536"}],"version-history":[{"count":0,"href":"https:\/\/banitoday.com\/hi\/wp-json\/wp\/v2\/posts\/25536\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/banitoday.com\/hi\/wp-json\/wp\/v2\/media\/25537"}],"wp:attachment":[{"href":"https:\/\/banitoday.com\/hi\/wp-json\/wp\/v2\/media?parent=25536"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/banitoday.com\/hi\/wp-json\/wp\/v2\/categories?post=25536"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/banitoday.com\/hi\/wp-json\/wp\/v2\/tags?post=25536"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}