Technology
AI 'hallucinations' can lead to catastrophic mistakes, but a new approach makes automated decisions more reliable
Scientists have developed a new, multi-stage method to ensure artificial intelligence (AI) systems that are designed to identify anomalies make fewer mistakes and produce explainable and easy-to-understand recommendations.
Recent advances have made AI a valuable tool to help human operators detect and address issues affecting critical infrastructure such as power stations, gas pipelines and dams. But despite showing plenty of potential, models may generate inaccurate or vague results — known as "hallucinations."
Hallucinations are common in large language models (LLMs) like ChatGPT and Google Gemini. They stem from low-quality or biased training data and user prompts that lack additional context, according to Google Cloud.
Some algorithms also exclude humans from the decision-making process — the user enters a prompt, and the AI does the rest, without explaining how it made a prediction. When applying this Technology to a serious area like critical infrastructure, a major concern is whether AI’s lack of accountability and trust could result in human operators making the wrong decisions.
Some anomaly detection systems have previously been constrained by so-called "black box" AI algorithms, for example. These are characterized by opaque decision-making processes that generate recommendations difficult for humans to understand. This makes it hard for plant operators to determine, for example, the algorithm’s rationale for identifying an anomaly.
A multi-stage approach
To increase AI's reliability and minimize problems such as hallucinations, researchers have proposed four measures, outlining their proposals in a paper published July 1 at the CPSS '24 conference. In the study, they focused on AI used for critical national infrastructure (CNI), such as water treatment.
First, the scientists deploy two anomaly detection systems, known as Empirical Cumulative Distribution-based Outlier Detection (ECOD) and Deep Support Vector Data Description (DeepSVDD), to identify a range of attack scenarios in datasets taken from the Secure Water Treatment (SWaT). This system is used for water treatment system research and training.
-
Technology8h ago
California’s Draft AI Law Would Protect More Than Just People
-
Technology8h ago
What’s Working: How a Colorado program is linking quantum, space and tech companies to a future workforce
-
Technology21h ago
Rocket experts build robots to observe ice melting beneath Antarctica
-
Technology21h ago
DR Congo to receive mpox vaccines within days, says WHO chief
-
Technology1d ago
Meta reveals Llama AI models are being adopted by banks and tech companies
-
Technology1d ago
Elon Musk's X unveils new video conferencing feature
-
Technology1d ago
Deepfake featuring Virat Kohli's remarks on Shubman Gill takes the internet by storm
-
Technology1d ago
2 solar probes are helping researchers understand what phenomenon powers the solar wind