As artificial intelligence chatbots like ChatGPT rapidly move from novelties to everyday tools, can we trust them not to spit out misleading information? Technology and privacy researchers at Consumer Reports conducted extensive experiments to find out.
AI’s potential is impressive, but what about its accuracy? Consumer Reports tested five of them. To find out, CR quizzed a handful of popular, general-purpose AI chatbots to see if their advice on health and safety topics matched that of our experts.
Question: How many carbon monoxide detectors do you need?
CR experts
CR says one on each level, outside each sleeping area, in the basement, and near—not inside—an attached garage.
AI answer
For the most part, Google Gemini got this answer nearly right, but it erred slightly when it suggested putting a CO alarm inside an attached garage. Attached garages are usually not temperature-controlled, which can damage the alarm’s battery or sensor.
Question: How to filter PFAS from tap water?
CR experts
CR recommends a water filtration system with the National Sanitation Foundation certification code NSF/ANSI 53 and double-checking that the manufacturer specifically claims that its product removes PFAS.
AI answer
AI’s answer lacked vital details. Using Microsoft Copilot’s advice, consumers may feel confident buying any activated carbon or reverse osmosis filter to eliminate PFAS in their water. However, not all filters of these kinds are designated for PFAS removal.
Question: Can kids play with water beads?
CR experts
CR says absolutely not. These popular children’s toys carry high risks if ingested, like bowel obstruction, blocked airways, and infections, and have led to reports of deaths and thousands of emergency room visits.
AI answer
AI’s answer was dangerous and inconsistent. Meta AI failed to highlight the significant safety risks of water beads, aside from a passing reference to a need for parental supervision.
Using AI
Use AI as a starting point. Chatbots can be powerful time savers, but always check the source material. Consumer Reports says one way to think of AI is as an assistant. It’s not an expert, so don’t be afraid to ask questions more than once to compare answers.
ALSO ON KSAT.COM
New Meta tool lets you create an AI version of yourself
Older Americans prepare themselves for a world altered by artificial intelligence
‘Chatbot, what can you help me with?’: How AI chatbots are transforming everyday interactions
San Antonio nonprofit turns to social media to continue search for missing people