ChatGPT and other AI bots made huge errors before Scottish election, study finds

The Electoral Commission has called for new legal controls over misinformation from AI chatbots, after a thinktank found they had made serious mistakes during the recent Scottish election. The thinktank Demos said its investigation had found that AI services gave voters misinformation to 34% of the questions it posed, which it said raised worrying questions about the lack of regulation of AI platforms in the UK. It ran a simulation before May’s Holyrood election by putting 75 questions to five free AI tools including ChatGPT , Google Gemini and Replika about three real-life constituencies to see how accurate and evidence-based their responses were. In its report, Electoral Hallucinations , Demos said those AI tools variously invented fictitious scandals, gave the wrong date for the election, claimed wrongly that voters in Scottish elections needed ID at polling stations and placed candidates in the wrong contests. An opinion poll of 2,005 British adults it commissioned alongside that study found that 20% of voters had used AI chatbots or search tools to get information about the parliamentary elections in Scotland and Wales, and for English local councils, equivalent to 10 million people UK-wide. Vijay Rangarajan, the Electoral Commission’s chief executive, has been pressing ministers to introduce legislation to make AI companies more accountable, after discovering half of voters in 2024’s general election had seen misleading information. …