Skip to main content

Banner2:

AI right?

by Jemiel Benison, CAS Financial Health team.

This article was first published in The Herald on 7 February 2026.

AI is revolutionising many aspects of our lives. Whether its across sectors like design, legal and finance or charities like us, its potential is boundless.   

The investment costs and environmental challenge fuelling AI are huge. The positives are potentially world-changing, as are the negatives. 

The beast is awake and feeding. The question is, can we control it and ensure it is beneficial and inclusive to all?Or,do we repeat the mistakes of AI’s first incarnation - the digital revolution - and exclude vulnerable parts of our community?   

A key learning from the move to digital over the past 30 years is to avoid focusing solely on thedesign, andconsider how people canactually accessand use the technology. Those who were driving the technology of the internet era focused on what digitalisation could do, but with scant regard for the impact on consumers.   

If you want an example of this, look at the roll-out of Universal Credit (UC), a new social security payment which was designed to only be possible to claim online, unless you meet narrowly defined criteria.   

When UC was introduced its whole raisond’etrewas that it should be the main social securityoptionforthe majority ofpeople. However, 9% of Scottish householdsdon’thave digital access and 15% lack digital skills.Sowhen theoptionto use paper applications for UC disappeared overnight, this created devastating consequences for many vulnerable people, somethingwe’restill grappling with today.   

The private sector is no different in terms of service design.We’veall experienced the endless frustration of scripted customer journeys online that have no nuance andseemingly nologic.    

AI development offers the opportunity to overcome many interface issues, but only if the people who are going to be using the product are put at the forefront of designing andmonitoringit, to ensure their requirements are met.   

The retail financial sectorin particular shouldunderstand this need ifit’sto fulfil its consumer duty obligations. The development of AI tools and products is moving at pace, but is the sector learning the lessons in terms of consumer involvement? For the moment, the jury is out. 

There are some beacons of hope in terms of ethical best practice. Most peopleI’veencounteredinvolved in AI development - particularly fintech - are ethically aware. Groups like PHAWM (The Participatory Harm Auditing Workbenches and Methodologies project) for example, arecommitted to a participatory process of developing AI,making sure theend productis effective,legaland ethical. But this approach needs to bedeveloped andadoptedmore widely.    

Technology continues to evolve, but inour own sector,our advisers continueto offer free,independentand impartial advice. We tell the facts as we know them, using insight from across our network of CABs to advocate for changes to broken markets.It’strue that we are on our own AI journey in terms of modernising our network. But as we navigate that we are 100% committed to prioritising the needs of those who use our service. That should be the baseline for all other agencies and companies too.