Intelligent CIO Middle East Issue 115 | Page 25

TRENDING

HOW FAR WILL YOU TRUST THE AI BLACK BOX?

Trust may be fundamental to our economies, but that does not mean we should automatically trust something just because it is the only way to get our pet project off the ground. It is not just acceptable but mission-critical to demand that AI earns our trust and that we leave the training wheels and report cards in place even after it has done so, explains Joe Dunleavy at Endava.

In business, as in life, it is trust that holds everything together, investment, deals, recruitment. Customers must trust cloud service providers because if they do not, they would second guess every technology decision made. A manager must trust an employee because if they do not, they would have to micromanage every task and would have no time for strategic thinking.

In these two examples, we see the outcomes of trust clearly. In the former, the cloud customer dares to innovate; in the latter, the manager does the same. The fundamentals are covered, so no need to worry.
But behind every trust relationship are processes. It is precisely because the cloud provider and the employee follow these processes faithfully that they inspire trust. As you read this, across the GCC hundreds if not thousands of AI systems are embedded in enterprises’ day-to-day operations.
According to McKinsey research from 2023, in the regional retail sector alone, 75 % of companies have adopted AI to augment at least one business function. One can only assume AI is trusted by these companies.
AI black box
But what is the origin of this trust? AI algorithms are famously non-deterministic. It is, in most cases, difficult if not impossible to trace output back to a branching
Joe Dunleavy, Global SVP and Head of AI Pod, Endava
www. intelligentcio. com INTELLIGENTCIO MIDDLE EAST 25