Pitfall of Black Box AI at Banks: Explaining Your Models to Regulators
The use cases of artificial intelligence (AI) and machine learning in front-office, middle-office and back-office activities at banks are growing slowly but steadily. The major areas of AI play include customer service (virtual assistants, chatbots, etc.), fraud detection, risk management, predictive analytics, and automation. Like in any other industries, AI, if implemented the right product in the right manner, can increase the efficiency of banking operations as well as reduce their cost (up to more than USD 1 trillion by 2030, according to experts). Of course, there are problems related to distinct data sets and data privacy that curtail the implementation of these technologies. However, AI would turn into a new normal at banks as existing workflows are set to become unsustainable due to the ever-increasing scale of operations. These days, most banks are operating round the clock due to the emergence of online banking and mobile banking. Along with that, the financial inclusion initiatives across the globe would see a gigantic rise in the volume of banking operations. Therefore, banks would require rapid processing abilities to stay relevant and ensure the satisfaction of various stakeholders including customers and regulators.
Though the field is somewhat set for AI at banks with the advent of mobile technology, data availability and abundance of open-source APIs, there are certain systemic problems that banks are concerned about. Banks are worried if their regulators would accept the use of technologies, which are relatively new and different from the existing ones to a great extent. There are also risks related to possible biases in machine learning algorithms due to data quality and data accuracy. Black box AI algorithms are another concern that can hinder the adoption of AI in banking. Here, we are trying to explain the concept of black box AI, its problems and how banks can overcome the challenge.
What is black box AI?
Black box AI is a problem in machine learning where even the designers of an algorithm cannot explain why and how it arrived at a specific decision. The fundamental problem here is: if we cannot figure out how AI has come up with its decisions, how can we trust AI? This trust issue led to the failure of IBM Watson (especially (Watson for Oncology), one of the best-known AI innovations in recent times. The main problem with a black box model is its inability to identify possible biases in the machine learning algorithms. Biases can come through prejudices of designers and faulty training data, and these biases lead to unfair and wrong decisions. Bias can also happen when model developers do not implement the proper business context to come up with legitimate outputs.
The same problem is relevant in the banking industry as well. If regulators pose a question: how AI has reached at a conclusion with regard to a banking problem, banks should be able to explain the same. For example, if an AI solution dealing with anti-money laundering compliance comes up with an anomalous behaviour or suspicious activity in a transaction, the bank using the solution should be able to explain the reason why the solution has arrived at that decision. Such an audit is not possible with a black box AI model. The same concern was expressed by Federal Reserve Gov. Lael Brainard in a November 2018 speech. “AI can introduce additional complexity because many AI tools and models develop analysis, arrive at conclusions, or recommend decisions that may be hard to explain. For instance, some AI approaches are able to identify patterns that were previously unidentified and are intuitively quite hard to grasp. Depending on what algorithms are used, it is possible that no one, including the algorithm’s creators, can easily explain why the model generated the results that it did,” she said.
Not just AI, Banks need explainable AI
Explainable AI or interpretable AI or transparent AI deals with techniques in artificial intelligence which can make machine learning algorithms trustworthy and easily understandable by humans. Explainability has emerged as a critical requirement for AI in many cases and has become a new research area in AI. As mentioned by the Defense Advanced Research Projects Agency under the US Department of Defense: “New machine-learning systems will have the ability to explain their rationale, characterize their strengths and weaknesses, and convey an understanding of how they will behave in the future.”
In the banking industry, which is subject to stricter regulatory oversight across the globe, an incorrect decision can cost billions of dollars for an institution. If a bank wants to employ AI, it is imperative for it to subject the particular solution to rigorous, dynamic model risk management and validation. The bank must ensure that the proposed AI solution has the required transparency depending on the use case. As an AI solutions provider, Tookitaki has always considered explainability as a must-have feature in its offerings. Its unique technology demystifies modern machine learning and gives clients the knowledge and tools to outperform the competition. Tookitaki solutions feature a ‘Glass box’ audit module that brings algorithmic transparency by providing thorough explanations for predictions.
There is no doubt that AI can bring in revolutionary changes in the banking sector. For that to happen, it is mandatory that banks should take the necessary oversight to prevent their AI models from being a black box. As of now, the AI use cases are mostly in low-risk banking environments, where human beings still take the final decision with machines just providing valuable assistance in decision making. In future, banks will be under pressure to remove some of the human oversight for cost savings amid increasing scale of operations. At that point, banks cannot run with risky black box models that can lead to inefficiencies and risks. They need to ensure that their AI solutions are trustworthy and have the required transparency to satisfy internal and external audits. In short, the bright future of AI in banking could be assured only through explainable AI.
Leave a Comment
The Crackdown on Shell Companies and the Role of Technology
The Anti-Money Laundering Act (AMLA) 2020, enacted as part of the National Defense Authorization Act (NDAA) 2021 of the US in January this year, had many key provisions to take the Anti-Money Laundering/Countering the Financing of Terrorism (AML/CFT)...
Tookitaki Powers AI-Driven Anti-Money Laundering Solution Using HPE GreenLake
Hewlett Packard Enterprise (HPE) announced a key collaboration with Tookitaki to provide a new offering designed for banks and financial institutions across Asia-Pacific. The new offering delivers Tookitaki’s artificial intelligence (AI) powered ...
AMLA 2020: 8 Key Provisions that Financial Institutions Required to Know
The US Congress passed the National Defense Authorization Act (NDAA) 2021 on January 1, 2021, addressing a variety of pressing concerns related to the nation’s security. The act included a number of reforms related to the country’s response to an...
The Rising Case for RegTech to Address AML Risks Amid COVID-19
Emerged as a subset of FinTech, the Regulatory Technology (RegTech) industry has now gone more mainstream, thanks to regulators and industry practitioners. Recently, there have been many pro-RegTech communique and reports, highlighting that the COVID...
Hakrinbank Selects Tookitaki to Ensure Sustainable Financial Compliance Monitoring
Tookitaki announced a partnership with Hakrinbank, a leading South American bank based in Suriname, to fortify its Anti-Money Laundering (AML) detection and alerts management capabilities. To improve its legacy system and augment its ability to bett...
Breaking Barriers: 5 Key Insights on RegTech Adoption
HKMA in a report shared comprehensive hands-on experience and insights from respondents to better understand the factors and dependencies affecting AML/CFT Regtech adoption. The regulator collaborated with 10 mature RegTech adopters to build out a co...
How to Address Present-day Sanctions Screening Pain Points with AI
Sanctions risk of financial institutions is evolving in line with the global social, economic and political changes. As seen in recent news, governments across the globe are increasingly relying on sanctions as an important measure for political fore...
Tookitaki Got Selected for FinTech Program: Asia meets Tokyo
Tookitaki has been listed among 8 Fintech startups in Asia for FinTech Program: Asia meets Tokyo, an accelerator launched by the Tokyo Metropolitan Government (TMG). We have been selected for our anti-money laundering (AML) solution having a unique m...
AML Alert Management: How AI can Augment Your Compliance Efficiency
The financial sector is facing one monster of a problem at the moment. As today’s financial institutions deal with millions of daily transactions, several thousands of routine financial transactions are being flagged every month, leading to many un...
Tookitaki Recognised for Innovative Use of AI & Machine Learning
Tookitaki has won the Regtech Award for AI & Machine Learning and was highly commended in the solutions category for AML/CTF Compliance, in the 3rd Regulation Asia Awards for Excellence 2020 in an online ceremony on 15 December 2020. Tookita...
Money Laundering via Cryptocurrencies: All You Need to Know
Technological advancements have given criminals faster and safer options to wash their ill-gotten money. There is no doubt that cryptocurrencies are very useful technology innovation that helps individuals and institutions access financial products a...
CNA 938 radio interviews Tookitaki Co-founder Jeeta Badopadhyay
Tookitaki Co-founder and COO Jeeta Bandopadhyay was named among the Singapore 100 Women in Tech (SG100WIT) List in September 2020. A collaboration between the Singapore Computer Society (SCS), IMDA, SG Women in Tech and Mediacorp, the inaugural SG100...
Need for New Customer Risk Rating Models: Not All Customers Are Created Equal
Being estimated at between US$800 billion to US$2 trillion every year, money laundering is a serious problem for the global economy. While regulators and financial institutions are working hard to prevent and reduce the crime, launderers are becoming...
Is AML Compliance Heading for a New Normal in the Age of Digital Payments?
Increased digitization has influenced various businesses and brought in a paradigm shift in the way they create business models and approach growth opportunities. Moving away from conventional transaction modes such as cash and checks, banks and FIs ...
Excel to AI: How Reconciliation Tools Evolve for Better
In the world of finance, reconciliation is the process of comparing two related sets of records or two accounts at the end of a specific accounting period to find out if account balances are matching in both records. Periodic reconciliation of accoun...
Lessons Not Well Learned: 2020 AML Fines Cross 2019 Total
If research is to be believed, institutions across the globe have not done enough in the anti-money laundering (AML) compliance area. Data from consultancy Duff & Phelps revealed that AML fines in the first six months of 2020 reached US$706 milli...
Exploring AML Risks in COVID-Era and the Ways to Address Them
The world continues to battle the COVID-19 pandemic and the crisis it brought in is unprecedented in the history of humankind. While there are a number of pandemic-related factors contributing to the expected crisis with financial services, financial...
AML Amid COVID-19: Watch out for These FBI-listed Fraud Schemes
There has been a rise in the number of cybercrimes and fraud schemes across the globe ever since the proliferation of the COVID-19 pandemic. Criminals, in general, are taking advantage of people’s scare, helplessness, and the need for immediate fin...
OCC Spring Risk Perspective: 5 Takeaways on Compliance Risk
Despite its general strength, the US federal banking system is apparently susceptible to the ongoing economic weakness caused by the rampant spread of coronavirus. Earlier this month, The US Office of the Comptroller of the Currency (OCC) published i...
How Criminals Used COVID-19 Sales Pitch to Defraud, Launder Money
As the world is working hard to contain the spread of the COVID-19, criminals continue to take advantage of the pandemic. They are devising sophisticated methods to defraud people and launder the criminal proceeds using the financial system. The late...
5 Top Myths and Facts about AI Implementation in AML Programs
We are more confirmed about the power of Artificial Intelligence (AI) to transform lives and businesses now. There are countless possible applications of AI and machine learning at present, and we see and hear exciting ways how these modern technolog...
Typology Repository Management: Solving AML Problems Via Collective Intelligence and Continuous Learning
Despite its general strength, the US federal banking system is apparently susceptible to the ongoing economic weakness caused by the rampant spread of coronavirus. Earlier this month, The US Office of the Comptroller of the Currency (OCC) published i...
Money Laundering Amid COVID-19: What Regulators Across Globe Say
As the world continues to fight against the COVID-19 pandemic, there are reports that criminals are taking advantage of the difficult situation. They are seizing the moment to proliferate their criminal activities, earn undue profits and transfer of ...
How will Art Cease to Be a Preferred Money Laundering Vehicle?
Money laundering via high-end art and antiquities is not new yet it is difficult to detect. Art-related money laundering amounts to about US$3 billion per year, according to this blog, quoting the United Nations Office on Drugs and Crime. Criminals o...
Beware! Money Mules in Demand amid COVID-19. Here’s an Effective Cure
If reports are to be believed, cybercrooks are taking advantage of the COVID-19 situation. They are targeting people who were laid off or working from home due to the pandemic to work for them as money mules. For those who are new to the term, money ...
Roundtable Rewind: Embracing Next-gen Tech & Collaboration Key to Sustainability
As a regtech player with a vision to enable sustainable compliance programs in financial institutions, Tookitaki organized a first-of-its-kind industry roundtable in Charlotte, NC, USA to discuss opportunities to innovate current AML programs and mee...
Tookitaki Appoints Industry Veteran Joe Friscia as Advisor
Tookitaki Holding Pte. Ltd. appointed industry veteran Joe Friscia, former President of NICE Actimize and BAE Systems as Advisor to the Company’s Advisory Board. Joe brings over 25 years’ extensive experience in the financial crime and enterpris...
Tookitaki Raises Another US$11.7 million in Series A; Closes Round at US$19.2 million
– by Abhishek Chatterjee, Founder & CEO The Tookitaki team and I are excited to announce that we have raised an additional US$11.7 million in Series A funding, taking the total investment in the round to US$19.2 million. The current round w...
30 Years of FATF: Notable Facts About Global AML Watchdog
The Financial Action Task Force (FATF), the intergovernmental body formed in 1989 to combating money laundering, is celebrating its 30th anniversary this year. Since its inception, the global agency played a key role in identifying and preventing the...
Tookitaki Joins Aite Financial Crime Forum as Sponsor
Technological advances have fundamentally changed the operational landscape of financial institutions. However, there are also new risks emerging in forms of sophisticated financial frauds and complex money laundering patterns. These risks can signif...
Will Machine Learning Replace Compliance Professionals?
The impact of modern technologies such as artificial intelligence (AI) and machine learning on job security has been a widely discussed topic today. Of course, AI has advanced very quickly in the last few years and evolved to outperform humans in a n...
6 Most Prevalent Cyber-Laundering Methods in APAC
Despite being a medium to exchange information in real-time and with scale, the Internet is being misused in several ways. Among the slew of financial crimes facilitated by the Internet, money laundering draws importance due to its gigantic size and ...
ABA Regulatory Compliance Conference: 10 Sessions You Can’t Miss
The 2019 edition of the American Bankers Association (ABA) Regulatory Compliance Conference is a few more days away. Organized by the Washington, D.C.-based trade association, the conference is touted as the “one-stop shop to discuss today’s—an...
Tookitaki AMLS Wins SBR Technology Excellence Award 2019
Tookitaki’s Anti-Money Laundering Suite (AMLS), an end-to-end machine learning-powered transaction monitoring and names screening solution, has bagged the inaugural Singapore Business Review Technology Excellence Award 2019 in the category R...
Watchdogs Grow Optimistic about AI Prospects at Banks
Proper regulation of banking operations is important as any failure in the banking system would affect the wider economy. Therefore, banking is one of the most regulated industries across the globe. Financial regulators ensure that services to the cu...
Pitfall of Black Box AI at Banks: Explaining Your Models to Regulators
The use cases of artificial intelligence (AI) and machine learning in front-office, middle-office and back-office activities at banks are growing slowly but steadily. The major areas of AI play include customer service (virtual assistants, chatbots, ...
AI for Regulatory Compliance at Banks: 4 Assessments Before You Okay the Solution Proposal
Banking is one of the industries where artificial intelligence and machine learning find their applications at a rapid pace. Regulatory compliance within banking is an area which has become a costly and inefficient affair due to complex and never-sta...
We Believe in Innovation, the Key to Survival and Growth
“Innovation distinguishes between a leader and a follower.” -Steve Jobs What comes on the top of your screen when you google the meaning of the word innovation is – the introduction of something new and relevant such as a new idea, method o...
Compliance Functions in Need of a Technological Overhaul. Can Machine Learning be the Game-Changer?
McKinsey in its latest compliance benchmarking survey found that compliance function at financial institutions has reached “an inflection point” and current compliance standards are in an “inchoate state”. The firm has suggested five critical...
Tookitaki Raises US$7.5 mn Series A from Global VCs to Transform Regulatory Compliance
Tookitaki, a regulatory technology company that aims to enable financial institutions to develop sustainable compliance programs, has raised US$7.5 million in Series A round. The round was co-led by London-based Illuminate Financial, an early-stage e...
From Wachovia to Danske Bank: Biggest Money Laundering Cases in Recent Times
Money laundering – the criminal activity of processing criminal proceeds to disguise their origin – is one of the gravest problems faced by the global economy, and its size is growing rapidly. It is estimated that 2- 5% of the global GDP, or US$8...
A Modern Approach to Address the Reconciliation Challenges of Financial Services
Reconciliation of transactions is deemed critical for the smooth running of every financial institution. The speed and accuracy of data reconciliation can distinguish a successful institution from its counterparts. The process is primarily used to id...
Busting a Myth: Compliance Officer’s Job is All About Risk
Regulatory compliance has become a dreadful task for banks after regulators across the globe set stricter norms in the aftermath of the 2008 financial crisis in an effort to prevent financial crimes such as money laundering. Rules have been changed t...
SocGen Goes Next-Gen with Tookitaki Reconciliation Suite
Société Générale leveraged Tookitaki’s Reconciliation Suite to automate the bank’s existing break reconciliation system. Key Challenges Addressed The bank’s finance department was unable to handle new breaks unless code is updated. Current ...
Attending ACAMS Conference in Singapore? Tookitaki Awaits You with Its Disruptive AML Solution
“In today’s era of volatility, there is no other way but to re-invent. The only sustainable advantage you can have over others is agility, that’s it.”- Jeff Bezos Singapore is hosting ACAMS’ 11th Annual AML & Financial Crime Conference ...
MAS’ Stress on Transaction Monitoring for Effective AML/CFT Compliance and Machine Learning is the Answer
Singapore is known for its top-notch AML/CFT regime created through up-to-date legislation, stringent policy and uncompromising supervision to safeguard against the abuse of the city state’s financial system for criminal activities. The country’s...
Mifid II and the Pressing Need for a New Reconciliation Approach
The financial services industry in the EU has been confused with the introduction of a revamped version of the Markets in Financial Instruments Directive (Mifid II). The ambitious regulatory reforms that took almost seven years to be materialized wer...
Is Automated Reconciliation Next to Impossible in Today’s Complex Financial World?
The 2008 global financial crisis and fairly new regulatory requirements like Basel III asked financial institutions (FIs) to cut operating costs and adopt a lean operations structure, pushing FIs to rethink on current reconciliation measures. Most of...
Modern Tech to Reshape US AML Compliance with Regulators’ Recent Handshake
George Bernard Shaw once said: “Those who cannot change their minds cannot change anything.” The past week has seen a significant change of mind from financial regulators in the US in their ardent attempt to combat and prevent financial crimes, e...
Skills Development: We Have Talents and We Strive to Multiply Them
“Mastery lies on an infinite continuum, and as a result, we will never reach the end. We can, however, see to it that we are as far along that continuum as our circumstance allows.” ― Chris Matakas Having continuous learning as one of its core...
It’s Our Fourth Founding Day; Taking a Pause to Cherish Our Simple but Awesome Journey
Today, as we step into our 4th year of foundation, I feel proud and honored to be leading Tookitaki that has been successful in creating added value to all its stakeholders. I was never a CEO and Tookitaki is my first company. I had the passion and d...
Tookitaki Expands into the US with New Office in Charlotte
SINGAPORE, Sept. 24, 2018: Tookitaki Holding Pte Ltd, a leading regulatory technology company, is pleased to announce the official opening of its North American office in Charlotte, NC, in the United States. This new location will serve as the comp...
5 Methods That Modern Money Launderers Use To Beat Detection
Society prepares the crime, the criminal commits it. DID YOU KNOW? Every year, an estimated amount in the range of US$800 billion-US$2 trillion (2-5% of global GDP) is being laundered globally Regulators across the globe imposed US$1.7 billion in fin...
Risk Management Conference: Positive Vibes from All Corners
The Risk Management Association’s (RMA) premier annual event, the Risk Management Conference, came to an end on 6 November, and Tookitaki had the privilege to attend the event which we believe was a success in a number of ways. As a modern-era tec...
Singapore Fintech Festival: Tookitaki to showcase advanced machine learning solutions in financial services
Singapore is assured of the Fintech world’s unwavering attention next week, as the city state, is hosting this year’s Fintech Festival during 12-16 November. Touted as the world’s largest platform for the global FinTech community, the event att...
The RMA Clarion Call to Address Risks and the Tookitaki Way
Risk officers, doing your best today is good while preparing hard for tomorrow is extraordinary. Risk management at banks has become difficult due to operational and regulatory changes. The Risk Management Association’s (RMA) premier annual event, ...
Typology Repository Management: Solving AML Problems Via Collective Intelligence and Continuous Learning
Despite its general strength, the US federal banking system is apparently susceptible to the ongoing economic weakness caused by the rampant spread of coronavirus. Earlier this month, The US Office of...
MAS’ Stress on Transaction Monitoring for Effective AML/CFT Compliance and Machine Learning is the Answer
Singapore is known for its top-notch AML/CFT regime created through up-to-date legislation, stringent policy and uncompromising supervision to safeguard against the abuse of the city state’s financi...
Singapore Fintech Festival: Tookitaki to showcase advanced machine learning solutions in financial services
Singapore is assured of the Fintech world’s unwavering attention next week, as the city state, is hosting this year’s Fintech Festival during 12-16 November. Touted as the world’s largest platfo...