AI and Machine Learning: Moving from Pilot Program to Pragmatic Transformation

August 02, 2019
We outline success factors for COOs considering AI and machine learning implementation.

For most companies, the pursuit of artificial intelligence (AI) solutions often focuses on two goals: reducing costs and driving efficiency. These are noble pursuits, and surely COOs who bring projects to their board with cost and efficiency in mind receive praise. Focusing on these goals alone, however, may be ill advised. The path to delivering true, lasting value is through harnessing intelligent automation that can act as a catalyst for end-to-end operational change. The goal, then, is not just building a slightly better version of an existing tool or process; it’s about creating an entirely new way to operate. This approach — what we call pragmatic transformation — still has cost reduction and efficiency at its core, but it has the potential for a much greater impact.

Like many in our industry, BBH has spent a considerable amount of time exploring how AI and machine learning can enhance the back and middle offices. Based on our experience using robotic process automation (RPA) to automate discrete business processes, there was a natural evolution toward combining RPA with AI. After many iterations, we launched two AI and machine learning initiatives and the lessons we learned from our experience were profound. In creating the framework for AI, we went through an operational metamorphosis, emerging with new processes, controls, and buy-in from stakeholders spanning the entire business. We could also be introspective about some of the bigger themes that are shaping our business and our industry: operational efficiency, design thinking, agile project management, the future of work, employee roles and skillsets, and enterprise communication, just to name of few.

As we reflect on our own AI journey from pilot program to pragmatic transformation, we’d like to share three success factors that helped us achieve our goals.

How do we define AL and machine learning?
Artificial intelligence and machine learning are broad descripitons to describe systems that can think, learn, and perform actions based on a defined objective.  Al can come in different forms to perform tasks faster, improve decision making, and automate not just the tasks, but the decisions behind the tasks. 

Success factor 1: Invest in business problems, not AI

It’s clear that the big question for our industry is not “if” or “when” to invest and apply AI, but “how.” As we looked to implement AI, we learned that selecting the right use cases was crucial; but too often firms focus on an exciting technology solution without actually considering what it’s solving for. This, of course, is easy to do, especially as firms establish innovation labs that aren’t fully entrenched in each business line. The first step for us was identifying a real business problem.

Consider an AI solution we created for our fund accounting business. In 2017, we had nearly one million “miscellaneous” cash wires flow into our accounting platform. Each one needed to be manually coded, researched, and resolved. As you can imagine, this was an onerous task, requiring significant manpower and, more importantly, time. To solve this issue, we developed LINC (Language Identification Network Center). LINC uses natural language processing in a supervised machine learning framework to categorize cash breaks, while making recommendations to operations specialists. The machine does this by recognizing words contained in wire transfer text, and the algorithm then codes the description. The result: 95% of entries are automatically coded compared to 65% before we deployed the solution. The second phase of this is moving beyond coding the exceptions to teaching the machine to resolve the breaks. This is where training is crucial. When teaching the machines, we need to ensure unconscious biases don’t produce unintended results; thorough reporting, benchmarking, and analysis will measure how well we’ve taught the machines. 

Our second use case was in the data-rich area of Net Asset Value (NAV) reviews. Security pricing within NAV systems must be reconciled each night to ensure the NAV is 100% accurate. Using the traditional fixed thresholds, we were producing thousands of exceptions for our analysts to review each night, with less than 1% representing a true issue. To address this problem, we created ANTS (Anomaly NAV Tracking System) which uses predictive analysis and machine learning to eliminate the noise of false exceptions and brings forth exceptions that might not have been previously detected. Analysts, in turn, spend less time sorting through recurring exceptions thus enabling them to focus on resolving true NAV threats.

In building these solutions, we learned to differentiate between “automating to replace” and “augmenting through enhanced intelligence.” Automating to replace is typically filled by RPA. RPA, unlike AI or machine learning, is often a solution for tasks that have a series of repeatable, manual steps with no complex judgement required. Augmenting through enhanced intelligence, on the other hand, can automate subjective and judgement-based tasks on top of many of the rote manual tasks RPA is already doing.

To recap, selecting the right use cases is crucial. To start, consider: 

  • A real business problem you need to solve
  • An area that is rich with data – structured and controlled data is a prerequisite
  • Whether you want to “automate to replace” or “augment through enhanced intelligence

Success factor 2: One step at a time – operating through iteration

For many COOs, building support for AI adoption can be a daunting task. It certainly was for us. The prospect of expense creep, risk of failure, and redesigns can often detract from the success of a project. Building confidence is key. That’s why we turned to the agile/iterative approach when choosing how to build, deploy, and ingrain AI into our own operating model. For instance, when building LINC, we added capabilities in stages and could refine incrementally, as figure 1 illustrates. This allowed us to celebrate victories along the way, while also keeping our goals aligned with the big picture. And by collating feedback and input from people across the business, we were able to generate support beyond our fund accounting group. In short, we were able to transcend the “silo effect” and give our project much-needed visibility.

We found that for navigating uncharted territories, like AI, you can’t have a standard waterfall approach, since that would assume you know all requirements and scope up front.  For AI projects, there is far more uncertainty as to how core systems will react and what data is available to fuel the engine. Starting with a small prototype and iterating based on feedback can help. Agile, however, will not solve these uncertainties, but it will arm your project team with the framework to solve challenges and adapt to new issues as they come.

Figure 1: Iterative Development, with result at each stage:

Linc 1.0 (In production) Coding Exceptions --->  Linc 2.0 (In production) Aggregating data to assist user in resolving exceptions ---> Linc 3.0 (In development) Machine resolves exceptions

Success factor 3: Plan ahead for adoption

When it comes to enterprise adoption, we learned that nothing is as important as formalizing processes for implementation. It all starts with communication, and since broad adoption (e.g., pragmatic transformation) was our goal, articulating the process across the enterprise was essential. For instance, when building ANTS and LINC, we partnered with HR, service delivery, systems, and many other internal areas. We also included risk and audit control functions – all areas of our firm that typically wouldn’t be involved so early. While this added time at the early stages of the project, it also brought a higher degree of understanding of how the technology worked and how the control environment evolved. This helped greatly with the next step of adoption: training.

Once we communicated our process, we established a training program to introduce the new roles our AI created. This was no easy task; after all, we were asking many employees to adapt, acquire new skills, and have a “machine learning” mindset. Most, however, took to the training with enthusiasm. This type of transformation alleviated the need to look outside of our organization for talent. Despite what many suspect, “teaching the machines” does not require a PhD in computer science; but it does require a different frame of mind. Previously, an analyst would process a transaction and move on to the next item until the work is complete for the day. The analyst would need to learn each step of the process to be able to carry out a specific task or job. Now, our AI systems reference historical behaviors of our analysts to find patterns and anomalies that can automate such decisions and actions. Our analysts no longer need to know the steps to carry out a task but instead how to analyze the performance of the system to ensure it's accurate and learning correctly.  

Finally, we learned that establishing key metrics before you begin can keep your project on track and allow you to maximize the return on the investment. We standardized metrics to monitor AI accuracy, application utilization, and efficiency. In this manner, we could monitor in real time that the tool was being used as intended.  Looking forward, these metrics are critical for the long-term success of our AI adoption, allowing us to know when and how often to retrain a model.  

Where we go next

With these lessons in mind, we continue to look to the future. We will not only seek out the next areas of our business that are ripe for pragmatic transformation, but we will continue to evolve the areas where we’ve already seen success.  With our first AI projects underway, we’re now able to build momentum for further AI adoption to eliminate manual recons. For us, it’s important to continually ask: Where can we improve? What can we do better? How do we continue to evolve? And most importantly, how can we create a better experience for our clients?

The views expressed as of August 2019 and are a general guide to the views of BBH. Brown Brothers Harriman & Co. (“BBH”) may be used as a generic term to reference the company as a whole and/or its various subsidiaries generally. This material and any products or services may be issued or provided in multiple jurisdictions by duly authorized and regulated subsidiaries. This material is for general information and reference purposes only and does not constitute legal, tax or investment advice and is not intended as an offer to sell, or a solicitation to buy securities, services or investment products. Any reference to tax matters is not intended to be used, and may not be used, for purposes of avoiding penalties under the U.S. Internal Revenue Code, or other applicable tax regimes, or for promotion, marketing or recommendation to third parties. All information has been obtained from sources believed to be reliable, but accuracy is not guaranteed, and reliance should not be placed on the information presented. This material may not be reproduced, copied or transmitted, or any of the content disclosed to third parties, without the permission of BBH. Pursuant to information regarding the provision of applicable services or products by BBH, please note the following: Brown Brothers Harriman Fund Administration Services (Ireland) Limited and Brown Brothers Harriman Trustee Services (Ireland) Limited are regulated by the Central Bank of Ireland, Brown Brothers Harriman Investor Services Limited is authorised and regulated by the Financial Conduct Authority, Brown Brothers Harriman (Luxembourg) S.C.A is regulated by the Commission de Surveillance du Secteur Financier. All trademarks and service marks included are the property of BBH or their respective owners. © Brown Brothers Harriman & Co. 2019. All rights reserved. IS-05329-2019-07-31

This browser is not fully supported by our public website and may not display or function as expected for this reason. Please note, the Infuse Portal and BBH client applications fully support the IE 11 browser.

Important Information for Non-U.S. Residents

You are required to read the following important information, which, in conjunction with the Terms and Conditions, governs your use of this website. Your use of this website and its contents constitute your acceptance of this information and those Terms and Conditions. If you do not agree with this information and the Terms and Conditions, you should immediately cease use of this website. The contents of this website have not been prepared for the benefit of investors outside of the United States. This website is not intended as a solicitation of the purchase or sale of any security or other financial instrument or any investment management services for any investor who resides in a jurisdiction other than the United States1. As a general matter, Brown Brothers Harriman & Co. and its subsidiaries (“BBH”) is not licensed or registered to solicit prospective investors and offer investment advisory services in jurisdictions outside of the United States. The information on this website is not intended to be distributed to, directed at or used by any person or entity in any jurisdiction or country where such distribution or use would be contrary to law or regulation. Persons in respect of whom such prohibitions apply must not access the website.  Under certain circumstances, BBH may provide services to investors located outside of the United States in accordance with applicable law. The conditions under which such services may be provided will be analyzed on a case-by-case basis by BBH. BBH will only accept investors from such jurisdictions or countries where it has made a determination that such an arrangement or relationship is permissible under the laws of that jurisdiction or country. The existence of this website is not intended to be a substitute for the type of analysis described above and is not intended as a solicitation of or recommendation to any prospective investor, including those located outside of the United States. Certain BBH products or services may not be available in certain jurisdictions. By choosing to access this website from any location other than the United States, you accept full responsibility for compliance with all local laws. The website contains content that has been obtained from sources that BBH believes to be reliable as of the date presented; however, BBH cannot guarantee the accuracy of such content, assure its completeness, or warrant that such information will not be changed. The content contained herein is current as of the date of issuance and is subject to change without notice. The website’s content does not constitute investment advice and should not be used as the basis for any investment decision. There is no guarantee that any investment objectives, expectations, targets described in this website or the  performance or profitability of any investment will be achieved. You understand that investing in securities and other financial instruments involves risks that may affect the value of the securities and may result in losses, including the potential loss of the principal invested, and you assume and are able to bear all such risks.  In no event shall BBH or any other affiliated party be liable for any direct, incidental, special, consequential, indirect, lost profits, loss of business or data, or punitive damages arising out of your use of this website. By clicking accept, you confirm that you accept  to the above Important Information along with Terms and Conditions.

1BBH sponsors UCITS Funds registered in Luxembourg, in certain jurisdictions. For information on those funds, please see

captcha image

Type in the word seen on the picture

I am a current investor in another jurisdiction