With over 2.5 billion consumer accounts, Mastercard connects nearly every financial institution in the world and generates almost 75 billion transactions a year. As a result, the company has built over decades a data warehouse that holds \u201cone of the best datasets about commerce really anywhere in the world,\u201d says Ed McLaughlin, president of operations and technology at Mastercard. \n\nAnd the company is putting that data to good use. The fastest growing part of Mastercard\u2019s business today is the services it puts around commerce, says McLaughlin.\n\nIDG\u2019s Derek Hulitzky sat down with McLaughlin and Mark Kwapiszeski, president of shared components and security solutions at Mastercard, to discuss how the company turns anonymized and aggregated data into valuable business insights and their advice for getting the best results out of machine learning models.\n\nFollowing are edited excerpts of their conversation. To hear directly from McLaughlin and Kwapiszeski and get additional insights, watch the full video embedded below.\n\nDerek Hulitzky: Mastercard\u2019s Decision Management Platform won our CIO 100 award in 2020. And it uses AI and data for fraud detection. Can you tell us more about the platform?\n\nMark Kwapiszeski: We use it for several purposes, primarily in our fraud products for creating things like fraud scores on transactions. But what\u2019s really exciting about the platform is just the size and scale and scope of what it does. It\u2019s built on about 900 commodity servers and it processes about 1.2 billion transactions per day at a rate of about 65,000 transactions per second, all of which it does in about 50 milliseconds per transaction. \n\nIt uses a lot of different AI technologies and techniques; it uses about 13 different algorithms, including things like neural networks, case-based reasoning, and machine learning. But it\u2019s not just running one model at a time. We\u2019ve actually built layers, where it can run multiple models at the same time, so that it can analyze all sorts of different variables within that transaction. \n\nDerek Hulitzky: You\u2019ve described how your analytics models aren\u2019t static, and that you continuously monitor them to understand what\u2019s happening with a transaction and why it happened. Can you describe what you mean by that?\n\nMark Kwapiszeski: When you consider every transaction that we see, every interaction, it could be fraud or it could be a mom trying to buy medicine for their child. Every transaction matters. So, we always have to know not only what happened, but the why behind what had happened. \n\nAnd while the models tend to get the headlines in conversations like this, to me it\u2019s all this stuff around the model that really becomes interesting when you think about\u2014how do you not only know what happened, why it happened, and then how do you watch that over time to watch for things like model drift. \n\nOne of the best ways to see if you do have a model that is drifting, is by putting a challenger model in and watching it over a period of time. And, in fact, we\u2019ve done that for periods of upwards of a year before, watching a model, comparing it to another one, so you actually really get the best model and the best results possible. \n\nDerek Hulitzky: So Mark, you talked about drift. Can you talk a little bit, Ed and Mark, about how you solve for that, how you react to it?\n\nEd McLaughlin: I think often people almost use the wrong metaphor when they talk about AI and modeling. They use more of a code metaphor, where you build it, you run it, and it stays fairly static until you end up end-of-lifeing it sometime down the road. Whereas we see more with these models that need to be constantly attended and monitored. \n\nMark Kwapiszeski: Yeah, it kind of manifests itself in two ways. We have an entire analytic environment that\u2019s really dedicated to what are those outputs and what were the results? And then we look to marry that up with the actual end result of a transaction, because often we won\u2019t know if an approved transaction actually turns out to be fraud until sometime later. \n\nSo, our data scientists then take that fraud information and the signals that we\u2019re getting, compare it back to that analytic information of what the DMP [Decision Management Platform] is putting off in the fraud scores that we have, and then they constantly then look to tweak those two things in order to find that right balance.\n\nEd McLaughlin: One final thing I would add, because if you want to make sure you\u2019re not drifting, you have to be clear on your concepts. You probably remember, just as a consumer, as a cardholder, years ago, a lot of declines, a lot of really blunt rules were out there, because the emphasis was fighting fraud. Now, what we\u2019re saying is \u2026 [make] sure as much good stuff gets through as it can, while you fight the fraud simultaneously.