Artificial intelligence (AI) is the most disruptive innovation in a generation. It is quickly becoming an essential component in many industries, including public safety.
However, these are still the nascent stages of AI adoption, and with that, come challenges. One is the so-called “black box,” problem, where human operators overseeing a system do not fully understand why the algorithms recommend a particular action. Data goes in one side and results come out the other, but it is not always clear what happens in the interim. Maybe the software perceived a pattern that humans could not detect, or perhaps the machine simply made a mistake during its calculations.