Transparency is a Misplaced Regulatory Focus for Holding Adaptive Software as Medical Devices (SaMDs) Accountable
Quy Mai Adaptive Software as Medical Devices (SaMDs) play an increasingly critical role within clinical settings, assisting physicians with illness detection, diagnosis, and analysis. Use of Artificial Intelligence/Machine Learning (AI/ML) techniques, such as deep machine learning and neural networks, lends adaptive SaMDs unparalleled analytical power, but not without risks. Adaptive SaMDs are typically “black-box,” meaning that they compute data such that no one can determine how it rendered outputs. “Transparency,” in the form of explainability, is frequently raised in policy discussions as a solution to track when the SaMD has erred in computing outputs. The FDA, in seeking to uphold...