Abstract What visual information do primate brains use to recognize objects, and can explanations from artificial neural networks (ANNs) help reveal these biological recognition strategies? Answering this question is important because humans and macaques both perform rapid, robust object recognition, yet the diagnostic image features guiding their behavior are difficult to measure at scale. Behavioral methods such as Bubbles can estimate these features but require extensive psychophysical data, whereas ANN explanation methods, including saliency and guided backpropagation, are efficient but often disagree with one another and lack direct biological validation. Here, we introduce MAPS, Masked Attribution-based Probing of Strategies, a framework that makes ANN-derived explanations testable in biological systems by linking them to neurobehavioral consequences. MAPS converts explanation maps into minimal explanation-masked images and asks whether these images preserve the original image-by-image recognition behavior. In silico, EMI-based behavioral similarity reliably recovers ground-truth similarity between model strategies. Applied to humans (n = 56) and macaques (n = 2), MAPS identifies explanation methods that best align with biological vision, achieving validity comparable to Bubbles without exhaustive psychophysics. MAPS provides a scalable, behaviorally grounded approach to evaluate and compare ANN explanations across brains and machines. Similar content being viewed by others Acknowledgements We thank the members of the ViTA Lab for helpful discussions and comments. Funding KK has been supported by funds from the Canada Research Chair Program (CRC-2021-00326), Google Research, Brain-Canada Foundation (2023-0259), the Canada First Research Excellence Funds (VISTA Program), and the National Sciences and Engineering Research Council of Canada (NSERC, RGPIN-2024-06223). SM is funded by the Connected Minds Postdoctoral Fellowship (supported by CFREF). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Author information Authors and Affiliations Corresponding authors Ethics declarations Competing interests The author declares no competing interests.
Masked attribution-based probing of strategies as a computational framework to align ...
Read the original article
nature.com →