"What in the Data Raises Alarms?"