The web alarm popup is supposed to have a "silence" button -- or at least the wiki claims here that "Clicking 'Silence' on web popup" will stop an active alarm.
I was mystified by the lack of such a button until I dug in the DOM inspector while an alarm popup was on-screen, and discovered...