Pause all email didn't work

Using Settings > Notifications > Pause all email, didn't prevent status updates or new comments from being notified via email to users. The individual email toggle for each action was turned on, at first but then we turned it off, and it was still failing.

Expectation was that with "Pause all email" toggled on, no one would get emails about anything, so this looks like a bug.