Know the number. Then decide.

We send one email when we publish a new test report. Each report gives the test, the numbers, and the failures.