Make sure notifications do not get deleted or reused until we are done with them. BUG: 464549 (cherry picked from commit 876c3412)