Monitor: Avoid fetching already removed collections.

This avoids a shitload of fetchjobs that fail anyways (If a bunch of collections is removed).