Do not add sensors we did not request when they appear

Otherwise we get unexpected sensors appearing when a new device is
connected. This is currently mainly triggered by the network plugin that
shows/hides devices based on connectivity.