Wait a bit before restarting the connection

This prevents a possible race between gpgconf shutting down all
daemons and us triggering the start of a new scdaemon after the old
one has been shut down but before gpg-agent has been shut down. This
could lead to an orphaned scdaemon.

GnuPG-bug-id: 5775