Properly handle signals using KSignalHandler

We cannot interact with Qt directly from a signal handler we configure,
we need to make sure it doesn't mess with the app's state.