Revert "Introduce PCH to improve build times"

This reverts the CMake code bits of
commit 88711c0c.

Had prematurely landed without approval & review, causes warnings & errors
with no active maintainer around.