Turn runtime checks for interface casts into asserts

The interfaces used here are all pretty old and should be available
anyways. No need to clutter the code with code paths that are
never tested anyways.