Skip loading a plugin if it was already loaded

This prevents duplicate plugins (like one local and one system) from
being loaded, making it less likely that the one wrong is loaded.