Disconnect from correct object.

This code takes core for replacing an already set node/edge, so we have
to disconnect from that element and not the newly set one.