Always reset minimum and maximum, not only when inserting

Otherwise we do not get a correct minumum/maximum value when those get
updated later on.


(cherry picked from commit f0299ad5)