Deformation is relative to the starting location of each node, so it matters that one body travelled 1 mm before contact.
Plot Strain to see the local deformation of each element with respect to its initial shape, regardless of how far it had to travel before contact was made. The same goes for Stress.