How often do you chrony a load to check its muzzle velocity.?

I had a known load shift about 5 inches vertical at 400 yards to be right off the steel plate.

Is that just "part of the game" or might there be something else going on here?