User blog comment:Dustpirate/Rearranging Village - Tips Needed/@comment-12.34.246.74-20120625150929

It has been my experience that the times reset for tax collection. So yes I would try to time the rearranging to just after you complete a major collection on everything.