Been there, done that . . .
I keep a stash of 2 1/2 inch blanks near my drill press (I think I cut them from some old scrap 2x4's). Whenever I have to make an adjustment to my drill press I drill one of these scraps to make sure things are still straight and true.