Here is the blank I am talking about having drilled.
Randy,
Once I saw the blank, memories came back to me of a pen I worked on some years ago.
http://www.penturners.org/forum/f13/ss-baron-penstripe-33138/
With the one in the link, everything was perfect. Some fellows here asked me to describe how I did it. I did in detail on two or three PMs. A week or two later, I get a couple of PMs saying that they must be doing something wrong. I try to go into more detail, but I get another PM later saying it just isn't working for them.
I decided to make another pin stripe pen and detail and photo each step. 1st blank off center at the exit, maybe a millimeter; 2nd blank, same thing; 3rd blank - .5 mm OC.; 4th blank lines not parallel, 5th blank blew up.
I just got lucky on the first one. After the fifth, I had an idea of what I might be doing wrong. I was measuring and trying to get within .005 tolerance of square, but barely perceptively, not square, more rectangular. Along this line, I also noted in one post in the last two weeks, one fellow stating that he tries to hold his individual laminates to within .001. I had 5 times more error in my measurements. That, plus almost imperceptible out of square, will lead to errors of several kind.
That said, your picture is somewhat fuzzy and it is hard to tell exactly, but your tolerances look like they may not close enough to get what you want from even from the chuck. Locking an un-square blank can throw things off.
I made a sled for my table top saw and made it to the point that I could make adjustments up to .002 when squaring blanks. I also use my jointer on occasion to get two side at 90°. Off square or rectangular blank ends can result in off center exits. I am not sure this is your problem or not, but thought I would mention it.