When turning it almost looks like it is wobbly [:0]. Then when I put them together it looks like one side is closer to the insert then the other side.[V]
Are you sure your blanks are properly trimmed... if you blanks are not trimmed perfectly square to the inside of the tubes, the bushings will not be square to the end of the blanks...
I went out and bought new bushings that the hardwood store carrys from pen state, works great. The kits was from Brea and the bsuhing. The bushing from Brea fit to loose on there own rod. I only buy my kits from Jim @ Brea
IIRC all cigars are a mandrel.
Check the tubes for debris, check also the faces of the bushings.
Also did you by any chance bur the tubes while milling? This can happen with the interchangeable milling shafts.