My procedure
CAVEAT: I take no responsibility for the safety of this procedure, but it is what I do and it works for me.
I turn the lathe speed way down, and use a jewelers blade screwdriver held with both hands braced against the base of my lathe. The blade of the screwdriver is pointed up, nearly vertical and above the centerline of the blank so it won't be grabbed by the rotating blank. The blade is slowly introduced to the bushing. Once it is on the bushing, I move the screwdriver blade slowly to the bushing/blank joint, scraping the CA glue off the bushing.
I then turn the lathe off. Once the ''cleaning' is accomplished, and the pen and bushing(s) are removed from the mandrel, I am very, very careful about separating the blank from bushing by snapping it free. It doesn't take much effort if the bushing is cleaned of CA. If it doesn't come easily off, I put the blank/bushing back on the lathe and do the process over.
Once off, I take the blank to a flat surface and sand it by holding the blank vertical and making small circles on a piece of 600 grit sandpaper held flat against the flat surface.
I have tried the nylon bushings, and found (for me) they interfered with putting the CA on the ends of the blank.
Again, I am sure some will cringe at this method, and I hesitated to post it for that express reason. But I have seen similar questions asked before and this works for me.
Be careful!
Warren