I would be happy to explain my method of doing this. First it would be advantageous for you to explain what it is you are trying to do. If you are segmenting pens maybe you could show us a photo of the setup. There could be just simple tricks we could help with in your procedure instead of changing everything. I will say this CA is not the adhesive to use. It is too brittle when dried.
I am an epoxy user for most of my segmented projects. I like to use System3 T88 two part epoxy. It is a strong holding epoxy but takes at least 24 hours to cure. Whenever I am gluing acrylics or wood to metals, I like to sand with about 100 grit paper all sides. I also will take a utility knife or exacto knife and make cross hatch marks in all sides of the pieces to help give the piece some tooth or adhesion. If I am building a simple segmented pens with bands and things like that I will predrill the pieces and then proceed to build the blank on the tube. This way I avoid the stress and tension of drilling a completed blank. I use the same glue to glue tube in so all works together. Now the only stress applied to blank is when turning down to size which I do with carbide round cutters and finally with a skew. I have included a few examples of my work.
View attachment 338932View attachment 338933View attachment 338934