The picture you have posted makes it a little difficult to see the problem. Could you post another picture looking directly at the point where the two rings cross and another with the barrel rotated 90° so the cross is not visible at all. Thanks.
And, yes, not having perfectly square blanks can be a big problem, too.