Ok guys... Sanded the bejeezus out of the arm ends, way more than before. So far so good. Hard braking tests done and no movement on the bushings, they're still in the bore. Thanks for all the info.
Jason-- Thanks for those pics. I'll keep that in mind if the center piece slips again.