Dan,
I had exactly the same problem with a ButtonGroup for RadioButtons also. I have three grouped buttons, which I reset the text for from an actionlistener method on a JButton.
I reused your approach as is, but it didn't work for me. I get the problem that now my RadioButtons whilst clear...