Oh yes, the "good" old TableCellRenderer.
I don't know the exact solution, but i'm quite sure, that you need only one component (e.g. your JLabel) globally that is used by each cell.
As i said, i'm not sure, the TreeCellRenderer works this weird way, i guess the TableCellRenderer is...