What's common to the ringing phones? Are they all on the same card. Is it a particular line that is ringing on them? That will help narrow down your search.
I have a trouble call scheduled for tomorrow, where whenever a dialtone is connected to a particular CO port, the phones start ringing on that line, even though the line is idle. The Partner is seeing the -48VDC and causing the phones to ring. That will require replacing the module that the CO port is on.
You can try removing modules one at a time, repositioning then modules, swapping them around, etc. to find what is causing it.