Out of curiosity... does the Terminal Server happen to be Windows 2003 Server ??
I have noticed this issue on a 2003 Server - seems to be something to do with 2003 Server drivers, or the way it handles multimedia. I don't think it is specific to Phone Manager, but prevents all sounds being passed to the client.
Have you tried disabling sound - ie. "Leave at remote computer" in the RDP client ?