ICP Comms drop and trying to determine cause

[Makkons]

Have a 4 controller cluster running on a MPLS network with QOS enabled and tested on UDP and TCP (EST) (CST) (MTN) (PFC)
EST is a gateway with paths that routes calls to CST agents .... MTN and PFC have there own PSTN/paths/agents.

Situation is intermittent ICP Comms loss between EST and CST maybe 2 or 3 times a day , which causes agents phones to be disrupted and agent stats to be corrupted at that time.

My pings between controllers are avg 30-40 ms and have shown max of 147 msec during an ICP Comm loss ,but no real packet loss. I dont beleive this is a controller issue , but a possible network/routing problem , anyone have any tips/advice in proving/pinpointing what would cause ICP Comms loss ?

Thanks in advance.

 

[CharlesBr]

Double check the gateway of the controllers losing sight of each other. In the case where the gw is a firewall or router that will then route the packets to the actual mpls gw it can cause such issues.