Also, you need to provide more info such as, OS version what IDP properties you have enabled, whether you are doing NAT or routing, etc. This will help in determining your problem. The more IDP properties you have selected the slower the device will be in allowing traffic. Lastly, are you using any traffic shaping?
Paul