A follow up,
I actually got my original code working now.
It so happened, it was the port issue. Somehow, using the same port could give you delay in queries.
$port = "81";
$connection = @fsockopen("$ip", $port, $errno, $errstr, $timeout)
$document = file("http://69.180.180.46:81/xml") were...