Ok--I've got a VS-2003 VB.NET-based service that scrapes data from an external web site. The site uses a two-step process of showing the query response--in response to the POST request, it returns an HTML doucment containing only a javascript "document.location" redirect which browsers handle accordingly.
My service strips out the new location from the first response and then does a GET to obtain the resulting page.
In the past all worked fine--the get would return a page from which I stripped needed data. Lately, the second page has been returning a simple page with the comment "'page.html' cannot be run as a Web object."
I'm guessing the host server can tell my service isn't a browser and is refusing a response. Anyone have an idea how to get around this? I need to find a workaround ASAP.
Thanks,
-Tim
My service strips out the new location from the first response and then does a GET to obtain the resulting page.
In the past all worked fine--the get would return a page from which I stripped needed data. Lately, the second page has been returning a simple page with the comment "'page.html' cannot be run as a Web object."
I'm guessing the host server can tell my service isn't a browser and is refusing a response. Anyone have an idea how to get around this? I need to find a workaround ASAP.
Thanks,
-Tim
