HTTP Headers and CGI

[dcusick]

Hello all! I know very little CGI, but I think it might be useful for what I plan on doing, so I might know it very well at the end of this project(or hopefully!). Anyway, I go to a website that has a mess of information in frames and tables. I would like to be able to view this on my cellphone, but cannot becuase the HTML seems all mangled. So what I figured I'd do, was to grab the HTML content from that site and create my own WML version of it. This way, I'll have all the data, but in a viewable form.

First problem: I have to log into the site. Is there a way that I can emulate typing in my username/password and hitting submit? Can't I somehow do this be POSTing the correct HTTP Header? If so, how do I know the correct format for the headers?

Second Problem: How do I get the HTML content. I was looking at HTTP Viewer from

http://www.rexswain.com.

And that is very similar to what I want, but his source code isn't freeware. So, anyone know how he did this? or how it can be done? Thanks in advance...

Doug

 

[Deleted]

You can acommplish both thesde tasks by using the modules:

LWP::UserAgent and HTTP::Request::Common qw(POST)

Find them here:

http://search.cpan.org

M. Brooks
X Concepts LLC

http://xconcepts.com

 

[dcusick]

Thanks for the response... Looks pretty good so far.. gonna look into this a little more... Thanks mbrooks. Much Appreciated!

Doug

 

[duncdude]

use LWP;

$browser = LWP::UserAgent->new();

$browser->credentials(
"???",
'??????????',
'login' => 'password' # <- login / password
);


Kind Regards
Duncan