AWK and Web Page Retrieval

[ssieloff]

Is ther any flavor of AWK that allows for the dynamic retrieval of web pages from within the program? I would like to retrieve URL's by reading a file within AWK, getting the HTML page from the internet, and parsing the tags/text into arrays for inclusion in a output file.

Any ideas?

 

[marsd]

Yep.
Look at gawk 3.0.98 and newer for stable awk with socket based(!!)extensions that will allow you to use awk as a network server and client. It isn't too difficult.
ftp.freefriends.org , I believe the directory is
"arnold"(for A.robbins).
As far as the rest of the code goes there are good
info docs for basic functions and implementations with
TCP/IP and some good url grabbing examples in particular
that should help you.