Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

  • Congratulations Chris Miller on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

Saving Web Pages with GetURL - usernames/passwords??

Status
Not open for further replies.

Albuckj

Programmer
Jan 10, 2002
11
GB
Hi,

I need a Java program to go to a URL and then save the web page in a text file. I have successfully done this by finding the GetURL method (see bottom of page). But I need to do it for a URL where a standard username and password prompt appears. I know I need to use the following piece of code somewhere in the GetURL program to bypass this authorisation:

HTTPConnection con = new HTTPConnection(this);
con.addBasicAuthorization("protected-space", "goofy", "woof");

The problem is that I am a complete Java novice and am desperately trying to finish a project, therefore I just don’t have the time to learn the language.
Can someone PLEASEEEEEEE tell me how I can incorporate the above code into the following GetURL program (which I know works for URL’s without the authorisation needed):

[by the way, the URL is in the program below and the username = Bazza99 and the password = upge5w7u]

import java.io.*;
import java.net.*;

/**
* This simple program uses the URL class and its openStream() method to
* download the contents of a URL and copy them to a file or to the console.
**/
public class GetURL {
public static void main(String[] args) {
InputStream in = null;
OutputStream out = null;
try {
// Check the arguments
if ((args.length != 1) && (args.length != 2))
throw new IllegalArgumentException("Wrong number of arguments");

// Set up the streams
URL url = new URL(" // Create the URL
in = url.openStream(); // Open a stream to it
if (args.length == 2) // Get an appropriate output stream
out = new FileOutputStream("badata.txt");
else out = System.out;

// Now copy bytes from the URL to the output stream
byte[] buffer = new byte[4096];
int bytes_read;
while((bytes_read = in.read(buffer)) != -1)
out.write(buffer, 0, bytes_read);
}
// On exceptions, print error message and usage message.
catch (Exception e) {
System.err.println(e);
System.err.println(&quot;Usage: java GetURL <URL> [<filename>]&quot;);
}
finally { // Always close the streams, no matter what.
try { in.close(); out.close(); } catch (Exception e) {}
}
}
}
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor

Back
Top