Internet Download

[Wullie]

Hi all,

This is an unusual request but a client asked me today if it was possible to download the whole Internet so that he could surf without a connection.

My thinking was to download the whole thing, zip and burn it onto a few CD's and then he could just insert CD1 for half and CD2 for the other half.

Now the problem, does anyone know a way to automatically download this info? I have plenty of hard drive space to store it all, I just need some kind of program that will do this for me, otherwise I am going to have to call each and every site, one by one which may take a few days.

Any suggestions appreciated, Wullie

http://www.freshlookdesign.co.uk

http://www.freshlookdesign.com

http://www.necomputers.org.uk

http://www.whiland.co.uk

The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell

 

[BigBadDave]

Just create a perl script that will run through a domain, follow all the links, and save all the pages/images/objects. Regards
David Byng

http://www.byngdesigns.co.uk

davidbyng@hotmail.com

 

[ChrisHirst]

LOL Wullie,

But you may need to use DVD-R

And it's after 12:00 here (GMT)


Chris.

Indifference will be the downfall of mankind, but who cares?

 

[Wullie]

Dave

I'm looking for a program that I could give to users so they could update the Internet themselves, so Perl is ruled out.

Chris

I have a total of 3 CD's available for this, I'm sure that if I zip it then it will fit on 2 of them.

Ps, I'm in Scotland.

Thanks guys, you have given me some things to work on but if anyone else can give me any other suggestions, feel free to do so.

I might just give up and pay someone about £100 to call every page 1 by 1 and store them all. Anyone interested just let me know. Wullie

http://www.freshlookdesign.co.uk

http://www.freshlookdesign.com

http://www.necomputers.org.uk

http://www.whiland.co.uk

The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell

 

[ChrisHirst]

Wullie

Why not ask google for an image of their cache?

but at £100 a page it's a tempting offer, If I start with my sites that's £20,000.
I could be a millionaire by 7pm.


Chris,

Indifference will be the downfall of mankind, but who cares?

 

[MrGreed]

Nice April fools thread. "did you just say Minkey?, yes that's what I said."

MrGreed

http://www.pastame.com

 

[Wullie]

MrGreed

You've not quite got the hang of this April fools, have you?

Oh well, maybe next year. LOL Wullie

http://www.freshlookdesign.co.uk

http://www.freshlookdesign.com

http://www.necomputers.org.uk

http://www.whiland.co.uk

The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell

 

[cian]

I already have the internet of a floppy disk if you want it?


É ::

http://www.endamcg.com

 

[Tarwn]

Hmmm...I might be able to make you a copy of the bound version that I have. I haven't updated it in a month or two, but thats only because I haven't decided what color paper to print out the next version on....would anyone else like a copy?
I even included the "You have reached the end of the internet" page as the last page

-Tarwn [sub]01010100 01101001 01100101 01110010 01101110 01101111 01101011 00101110 01100011 01101111 01101101 [/sub]
[sup]29 3K 10 3D 3L 3J 3K 10 32 35 10 3E 39 33 35 10 3K 3F 10 38 31 3M 35 10 36 3I 35 35 10 3K 39 3D 35 10 1Q 19[/sup]
Get better results for your questions: faq333-2924
Frequently Asked ASP Questions: faq333-3048

 

[ChrisHunt]

Why not ask Al Gore for his original copy? -- Chris Hunt
Extra Connections Ltd

http://www.extracon.com

 

[4x4uk]

I have a pdf version if anyone wants a copy. I am currently working on a wap version which can be stored in the browser cache of all mobile phones to keep connection time down to a minimum. Infinity exists! - I just haven't worked out a way to get there yet.

http://www.ne4x4.org.uk/

|

http://www.ne4x4.org.uk/Ian/

|

http://www.ne4x4.fsnet.co.uk/beck/

 

[Tarwn]

Anyone have a csv copy yet? [sub]01010100 01101001 01100101 01110010 01101110 01101111 01101011 00101110 01100011 01101111 01101101 [/sub]
[sup]29 3K 10 3D 3L 3J 3K 10 32 35 10 3E 39 33 35 10 3K 3F 10 38 31 3M 35 10 36 3I 35 35 10 3K 39 3D 35 10 1Q 19[/sup]
Get better results for your questions: faq333-2924
Frequently Asked ASP Questions: faq333-3048

 

[Wullie]

I finally found what I was looking for. LOL

http://www.onzin.nl/internetdownload/

Wullie

http://www.freshlookdesign.co.uk

http://www.freshlookdesign.com

http://www.necomputers.org.uk

http://www.whiland.co.uk

The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell

 

[4x4uk]

A very useful resource. Nice one Wullie Infinity exists! - I just haven't worked out a way to get there yet.

http://www.ne4x4.org.uk/

|

http://www.ne4x4.org.uk/Ian/

|

http://www.ne4x4.fsnet.co.uk/beck/

 

[SPYDERIX]

Very good wullie LOL I was trying to locate that image too so that I could show it to you. o/w you beat me to the punch.

http://www.spyderix-designz.com

 

[palbano]

Wullie, thanks.. i've been looking for this thread all day! Obviously in all the wrong forums! LOL

Anyway my approach is to just write a javascript that uses the random number generator to produce dynamic content for each page and tell the client it is an International download!

-pete

 

[Wullie]

Just as a side note for anyone who uses PHP, try running a phpinfo script and check out the image that appears. Wullie

http://www.freshlookdesign.co.uk

http://www.freshlookdesign.com

http://www.necomputers.org.uk

http://www.whiland.co.uk

The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell

 

[spewn]

okay...

*****
I already have the internet of a floppy disk if you want it?
&

http://www.onzin.nl/internetdownload/

&
Why not ask Al Gore for his original copy?
&
Hmmm...I might be able to make you a copy of the bound version that I have.
*****

hahaha!!! so funny. i needed a laugh, too. very clever. not bad for a bunch of computer geeks.

- g

 

[babel]

Thought it was a joke the first time I saw it, somewhere else cian.....

what you might find interesting is

http://www.archive.org

with the wayback machine...............

It shows old pages of sites.......

 

[Gatorajc]

I know this is a day after April Fools and gets off the topic of this particular forum but here it goes. I thought this post was very funny so I sent the same question around the office here, I work in a pretty big IT area supporting a big company, saying a user had requested it.

Wullie if you had a copyright I'll send you a couple bucks.

The funny thing is people around here thought someone actually asked that. When I told them April Fools they said it did not count because people ask some stupid questions and I heard all kinds of stories that happened to them and that they heard.

Granted most of them are urban legend type stuff or just had to be made up. Like the guy who said he could not find his CD-Rom but did find the cup holder or the lady who said that Word was not working and the tech asked her what she saw on the screen and she said she could not see the screen because the power was out.

It was funny hearing some of the things. So Wullie thanks for the day full of laughs.

AJ