Searching large sites 1

[lesm]

I'm not an expert PHP programmer.
I need to search all files in a large site, 10,000+ files in some 300 hundred dirs. Of course the problem is the 30 seconds Timeout. I can use the Sleep() function but prefer a better solution. Since I'm not expert, I need some ideas, in order to get the best approach.

Any help? Thank you.

 

[Olavxxx]

Did you try google?
lol.. nah, sorry.. I dont know how this would be best solved. I think it will give a great deal of system stress!

I think maybe you have to make a function that redirects and runs functions, based on an array or something.

Olav Alexander Mjelde

http://www.volvo-power.net

Admin & Webmaster

 

[vbkris]

why not have some kind of indexing system that indexes only 100 files at a time. it will take a long time but once that is done then your search can be handled using a database...

Known is handfull, Unknown is worldfull

 

[lesm]

I can't figure out how an array might help.
Indexing may not help much, since the strings to search (i.e. "cccc.nnnnnnnnnn.ccccc", or "cc.nnnn.nnnnnn.ccc") change very often. Since it is an Intranet system I can't post an URL.

What I'm trying to figure out is how to stop the script execution to avoid the timeout and without flushing the results. Is it possible? Storing in a file, reloading and continuing seems to be very cumbersome.

 

[ChrisHirst]

I'd suggest PhpDig and just use it as a site search engine.



Chris.

Indifference will be the downfall of mankind, but who cares?

http://www.candsdesign.co.uk

A website that proves the cobblers kids adage.

http://www.cram-system.com

Nightclub counting systems

So long, and thanks for all the fish.