dealing with huge txt files

[AgentM]

Hi

My asp code has to read a .txt file which is approx 3 MB in size.

The data on each line has to be filtered into a database.
I am reading the file line by line and using the mid function to separate the data.

This takes such a long time that IE stops responding.

Does anyone have any ideas , abt how to make the process faster?

Any ideas appreciated.

 

[Zelandakh]

Open an Access database and pul lthe text into that instead?

 

[bra1niac]

Agreed. Do something third party. You're killing your connections especially when the servers, assuming your Db is on a separate box, have consistant loads.

Use a third party app like access and try to import the data or write something in VB and start up (if you don't have one already) an app server to handle the processing load. That way, the site (asp script) would direct the data to the app server, which would bear the load. "It's easier to ask forgiveness than it is to get permission." - Rear Admiral Dr. Grace Hopper