Importing Text File

[oharab]

What's the best way of importing a large text file (~1.5 million records) into a Pervasive.SQL 2000i system?
Some of the fields are dates, so I'm not sure how to handle them.

Cheers

Ben

----------------------------------------------
Ben O'Hara

http://www.RobotParade.co.uk

"Where are all the stupid people from...
...And how'd they get so dumb?"
NoFX-The Decline
----------------------------------------------

 

[mirtheil]

Is the Text file in CSV? What format are the date? Do you already have a table defined? If so, does the table use "True Nulls" Depending on the answers to these questions, you may be able to use the Pervasive Import Wizard. Otherwise, you may need to write an application to import the data.

info@mirtheil.com
Custom VB and Btrieve development.
Certified Pervasive Developer
Certified Pervasive Technician

 

[grnelson]

You can take a look at BtSearch at

http://www.nssdd.com.

It will allow you to import text files of various formats into Pervasive Btrieve files. It will also import dbase files as well.


Gil

 

[oharab]

I am converting an Access mdb to run on Pervasive in an attempt to speed things up a little.
This means that I can save the data in any format I need to, what do you suggest?

I tried the trial version of btsearch, and it worked well, apart from the dates, not sure what I am doing wrong. Also, it is unlikely that my dept will let me buy btsearch, they aren't too happy about me using Pervasive anyway!

Any thoughts?

Ben

----------------------------------------------
Ben O'Hara

http://www.RobotParade.co.uk

"Where are all the stupid people from...
...And how'd they get so dumb?"
NoFX-The Decline
----------------------------------------------

 

[grnelson]

Hi, just came back from a vacation so I'm not sure if you resolved this or not. If you still want any info regarding BtSearch and the date formats go ahead and leave another post. The dates should be in a format like mm/dd/yyyy. As far as Pervasive it is a much better database than Access and I've worked with both.


Gil

 

[oharab]

Hi Gil.
Never did resolve it.
I've reverted to connecting Pervasive to Access thru ODBC, then using DAO to copy one record at a time across! It's taking a while to do 225000 records, & will take an age to do 650000!!!
It's made even longer by the fact that every 12000 records or so the whole thing stops & gives me an "out of resources" message, so I have to just restart the code from where it left off!

Bummer!


Ben

----------------------------------------------
Ben O'Hara

http://www.RobotParade.co.uk

"Where are all the stupid people from...
...And how'd they get so dumb?"
NoFX-The Decline
----------------------------------------------

 

[grnelson]

What problem were you having with the dates? BtSearch allows you to import dbase or ascii. BtSearch also uses the extended calls allowed by the Btrieve API which helps speed up the import.
Thanks,

Gil

 

[oharab]

No problem with using BtSearch, other than my employers won't pay for it!
My boss isn't too keen on me using pervasive, the only reason we have it, is 'cos it came as part of another system!
It's all a bit political between us & IT!

B

----------------------------------------------
Ben O'Hara

http://www.RobotParade.co.uk

"Where are all the stupid people from...
...And how'd they get so dumb?"
NoFX-The Decline
----------------------------------------------