OK. I adjusted the code and re-ran the program. How much faster? Scary faster. About 12 minutes to cycle through the text file of 1.5MM records this time, instead of almost 2.5 hrs.
I actually did think the initial "slowness" was due to the numerous UDF calls, and was in the midst of making...
Thanks for all your ideas!
jrbblder - I downloaded SQL Server 2008 Express and plan on working with it some this weekend. I know you mentioned SQL Server 2005 Express, but version 2008 was available so I opted for that one - I hope I made the proper choice.
myearwood - Your approach would...
Thanks again all!
The SQL Server approach sounds like it would be a good solution. Unfortunately, the operation I currently work for is sort of a "mom and pop" shop, and they are not really willing to spend money and time (for installation, configuration, training, support, etc.) for a SQL...
Thanks for the prompt feedback!
Yes, the tab delimited files ARE variable length (where the same data field could have different lengths between different records).
Also, we have not yet received a tab delimited file that approaches the 2GB mark. For example, the 1.6MM records I have right...
Hi all! Thanks for all your help with resolving other issues I have encountered. I have a new one now.
We receive huge, variable length, tab delimited data files from a client several times a week. They often contain 1 to 2 million records each time, and their default layout "expands" each...
My bad - maybe I didn't explain properly. But thanks for the quick feedback anyway.
I have a Foxpro program that basically opens a small window. I compile that program into an .exe file.
I close VFP completely.
Then I run the .exe from Start, Run, etc. A large window opens, taking up about...
I have a Foxpro program that opens up a simple interface in a small window. When I make it an executable, the small interface window opens just fine, but in a much larger Microsoft Visual Foxpro window. Is there a way I can programmatically make the Microsoft Visual Foxpro window open in a...
Thanks for all your input - some great ideas! The largest of these tab-delimited text files we have received so far has been 2.4GB (which does truncate at 2GB using VFP commands), but they are typically under 2GB. We cannot change the format or record layout of the text files because they are...
All - thanks so much for you quick replies! A few notes: this will be a regular, on-going job that will be run at least once or twice a week. Unfortunately, we do not have SQL Server available to us. Each data record in the text file has the fields delimited by a tab, and a CR/LF end of...
Hi! I have a very large tab-delimited text file, and in order to stay under the 2GB limit I would like to be able to selectively load - on the fly - only some of the fields into a VFP structure. For example, if the full text record contains 100 data elements (fields), I would like to only load...
We are using VFP 6.0 and MS Access 2002. I would like to know if it is possible to set up a VFP program that will open a specific table within an MS Access database, add a row, and then populate that row with specific information from either fields from a .dbf or VFP memory variables.
If this...
We want to use VFP 6.0 to access and update specific cells from specific worksheets (tabs) in an existing Excel 2003 workbook.
The Forums have shown me the basic way to open the Excel workbook, update a cell, and save, but I cannot figure out how to get VFP to select a specific worksheet (it...
Thanks guys
Yes it definately gives me more amunition when I'm creating cursors. When you know what affect the SQL will have on your output saves a lot of confusion.
I would like to thank all who gave of his time to address the above problem.
I got a lot more out of this thread than I...
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.