splitting unix file into smaller chunks using Access

[maudedo]

Hello

I require importing unix format data files into Access for some data comparisons, however, the limitation of using Access is its inability to exceed more than 1.9GB. Some of the files I wish to compare can exceed 2-9GB. I do not have access to a SQL server which would be the preferred option of data comparison. I wonder therefore if anyone knows a script (example code would be much appreciated) I could run in Access which would identify if the file I am trying to load (extension is a variable also) exceeds 450MB, and if so runs a script to split the file into 3 chunks of 150MB, and making sure that it only breaks after an end of line before creating the next data line being presented in the next file? It (and partitioned versions) would also need to retain the original file format of UNIX (not dos format) so had LF not CRLF at end of line.

the main functionality I am looking for is the splitting script - not the importing it into access to interrogate.
If I have posted this to the incorrect forum I do apologise, and I have attempted a 'file splitter' search or partition data search and didnt come across any results - so again, apologies if this subject has appeared before and would appreciate any guidance in this respect.

thank you
Donna

 

[taupirho]

trust me when I say you should save yourself a whole s***load of problems and get the UNIX bods to do the file splitting for you before passing on the files to you. This will be about a 2 minute job for them rather than days and possibly weeks of programming effort from you.


In order to understand recursion, you must first understand recursion.