travs69 - thanks for the help :)
Yeah I posted it on other forums hoping that someone might actually help.
I didn't want to muck up the question with all the stuff that I have tried. This is actually different than my original request. My original request was solved and works great, but we...
I have a large data file that I got some help from brigmar to split into smaller more manageable chunks (went from a 12.86 GB file to 500 MB - 1.6 GB chunks).
I now want to add to the PERL script and go back through those chunks and pull out any invoices within those smaller data files that are...
brigmar - you rock - thanks a ton for all your help. After using your suggestions and changing the input file, here is what I came up with and it works great. It basically looks for an "11" beginning at the 67th character and then splits the file into 500 Kb chunks (or larger depending on the...
The answer is yes to both. I actually for test purposes copied that same line, over and over so that it is the only line in the data file and it is a 3 Mb file. So each line is identical and the CIBC is in the same spot for each one. I tried to use your first example without success - still...
No it isn't on a line by itself. Here is an example of the layout of one line of data. The X's represent names, addresses, account numbers, etc.
05/01/07 05/30/07 XXXXXXX 00.00 CIBC X X X X - XXXXX XXXXXX XX XXXXXXXXXX...
brigmar -- It is still just outputting one file. For testing purposes I am using a 200 Mb file and trying to break it into 500 Kb chunks...
#!usr/bin/perl -w
use strict;
my $chunksize = 500 * 1024; # 500Kb
my $filenumber = 0;
my $infile = "infile.dat";
my $outsize = 0;
my $eof = 0;
open...
The code that brigmar posted is a working script, but it doesn't seem to be splitting the file. The output file comes out the exact same size as the inout file.
The end of the invoice identifier that I am using is CIBC.
What did you mean by "Do Transforms here..."? What do I need to put in...
Why don't you tell us what site you are wanting to get more pagerank to and maybe we can give you some tips to just make your current site better rather than spinning your wheels on 1000 different sites.
It is ASCii text in a dat file. It comes from the customer in this format and then I just need to break it out into smaller chunks, because 12-13 GB is just too big. The string or pattern will differ with each client where each invoice begins and ends. I first need to go through it and strip...
I take 1-2 GB data files and process invoices (tens of thousands of invoices if not more). I don't want to break it off into one file/invoice chunks, I am hoping to be able to break the 12-13 GB file into 1/2 - 1 GB files to continue processing and not hanging up the server. I just need to...
I am looking for some suggestions on how to split a large 13 Gb+ file into smaller more manageable sized file chunks based on content using Perl. I am trying to make it a little more generic as to exactly what data or content to split on, just hoping that someone can point me in the right...
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.