Keeping track of hundres of file handles 3

[travs69]

I need to parse through millions of lines of dataand parse them into smaller files. The original data is all mixed up and I might need to write to file A once or hundreds of times.

Instead of opening/closing every file handle I thought I'd open it up if needed, mark it in an hash to I know it's already open and close all of them when I'm done. The problem is I'm not doing something right or I wouldn't be posting

my %fileopen;
my @data= qw(1 2 3 4 5 6 7 8 9);

for my $data (@data) {
 if (! defined($fileopen{$data}){
  open($data, ">>$data.log");
 }
 print $data "$data\n";
}

for my $key (keys %data) {
 close($key);
}

Basically every line in my data has a number in it and I'd like to somehow associate that number to a filehandle.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Travis - Those who say it cannot be done are usually interrupted by someone else doing it; Give the wrong symptoms, get the wrong solutions;

 

[Kirsle]

Maybe along the lines of...

my @handles = ();

open ($handles[0], "whatever-file.txt");
open ($handles[1], "whatever.txt");
open ($handles[2], "blah.txt");

Kirsle.net | My personal homepage

perl -e '$|=$i=1;print" oo\n<|>\n_|_";x:sleep$|;print"\b",$i++%2?"/":"_";goto x;'

 

[travs69]

Thanks.. I guess I was just over thinking the issue.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Travis - Those who say it cannot be done are usually interrupted by someone else doing it; Give the wrong symptoms, get the wrong solutions;

 

[travs69]

That works for opening the handles.. but how do you print to those handles then?



~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Travis - Those who say it cannot be done are usually interrupted by someone else doing it; Give the wrong symptoms, get the wrong solutions;

 

[Annihilannic]

Note that if you're storing FILEHANDLES in an array or other
expression, you will have to use a block returning its value
instead:

print { $files[$i] } "stuff\n";

Note also that you'll need to open them as ">>whatever.txt", per your original code...

Annihilannic.

 

[Kirsle]

Beat me to it, Annihilannic. I just found that perldoc and was about to post the same thing.

Kirsle.net | My personal homepage

perl -e '$|=$i=1;print" oo\n<|>\n_|_";x:sleep$|;print"\b",$i++%2?"/":"_";goto x;'

 

[travs69]

very cool thanks again guys, you won't believe how many filehandles the current code is opening/closing

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Travis - Those who say it cannot be done are usually interrupted by someone else doing it; Give the wrong symptoms, get the wrong solutions;

 

[travs69]

I went from processing one file a minute to one file every 10 secs with this update. Thanks guys!!

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Travis - Those who say it cannot be done are usually interrupted by someone else doing it; Give the wrong symptoms, get the wrong solutions;

 

[rharsh]

This may be a bit more information than you need, but here's a good article about using scalars as file handles that may be helpful.

http://www.stonehenge.com/merlyn/LinuxMag/col10.html