Thanks Annihilannic, I thought of that, and yet I hesitate to test it only because I used the TOP feature to watch the resource usage throughout the batch job and did not see the available ram drop below 20G.
I make the assumption that the sort command will take what it needs to perform the...
EDIT:
The problem is that when I ran 100,000 records through this job stream... no problem. However, now that I have 2.2 million records, the sorts appear to be processing at about 1000 records per hour... not good.
Thanks again for your help.
I have several sort commands within a batch job stream. I am using stdin and stdout for most of the sort commands. The flat files that are being piped in and out are anywhere between 500MB and 30GB.
From what I noted in the man page, 'sort' is largefile compatible (2GB+).
I have changed the...
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.