Tek-Tips is the largest IT community on the Internet today!
Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!
-
Congratulations Mike Lewis on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!
-
Removing non-ascii from large .txt file
I finally figured it out, this may help someone in the future so I'm posting what I came up with. tr -cd '\11\12\15\40-\176' <Filebefore.txt > Fileafter.txt -
Removing non-ascii from large .txt file
Thanks again for replying. When I run the above script the output file is this: #, , , , #, , , , #, , , , #, , , , #, , , / ... -
Removing non-ascii from large .txt file
I created a .scp file and ran it, it appears to run the script but the output file is empty. Here's what I've got gawk -f scpfiles\nonascii.scp file1.txt > file2.txt in the scp file I've got { gsub(/[^ -~]/,"",$0) } The txt file I'm working with has 2.3 million lines. -
Removing non-ascii from large .txt file
I'm a awk virgin, however a system we have in place already uses this program with other scripts. I'm needing a command to remove all non-ascii characters from a 180mb .txt file. One of the commands is this: gawk -f scpfiles\Test.scp TEST.TXT > TEST.list Which points to this script file: {...
