I think the process of reading a file line by line is the bottleneck. This bottleneck will still exist if i merely transfer it to a producer thread and have a consumer thread process the data.
How can i rework my C# code to make a limited number of large data requests to the hard drive instead...
I have text files that are 500MB+ that i need to process line by line. Currently i am using the basic code structure below. This results in a process that takes a few hours.
I tried using threads to process parts of the same source file and reading characters from the file into a few...
I have text files that are 500MB+ that i need to process line by line. Currently i am using the basic code structure below. This results in a process that takes a few hours.
I tried using threads to process parts of the same source file and reading characters from the file into a few...
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.