What tool can I use to analyze a csv file?

[tbtcust]

Hi all,

I have a CSV file that has to get loaded to a database. The file contains many record types each having it's own record layout. The files are large and I don't know much about them. Is there a way to use one the tools to produce the following at the record type level?
1) the data types of each field
2) the stats on the data i.e. how often the field is empty/null/spaces

 

[johnherman]

You are looking for a data profiling tool. Examples include Profile Stage, Axio, and some newer (and perhaps less expensive) competitors.

Search on data profiling or data profile tools in DM Review site

http://www.dmreview.com

or with your favorite search engine.

-------------------------
The trouble with doing something right the first time is that nobody appreciates how difficult it was - Steven Wright

 

[johnherman]

Another alternative is to load the .CSV file into a database and write database queries using SQL to analyze the data. Less efficient than the profile tools, though.

-------------------------
The trouble with doing something right the first time is that nobody appreciates how difficult it was - Steven Wright

 

[tbtcust]

johnherman,

I was looking for a data profiling tool

I took your advise about loading to a database.

I gave one of the jr folks some quick specs and she got several days of days of data loaded in MS Access and she wrote some VB code to get the profile I needed. thanks so much.