120GB source data Transfer

[rkmibinm]

How much time 120 GB of source data in flat file should take to load into sql server based datawarehouse through DTS as ETL.
I am doing assessment for one of the datawarehouse where it takes 5 days. There are no validations , the data simply goes into different tables.

 

[MDXer]

There is no clear answer as it can depend on a number of items. Items such as the following:

Tables indexes
Import method
File Size
File grouping
Disk IO

and a number of various other factors.

If your concerned that you have bottle necks then looking at execution plans. System performance and disk queues can help identify where bottle necks may be.

Shoot Me! Shoot Me NOW!!!
- Daffy Duck

 

[rkmibinm]

No indexes,
Import through DTS,
Source flat file 120 GB,
There are no validations.
just data transfer from flat files to destination tables.

Do you still think 5 days of job is not too much.

 

[RiverGuy]

Try BCP instead. Try a 1 GB selection of your file to test before you go for the entire 120 GB.

 

[MDXer]

and commit every X thousand rows. THat way your trans log is bloating to some outrageous size.

Shoot Me! Shoot Me NOW!!!
- Daffy Duck