Hey all!
I have an SSIS package that has an export column tied to a derived column. The derived column is used to make a Filename column from some data. It is fed in to the export column. In the case, for instance, that a column is an NTEXT, I would generate a filename like NTEXT_<primarykeyid> so that each NTEXT value gets it's own file. I am not sure if this is the bets solution, but I am kind of new to SSIS.
The problem is that when there are a LOT of rows, I have hundreds of thousands of files. I am considering letting the export column append the data to a single file for that particular table.
My question is whether import column supports this? I would be reading back in a single raw file, with quite a few rows and reading each row's NTEXT field from that single export column file. Is this possible? If so, how do I do this?? How would the import column know where to seek within the file? If it can't be done this way, is there a way to do this? I can't justify generating so many files.
Thanks so much!
Brian
I have an SSIS package that has an export column tied to a derived column. The derived column is used to make a Filename column from some data. It is fed in to the export column. In the case, for instance, that a column is an NTEXT, I would generate a filename like NTEXT_<primarykeyid> so that each NTEXT value gets it's own file. I am not sure if this is the bets solution, but I am kind of new to SSIS.
The problem is that when there are a LOT of rows, I have hundreds of thousands of files. I am considering letting the export column append the data to a single file for that particular table.
My question is whether import column supports this? I would be reading back in a single raw file, with quite a few rows and reading each row's NTEXT field from that single export column file. Is this possible? If so, how do I do this?? How would the import column know where to seek within the file? If it can't be done this way, is there a way to do this? I can't justify generating so many files.
Thanks so much!
Brian