I import many files a day into our database via my ssis packages.
There is one file that comes in every so often that we do not want to process the full file.
I need to check each row of the file and if it has certain data, that row should NOT be processed. Otherwise, it should be processed. (If 'column H' has 'TT' in it, don't process. else, process)
I'm wondering what my best option is:
a) use a conditional split to determine which rows have 'TT' in it. If they do, don't continue down the pipeline
b) use a streamreader to determine if a line has this 'TT' in it. If it does, do not process
What I really want to know is which option is more 'expensive'. A conditional split sounds much easier to me, but does it matter which one I do?
Maybe there's a better option that I'm not aware of.......(I try to stick away from script components - if that's the other option)
Any input would be appreciated:)
The conditional split will be you best bet. That compoent is synchronous and therefore very fast.