blogs.conchango.com

Someone emailed me today asking: I have an SSIS package that outputs data that can’t be inserted into destination tables into flat log files [JT: I presume he means that error rows are redirected to a flat file] What is the easiest way to then after processing has completed: A) Check to see whether there has been any data that could not be ...

Here's a handy little tip for when you are building custom destination components or script destination components that enables you to log the number of processed rows. Have you ever seen that handy little message that appears in your logs that tells you how many rows arrived at a destination component? It looks a little like ...

I haven't published a nugget for a while but today a guy called Antonio was asking me how one might output the captured rowcount in a file so i thought I'd put something together that demonstrated it. Its very simple, although you will need two data-flows. One to capture the rowcount (using a rowcount component), and another to ...

I was recently contacted by Octoni Simbolon who asked me: ''[In a data flow] can we assign each row to avariable before load to destination oledb, so we can manipulate each rowand field ?'' Strictly speaking I suppose you can do this by assigning to a variable within a script component but I was pretty sure that Octoni was talking about SSIS ...

An interesting problem has been posed on the SSIS forum at SQL Server Central. The user wants to download a file containing stock information from Yahoo finance and import the data into a database table.   That sounded like an interesting problem so I took up the challenge. The basis of my solution uses the code that Ashvini ...

"I have a file that is a list of orders. Each record in the file contains the order number and the item that has been ordered along with information about that item (e.g. Quantity ordered). I want to split the file into an OrderHeader and an OrderDetail table with RI between those tables. How do I do that?" I have seen the above ...

While I was at the PASS Summit recently I was lucky enough to meet SQL Server guru and all round nice bloke Chris Hedgate. Chris had some polite things to say about my blog but did offer some constructive criticism - I should try and put more introductory type stuff on here cos most of what i write is too in depth for people just starting out ...

There is a property of each data-flow task called EngineThreads which dictates, quite simply, the number of threads that run in the data-flow pipeline. But what does that mean exactly and how can it affect your data-flow? Well BOL doesn't have much on the subject simply saying ''An integer that specifies the number of threads that the data flow ...

It is generally accepted that a synchronous script component outputs the same number of rows as are input. Well I have news for you, this doesn't have to be the case. If you have a synchronous script component with multiple outputs then you can choose to send each input row to many or none of these outputs. As a result it is possible to have a ...

If you use an error output then you will find that you get given an error number and an error column (i.e. the column in which the error occurred) but you do not get an error description. Well not to worry because youo can get the error description using a script component. Here I've built a data-flow that contains an error in the source ...