SSIS component vs C# script performance

Question

I am developing an ETL package using SSIS. I have some semi complex Data Conversion, validation and field definitions. I can implement it by using some components such as Derive Column , Conditional, data conversion and others. My second option is to write C# script and implement all complexities using language (C#) capabilities.
Which method is more efficient on big data (Using components or C# script)?
Thanks

Joost · Accepted Answer · 2014-05-25 19:19:23Z

4

The out of the box components are in general probably faster then custom code in a Script Component, unless you need a whole bunch of components to accomplish something that can be done in a simple C# line of code.

An other thing is the use of (partial) blocking components (like sort, union, aggregate, etc.). If you need those, but you could also do it in a none blocking Script Component then it could faster to use the Script Component...

You should find a balance between performance and readability of your package. Adding C# could make it hard to maintain for non-programmers, but if a couple of well documented C# lines could take a way a whole bunch of out of the box components....

answered May 25, 2014 at 19:19

Joost

1,9313 gold badges20 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

SSIS component vs C# script performance

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related