SSIS - Parallel processing

I remember seeing a very early CTP of Yukon and the new DTS. I was very exceited to see a parallel property on the loop container which would allow the contents of the container to be executed in parallel.

If you've used the RTM on Yukon you will know that there is no such property. Unfortunately it was too complex to be implement.

However you can still get parallel execution by using multiple tasks or by having multiple paths in a data flow.

For more details read this post

http://blogs.msdn.com/sqlperf/archive/2007/05/11/implement-parallel-execution-in-ssis.aspx


-
Published 15 May 2007 20:34 by simonsabin
Filed under: , , ,

Comments

31 August 2010 05:13 by CozyRoc

# re: SSIS - Parallel processing

Hi Simon,

CozyRoc has recently released a new task called "Parallel Loop Task". You can point to regular "Foreach Loop Container" and execute it in parallel. In tests, a CPU intensive sequential process when executed in parallel on 4-core machine was executed 3 times faster compared to the sequential.

You can find more about the new task here: www.cozyroc.com/.../parallel-loop-task