posted 7/21/2010 by MarkGStacey - Views: [2193]
Last night I presented an introduction to StreamInsight to the Jhb SQL user group, to a mixed reaction.
A lot of the people there still don't see how they'd use it in their jobs, and I don't blame them. Some interest from resident high volume developer @CraigN, hopefully leading to more discussions.
Also, confimation from Gary Hope, MS South Africa's Data Platfrom Technical Specialiast that StreamInsight is a platform for partners to build apps : and a nice in-depth talk about how the architecture around StreamInsight is essential for performance.
I've attached my slide deck, and will upload some code samples soon. In the interim, you can have a look at http://streaminsightsamples.codeplex.com/ for a twitter and yahoo stock feed example
Slide deck
Each product has its place .Even stream Insight to me is no silver bullet for on it only ships with the Enterprise and Datacenter SKU's so using it is only feasible in most Enterprise and high end solutions.
In realtime trading systems ,realtime analytics ,monitoring or hyperactive warehousing scenarios it is a wonderfull platform,however most integration Consultants (ETL) is skilled in SSIS ,Informatica or DataStage and getting to know the Object orientated realm etc. may prove quite an excersize and an expensive one for organizations at that .Most of them is not in the business of building products but merely use the tools at their disposal to solve business problems or analyse data
Using Stream Insight implies that one knows Object Orientation ,LINQ , Parrallel Processing Patterns (PLINQ) ,Threading in order to achieve the performance ,which places it firmly in the hands of full on C# etc developers .Using normal SSIS can be quite simple whereas StreamInsight no matter what people sya can become quite complex, quite fast
When it comes to data mining ,trending and historical analysis the etc. you will still have to feed your Historical store as you cannot gather 5 years worth of streaming data and aggregations incremental over time .
Just my 2c worth
C