Last weekend we did the second HDInsight bootcamp for @ukwaug. It was a good meetup and I think people got a lot out of it. One attendee said to me at the end.
“I can’t believe I got up and running with a cluster and map-reduce job in half an hour in C#. It took me weeks and an armada of experts to use EMR (Elastic Map Reduce) even though I’ve been using Java for the past few years”
That’s true though. HDInsight was meant as an easy route for programmers and .NET developers especially and those that are lazy enough to want their infrastructure to just be there (like me).
Anyway, thanks to the guys at bbits for giving us 50,000 data points from reports from their LoveCleanStreets application at http://www.lovecleanstreets.org/ it was great to see people coming up with innovative uses of the data and finding trends. In the future we’ll look to do a more advanced workshop we can enrich with other sources.
The Map-Reduce labs can be found here
The PIG labs can be found here
The dataset can be found here
Last, but not least, people have asked for the slides which can be found here (Map-Reduce anyway)
Thanks to @mjunwin, @isaac_abraham and @ds_ldn for some great presentations on the day. I’ll be updating this post in the coming days to include their 3 presentations.
Thanks to Microsoft as well for sponsoring (and Elastacloud who are picking up the delta on the bootcamp series!)
