When
10:45 AM Sunday
Where
AD-211
Silicon Valley Code Camp : October 3rd and 4th 2015session
Distributed Data - System Design
How to design and build bigger better distributed data systems.
About This Session
Over the past few years data has gone from the back office to center stage. Businesses realize that data and the business intelligence gained from it is one of the most valuable assets it possesses. Consequently data has migrated from vertical big iron systems to distributed horizontally scaleable systems with the potential for massive parallel processing. And that is not all. Data systems, once used for MapReduce and long running batch processing are now processing data at near real time. The innovations in this area are foundational and seismic. Newer data systems will provide personalization, recommendations, business insights in near real time. However, building, maintaining and managing these systems is non-trivial. There is a paradigm shift when dealing with distributed and partitioned data: how do we provide a consistent view of the distributed data; how do we maintain 24/7 availability; and how do we handle unexpected failures - and failures are always unexpected. This talk goes into some of the principles and practices in distributed data systems, from messaging systems like Kafka to in-memory file systems and distributed caches. And it suggests best of breed practices to apply when building your own distributed system.Time: 10:45 AM Sunday Room: AD-211
The Speaker(s)
John Brinnand
Technical Director , DigiCert
I consider myself a pragmatic architect with many years of experience in designing and building software systems. From embedded code to distributed systems every software product poses interesting challenges and solutions. I consider myself a pragmatic software architect – someone who finds that adaptive design appears in the friction between ideas and implementation, vision and application, abstraction and ground reality. Or - as the Chinese say: between the thunder and the rain.