Lecture: Big Data, Technological Disruption and the 800 Pound Gorilla in the Corner
This talk will focus on the current market for “Big Data” products, specifically those that deal with one or more of “the 3 V’s”. I will suggest that the volume problem for business intelligence applications is pretty well solved by the data warehouse vendors; however upcoming “data science” tasks are poorly supported at present. On the other hand, there is rapid technological progress, so “stay tuned”. In the velocity arena recent “new SQL” and stream processing products are doing a good job, but there are a few storm clouds on the horizon. The variety space has a collection of mature products, along with considerable innovation from startups.
I will discuss opportunities in this space, especially those enabled by possible disruption from new technology. Also discussed will be the pain levels I observe in current enterprises, culminating in my presentation of “the 800 pound gorilla in the corner.”