Data-Driven Spark 2.0.0

FRosner released this 19 Jun 08:43

· 240 commits to master since this release

29e8289

Build

Upgrade from Spark 1.2 to Spark 1.3
- SchemaRDD to DataFrame
- Resolve SLF4J class path conflicts
- Avoid serialization bug in flights example data set in Spark shell
Change default Scala version for sbt build to 2.10 (was 2.11)

Analysis and Visualization

First version of dashboard function
- Visualizations are now drawn independently from each other using a document-wide cache to store configuration under their content id as a key
- Bootstrap CSS layout for columnar layout
- Dashboard shows a sample, column dependencies and summary statistics for each column

Bugfixes

Changing the upper bound of heatmap scales caused heatmap to ignore the selected colors and redraw with default

Assets 4