Supports Spark DataFrame?

[tk3369]

I read through the documentation and it refers to RDD's. The current version of Spark has concepts of DataFrame and DataSet. Does this package support those? Perhaps it is related to #58?

[dfdx]

DataFrames/Datasets are described in SQL Interface section, although documentation isn't complete, so it's best to consult source code. In short, various methods for reading and writing data are supported, as well as general-purpose select, group_by, sql and some other functions.

There's a lot of missing functionality, of course, so if you miss something specific, please post an issue for it.