Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cleanup support for Spark SQL interface. #31

Open
anuragkh opened this issue Oct 17, 2016 · 0 comments
Open

Cleanup support for Spark SQL interface. #31

anuragkh opened this issue Oct 17, 2016 · 0 comments
Assignees
@anuragkh
Labels
enhancement
Milestone
v0.1.9

Comments

@anuragkh
Copy link
Collaborator

The current Spark SQL interface still uses constructs from Spark 1.4.0. The implementation can benefit from the optimizations if the Data Source is brought up to date with Spark 2.0 constructs including Datasets.

Additionally, the current Spark SQL interface supports a subset of operators. We should add support for all Spark SQL operators.
@anuragkh anuragkh added this to the v0.1.9 milestone Oct 17, 2016
@anuragkh anuragkh self-assigned this Oct 17, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@anuragkh anuragkh

Labels
enhancement
Projects
None yet
Milestone
v0.1.9
Development

No branches or pull requests
1 participant
@anuragkh