Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Are you Interested in integrating XSQL into Scriptis and Linkis? #2

Open
wushengyeyouya opened this issue Sep 6, 2019 · 5 comments

Comments

@wushengyeyouya
Copy link

Hi, Your project is particularly great, but there are certain thresholds for analysis users. Are you Interested in integrating XSQL into Scriptis and Linkis? .
Scriptis: https://github.com/WeBankFinTech/Scriptis
Linkis: https://github.com/WeBankFinTech/Linkis
I look forward to your reply. Thank you very much.

@WeiWenda
Copy link
Collaborator

WeiWenda commented Sep 6, 2019

@wushengyeyouya do you want to use hive thriftserver2 jdbc?

@wushengyeyouya
Copy link
Author

Linkis support spark engine, and we can implement a new EngineHook to get the ability of XSQL.
Scriptis can show the metadata of XSQL holded, and submit sql to linkis.

@WeiWenda
Copy link
Collaborator

WeiWenda commented Sep 6, 2019

How does Scriptis&Linkis use spark now? xsql usage is all the same as spark

@wushengyeyouya
Copy link
Author

Linkis use spark repl to obtain the ability of spark. So we think Scriptis&Linkis is pretty easy to integrate XSQL.

@WeiWenda
Copy link
Collaborator

WeiWenda commented Sep 6, 2019

You can configure spark.sql.catalogImplementation=xsql in spark-defaults.conf,so that spark-shell、spark-sql、spark-submit will enable XSQL syntax�. But above configuration only works in bin version, spark.sql.catalogImplementation=xsql is not allowed in raw spark.
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants