Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement ppl join command with Calcite #3364

Merged

Conversation

LantaoJin
Copy link
Member

@LantaoJin LantaoJin commented Feb 27, 2025

Description

Core Syntax: Implement ppl join command with Calcite

./gradlew :integ-test:integTest --tests '*Calcite*IT' succeed in local

Related Issues

Resolves #3356

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@LantaoJin
Copy link
Member Author

cc @penghuo @dai-chen @qianheng-aws

if (ctx.joinCriteria() == null) {
joinType = Join.JoinType.CROSS;
}
Join.JoinHint joinHint = getJoinHint(ctx.joinHintList());
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we have test cases on join hint? Curious if our hint is compatible with calcite's.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JoinHint currently not in use in Spark-PPL, so it not in use in Calcite as well. I think we don't need to add any behaviours which Spark-PPL doesn't have for now. Will enable JoinHint when we completed Calcite integration job.

@LantaoJin LantaoJin merged commit f18c187 into opensearch-project:feature/calcite-engine Feb 28, 2025
6 of 14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
calcite calcite migration releated
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants