Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[hotfix] Paimon S3 File Reader Miss Pom dependency #3241

Merged
merged 1 commit into from
Oct 12, 2024

Conversation

czy006
Copy link
Contributor

@czy006 czy006 commented Oct 11, 2024

Why are the changes needed?

2024-10-11 10:49:08,133 ERROR [main] [org.apache.amoro.server.AmoroServiceContainer] [] - AMS start error
java.io.UncheckedIOException: org.apache.paimon.fs.UnsupportedSchemeException: Could not find a file io implementation for scheme 's3' in the classpath.  Hadoop FileSystem also cannot access this path 's3://gzczy-test/warehouse'.
        at org.apache.paimon.catalog.CatalogFactory.createUnwrappedCatalog(CatalogFactory.java:100) ~[paimon-bundle-0.9.0.jar:0.9.0]
        at org.apache.paimon.catalog.CatalogFactory.createCatalog(CatalogFactory.java:71) ~[paimon-bundle-0.9.0.jar:0.9.0]
        at org.apache.paimon.catalog.CatalogFactory.createCatalog(CatalogFactory.java:67) ~[paimon-bundle-0.9.0.jar:0.9.0]
        at org.apache.amoro.formats.paimon.PaimonCatalogFactory.paimonCatalog(PaimonCatalogFactory.java:73) ~[amoro-format-paimon-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.formats.paimon.PaimonCatalogFactory.create(PaimonCatalogFactory.java:62) ~[amoro-format-paimon-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.formats.paimon.PaimonCatalogFactory.create(PaimonCatalogFactory.java:40) ~[amoro-format-paimon-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.CommonUnifiedCatalog.initializeFormatCatalogs(CommonUnifiedCatalog.java:226) ~[amoro-common-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.CommonUnifiedCatalog.<init>(CommonUnifiedCatalog.java:60) ~[amoro-common-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.catalog.ExternalCatalog.lambda$new$0(ExternalCatalog.java:52) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:268) ~[amoro-common-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:241) ~[amoro-common-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.catalog.ExternalCatalog.<init>(ExternalCatalog.java:51) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.catalog.CatalogBuilder.buildServerCatalog(CatalogBuilder.java:87) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.table.DefaultTableService.initServerCatalog(DefaultTableService.java:163) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at java.util.ArrayList.forEach(ArrayList.java:1257) ~[?:1.8.0_172]
        at org.apache.amoro.server.table.DefaultTableService.initialize(DefaultTableService.java:394) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.AmoroServiceContainer.startService(AmoroServiceContainer.java:159) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.AmoroServiceContainer.main(AmoroServiceContainer.java:117) [amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]

Brief change log

  • Add paimon-s3 dependency in amoro-format-paimon

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before making a pull request

Documentation

  • Does this pull request introduce a new feature? (no)
  • If yes, how is the feature documented? (not documented)

Copy link
Contributor

@zhoujinsong zhoujinsong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@zhoujinsong zhoujinsong merged commit 119d661 into apache:master Oct 12, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants