-
Notifications
You must be signed in to change notification settings - Fork 57
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FLINK-31986][Connectors/Kinesis] Setup integration tests for FLIP-27 Kinesis source #172
Conversation
<dependency> | ||
<groupId>software.amazon.awssdk</groupId> | ||
<artifactId>s3</artifactId> | ||
<scope>test</scope> | ||
</dependency> | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why do we test using s3? Can we use kinesis instead?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We are actually testing Kinesis only. The S3 dependency is required because the LocalStack container in the connector base arbitrarily creates an S3 bucket and lists its contents to test readiness. LocalstackContainer.java#L61-L83
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Right - thanks!
...eams/src/test/java/org/apache/flink/connector/kinesis/source/KinesisStreamsSourceITCase.java
Outdated
Show resolved
Hide resolved
...eams/src/test/java/org/apache/flink/connector/kinesis/source/KinesisStreamsSourceITCase.java
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice work @elphastori . Added some comments
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM - thanks @elphastori
Awesome work, congrats on your first merged pull request! |
Purpose of the change
Sets up Integrations tests for the FLIP-27 DataStreams API Kinesis source
Verifying this change
This change added tests and can be verified as follows: