Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add empty source input checks (ingest & search) #398

Merged
merged 3 commits into from
Sep 20, 2024

Conversation

ohltyler
Copy link
Member

@ohltyler ohltyler commented Sep 20, 2024

Description

Adds checks to prevent invalid running of the fetching of source input data or source output data, which can be expensive under certain scenarios (e.g., running ML inference). Adds informational callout and disables the buttons when conditions are met. Screenshots below.

Also adds few missed cases of wrapping JSON.parse() calls in try/catch, when the inputs could potentially be in bad formats and cause uncaught exceptions.
Also removes few legacy empty files.

Screenshot 2024-09-20 at 12 45 22 PM

Screenshot 2024-09-20 at 12 45 48 PM

Screenshot 2024-09-20 at 12 53 49 PM

Screenshot 2024-09-20 at 12 54 03 PM

Check List

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@saimedhi
Copy link
Collaborator

Looks good to me.

@saimedhi
Copy link
Collaborator

Seeing a test failure. will rerun tests.

@saimedhi saimedhi merged commit dd20c6f into opensearch-project:main Sep 20, 2024
11 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 20, 2024
* Add empty source input checks; remove legacy files

Signed-off-by: Tyler Ohlsen <[email protected]>

* repeat for output transform

Signed-off-by: Tyler Ohlsen <[email protected]>

* add disabled check

Signed-off-by: Tyler Ohlsen <[email protected]>

---------

Signed-off-by: Tyler Ohlsen <[email protected]>
(cherry picked from commit dd20c6f)
saimedhi pushed a commit that referenced this pull request Sep 20, 2024
* Add empty source input checks; remove legacy files

Signed-off-by: Tyler Ohlsen <[email protected]>

* repeat for output transform

Signed-off-by: Tyler Ohlsen <[email protected]>

* add disabled check

Signed-off-by: Tyler Ohlsen <[email protected]>

---------

Signed-off-by: Tyler Ohlsen <[email protected]>
(cherry picked from commit dd20c6f)

Co-authored-by: Tyler Ohlsen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
advanced transform backport 2.x enhancement New feature or request Roadmap:Ease of Use Project-wide roadmap label
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants