Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] PDK support, v2 #1597

Closed
wants to merge 12 commits into from

Conversation

marioortizmanero
Copy link
Contributor

@marioortizmanero marioortizmanero commented May 2, 2022

Pull request

Description

This PR implements Tremor's plugin system or PDK. This second attempt over #1434 re-organizes a few things, cleans them up, and makes it more flexible for future upgrades (e.g., codec plugins).

NOTE: this is still very WIP, no need to review yet. I don't get why this sends a review automatically to everyone :/

Related

Checklist

  • The RFC, if required, has been submitted and approved
  • Any user-facing impact of the changes is reflected in docs.tremor.rs
  • The code is tested
  • Use of unsafe code is reasoned about in a comment
  • Update CHANGELOG.md appropriately, recording any changes, bug fixes, or other observable changes in behavior
  • The performance impact of the change is measured (see below)

I've created this kanban to track my progress: https://github.com/marioortizmanero/tremor-runtime/projects/1

Performance

@@ -273,6 +278,10 @@ flaky-test = []
[patch.crates-io]
rust-bert = { git = 'https://github.com/mfelsche/rust-bert.git', rev = '1140989' }
rust_tokenizers = { git = 'https://github.com/mfelsche/rust-tokenizers.git', rev = '5a7860d' }
# FIXME: update to crates.io when the new version is released
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Putting a note here so we remember to merge those PR's once ready.

@marioortizmanero marioortizmanero marked this pull request as draft May 4, 2022 09:12
@marioortizmanero marioortizmanero changed the title PDK support, v2 [WIP] PDK support, v2 May 4, 2022
@marioortizmanero marioortizmanero force-pushed the pdk-scratch branch 2 times, most recently from fa1ad43 to 159d402 Compare June 5, 2022 23:10
Signed-off-by: Mario Ortiz Manero <[email protected]>
Signed-off-by: Mario Ortiz Manero <[email protected]>
Signed-off-by: Mario Ortiz Manero <[email protected]>
Signed-off-by: Mario Ortiz Manero <[email protected]>
Signed-off-by: Mario Ortiz Manero <[email protected]>
Signed-off-by: Mario Ortiz Manero <[email protected]>
Signed-off-by: Mario Ortiz Manero <[email protected]>
* Change `World` to `KillSwitch`
* Use `FutureExt as _` to avoid name clashes in the future
* Fix `KnownKey` issue (see tremor-rs#1812)
* Use insert_nocheck when possible

Signed-off-by: Mario Ortiz Manero <[email protected]>
@Licenser
Copy link
Member

closing this as it is too far behind and no longer maintained

@Licenser Licenser closed this Apr 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants