Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding abi_stable support for tremor-value, v3 #1336

Closed

Conversation

marioortizmanero
Copy link
Contributor

@marioortizmanero marioortizmanero commented Nov 20, 2021

Pull request

Description

This is an intermediate PR for #1287 so that it's more manageable.

This is the third attempt for tremor-value, see #1303 for the first one. Most of these attempts were because connectors rebased and it was easier to cherry-pick from scratch to resolve the issues.

In this PR, all I do is make tremor-value compatible with abi_stable. The main crate will still compile because it's a backward-compatible change. I'll soon make another PR with the changes to tremor-runtime, which are much more complicated than this simple PR.

Once this is approved and more or less ready, I'll merge marioortizmanero#3 over it with the full PDK changes.

Related

Checklist

  • The RFC, if required, has been submitted and approved
  • Any user-facing impact of the changes is reflected in docs.tremor.rs
  • The code is tested
  • Use of unsafe code is reasoned about in a comment
  • Update CHANGELOG.md appropriately, recording any changes, bug fixes, or other observable changes in behavior
  • The performance impact of the change is measured (see below)

Performance

Matthias Wahl and others added 30 commits November 17, 2021 12:38
We might want to revert that at some point, when we switch from triggered to paused or so.

Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
for turning data chunks from a connector source into (possibly multiple) EventPayloads

Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
…gs from file

Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
For supporting two-phase startup for bindings (1. connect everything, 2. start sending events),
the start_X() methods on Registries needed to be added and we needed to dispatch to
different instance implementations as logic is different between artefact types (e.g. connector, pipeline, binding).

Starting work on quiescence, but this will be overhauled completely in another commit.

Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
for detecting if we should stop reading from / writing to external connections.

Not used yet. See next PR.

Signed-off-by: Matthias Wahl <[email protected]>
Triggering it with timeout is what is missing now.

Signed-off-by: Matthias Wahl <[email protected]>
Matthias Wahl and others added 24 commits December 8, 2021 23:48
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
and bring them in a common shape.

Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Heinz N. Gies <[email protected]>
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Matthias Wahl <[email protected]>
Signed-off-by: Daksh Chauhan <[email protected]>
Signed-off-by: Daksh Chauhan <[email protected]>
@mfelsche mfelsche force-pushed the connectors branch 2 times, most recently from a22e761 to 3bcfe47 Compare December 16, 2021 15:42
@marioortizmanero marioortizmanero changed the title Adding abi_stable support for tremor-value, v3 Adding abi_stable support for tremor-value, v4 Dec 21, 2021
@marioortizmanero marioortizmanero changed the title Adding abi_stable support for tremor-value, v4 Adding abi_stable support for tremor-value, v3 Dec 21, 2021
@marioortizmanero
Copy link
Contributor Author

Another rebase with crazy changes, starting from scratch at #1381

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants