feat(tpu-v2): provide swap protocol versioning #2324

laruh · 2025-01-17T13:32:51Z

ordermatch structs which got swap_version field:

TakerOrderBuilder
MakerOrderBuilder
MakerOrder
MakerReserved
TakerRequest

swap structs. if swap started swap_version will be saved in db:

MySwapForRpc
TakerSwapStateMachine
MakerSwapStateMachine
TakerSwapDbRepr
MakerSwapDbRepr

swap version 2 is tpu v2 protocol
legacy swap protocol is 1 version

When Taker or Maker build order, the value const SWAP_VERSION: u32 = 2; is used for order Builder.
However in create_maker_order/lp_auto_buy if user didnt use ctx.use_trading_proto_v2() in config we set legacy protocol version to the order.

updated my_swaps table migration, new swap_version field provided in Maker/TakerSwapStorage

onur-ozkan

Is this blocking anything currently? These changes look like a hacky workaround rather than a being proper solution. It would be great if we can avoid this change.

onur-ozkan · 2025-01-20T11:00:54Z

mm2src/mm2_main/src/lp_ordermatch.rs

+fn legacy_swap_version() -> u32 { 1 }
+
+fn is_legacy_swap_version(swap_version: &u32) -> bool { *swap_version == 1 }


Suggested change

fn legacy_swap_version() -> u32 { 1 }

fn is_legacy_swap_version(swap_version: &u32) -> bool { *swap_version == 1 }

const fn legacy_swap_version() -> u32 { 1 }

fn is_legacy_swap_version(swap_version: &u32) -> bool { *swap_version == legacy_swap_version() }

Provided const fn 998e75a

laruh · 2025-01-20T11:27:37Z

Is this blocking anything currently? These changes look like a hacky workaround rather than a being proper solution. It would be great if we can avoid this change.

We need swap versioning to do a legacy fallback on order matching

dimxy · 2025-01-20T12:00:25Z

mm2src/mm2_main/src/lp_ordermatch.rs

+    /// In the future alls users will be using TPU V2 by default without "use_trading_proto_v2" configuration.
+    pub fn use_trading_proto_v2(mut self, use_trading_proto_v2: bool) -> Self {
+        if !use_trading_proto_v2 {
+            self.swap_version = 1;


Do we reserve only single value for legacy swaps?
I think legacy swaps may exist for sometime and we should allow version grow for them too.
I suggest use a structured encoding, for e.g.:
for legacy swaps: 1.x.y
for TPU: 2.x.y
(we could encode it into u32 as 1 * 10000 + x * 100 + y)

Explain how this is supposed to work and to be supported for kickstart process for example.

I really doubt we will use minor and patch versions in the current repo.
We can start legacy from 0 and reserve 1 version for legacy kmd burn implementation.
I think it will be the first and the last feature in legacy which will require explicit version separation.
zero fee shouldn't make many changes in utxo and evm code?

anyway everything which changes backward compatibility should update swap version "major" integer.

will legacy and legacy burn fee/zero fee be incompatible or not? That is only matters. Even if we dont reserve numbers before 2 for legacy, we could use next numbers after 2 for newer legacy versions. its just numbers.

Could you plz add some info how swap_version is used, to the PR description?
Was it meant to have just 1 and 2 values?

I am referring to the discussion in the team chat where it was discussed to get swap parties versions from the order matching. Maybe this PR should be reconsidered after we work out that concept.

I updated PR description

I am referring to the discussion in the team chat where it was discussed to get swap parties versions from the order matching.

This PR provides swap version from order matching

Maybe this PR should be reconsidered after we work out that concept.

This PR exists due to the reason that we still dont have any conclusion related to versioning. It is blocking TPU, to launch TPU in production, we need support for a legacy fallback.

I would tell we can change versioning later in other PRs, when we see by practice what versioning approach is preferable

dimxy · 2025-01-20T12:08:52Z

mm2src/mm2_main/src/lp_ordermatch.rs

+    /// In the future alls users will be using TPU V2 by default without "use_trading_proto_v2" configuration.
+    pub fn use_trading_proto_v2(mut self, use_trading_proto_v2: bool) -> Self {
+        if !use_trading_proto_v2 {
+            self.swap_version = 1;


we should use a const like LEGACY_SWAP_VERSION (indicating current version this code supports)

Current version this code/repo supports is this const SWAP_VERSION.
If use_trading_proto_v2:false it means user didnt enable TPU

reused const fn 53d4b40
we need const function for #[serde(default = "legacy_swap_version")], so no need to create one more const variable.

UPD: I refactored this function a bit according to Onur notes, so please check newer commits

onur-ozkan · 2025-01-21T07:44:19Z

mm2src/mm2_main/src/lp_ordermatch.rs

+    pub fn use_trading_proto_v2(mut self, use_trading_proto_v2: bool) -> Self {
+        if !use_trading_proto_v2 {
+            self.swap_version = legacy_swap_version();
+        }
+        self
+    }


Why not this?

Suggested change

pub fn use_trading_proto_v2(mut self, use_trading_proto_v2: bool) -> Self {

if !use_trading_proto_v2 {

self.swap_version = legacy_swap_version();

}

self

}

pub fn use_trading_proto_v2(mut self) -> Self {

self.swap_version = legacy_swap_version();

self

}

or, at least rename it to something like maybe_**

u suggested to change version to legacy protocol calling use_trading_proto_v2
please re read doc comment

/// When a new [TakerOrderBuilder::new] is created, it sets [SWAP_VERSION] by default. /// However, if user has not specified in the config to use TPU V2, /// the TakerOrderBuilder's swap_version is changed to legacy. /// In the future alls users will be using TPU V2 by default without "use_trading_proto_v2" configuration. pub fn use_trading_proto_v2(mut self, use_trading_proto_v2: bool) -> Self {

What I suggest is, either remove this boolean from the function and check it on the caller side or declare that in the function name with "maybe" prefix.

What I suggest is, either remove this boolean from the function and check it on the caller side

I dont get it, on the caller side it is where? Right now it looks like, you call use_trading_proto_v2 and set legacy

pub fn use_trading_proto_v2(mut self) -> Self { self.swap_version = legacy_swap_version(); self }

I updated function name e37c74e

I didn't pay attention to the logic, the usage was just unclear. Looking at the logic, it's even more unclear.. Function is called use_trading_proto_v2 but it downgrades version to legacy if given boolean is false.

Why not just this:

pub fn use_trading_proto_legacy(mut self) -> Self { self.swap_version = legacy_swap_version(); self }

and call it only when use_trading_proto_v2 is false?

the thing is that use_trading_proto_v2 initially is a config boolean flag, so use_trading_proto_legacy is supposed to be a question

ok I refactored function, now its purpose is only to set legacy protocol a62f56a

onur-ozkan · 2025-01-21T07:45:09Z

mm2src/mm2_main/src/lp_ordermatch.rs

+    pub fn use_trading_proto_v2(mut self, use_trading_proto_v2: bool) -> Self {
+        if !use_trading_proto_v2 {
+            self.swap_version = legacy_swap_version();
+        }
+        self


same as above

onur-ozkan · 2025-01-21T07:45:48Z

mm2src/mm2_main/src/lp_ordermatch.rs

+        let alice_swap_v = maker_match.request.swap_version;
+
+        // Start legacy swap if taker uses legacy protocol (version 1) or if conditions for trading_proto_v2 aren't met.
+        if alice_swap_v == 1u32 || !ctx.use_trading_proto_v2() {


Suggested change

if alice_swap_v == 1u32 || !ctx.use_trading_proto_v2() {

if alice_swap_v == legacy_swap_version() || !ctx.use_trading_proto_v2() {

Done d4c5a16

onur-ozkan · 2025-01-21T07:45:58Z

mm2src/mm2_main/src/lp_ordermatch.rs

+        let bob_swap_v = taker_match.reserved.swap_version;
+
+        // Start legacy swap if maker uses legacy protocol (version 1) or if conditions for trading_proto_v2 aren't met.
+        if bob_swap_v == 1u32 || !ctx.use_trading_proto_v2() {


Suggested change

if bob_swap_v == 1u32 || !ctx.use_trading_proto_v2() {

if bob_swap_v == legacy_swap_version() || !ctx.use_trading_proto_v2() {

Done d4c5a16

onur-ozkan · 2025-01-21T07:46:35Z

mm2src/mm2_main/src/lp_ordermatch/my_orders_storage.rs

@@ -706,6 +706,8 @@ mod tests {

    wasm_bindgen_test_configure!(run_in_browser);

+    const LEGACY_SWAP_V: u32 = 1;


legacy_swap_version can replace this need

Done d4c5a16

onur-ozkan · 2025-01-21T07:47:50Z

mm2src/mm2_main/src/ordermatch_tests.rs

@@ -20,6 +20,8 @@ use std::collections::HashSet;
 use std::iter::{self, FromIterator};
 use std::sync::Mutex;

+const LEGACY_SWAP_V: u32 = 1;


Same as above

Done d4c5a16

laruh added 2 commits January 13, 2025 19:37

swap_version field

7387740

add swap_version field in MySwapForRpc structure,

124057a

updated my_swaps table migration, new swap_version field provided in Maker/TakerSwapStorage

laruh added the status: pending review label Jan 17, 2025

laruh changed the title ~~feat(tpu-v2) provide swap protocol versioning field~~ feat(tpu-v2): provide swap protocol versioning Jan 17, 2025

onur-ozkan reviewed Jan 20, 2025

View reviewed changes

dimxy reviewed Jan 20, 2025

View reviewed changes

review: use const fn

998e75a

dimxy reviewed Jan 20, 2025

View reviewed changes

review: call const legacy func in use_trading_proto_v2 fnc

53d4b40

onur-ozkan reviewed Jan 21, 2025

View reviewed changes

laruh added 3 commits January 21, 2025 14:57

review: use const fn in more places

d4c5a16

review: rename function

e37c74e

review: provide set_legacy_swap_v func

a62f56a

laruh added the priority: high Important tasks that need attention soon. label Jan 23, 2025

laruh mentioned this pull request Jan 26, 2025

Trading protocol upgrade v2. #1895

Open

27 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(tpu-v2): provide swap protocol versioning #2324

feat(tpu-v2): provide swap protocol versioning #2324

laruh commented Jan 17, 2025 •

edited

Loading

onur-ozkan left a comment

onur-ozkan Jan 20, 2025

laruh Jan 21, 2025

laruh commented Jan 20, 2025

dimxy Jan 20, 2025

laruh Jan 21, 2025

dimxy Jan 21, 2025

laruh Jan 21, 2025 •

edited

Loading

dimxy Jan 21, 2025

dimxy Jan 20, 2025

laruh Jan 21, 2025 •

edited

Loading

onur-ozkan Jan 21, 2025

laruh Jan 21, 2025

onur-ozkan Jan 21, 2025

laruh Jan 21, 2025

laruh Jan 21, 2025

onur-ozkan Jan 21, 2025 •

edited

Loading

laruh Jan 21, 2025

onur-ozkan Jan 21, 2025

onur-ozkan Jan 21, 2025

laruh Jan 21, 2025

onur-ozkan Jan 21, 2025

laruh Jan 21, 2025

onur-ozkan Jan 21, 2025

laruh Jan 21, 2025

onur-ozkan Jan 21, 2025

laruh Jan 21, 2025 •

edited

Loading

		fn legacy_swap_version() -> u32 { 1 }

		fn is_legacy_swap_version(swap_version: &u32) -> bool { *swap_version == 1 }

	if alice_swap_v == 1u32 \|\| !ctx.use_trading_proto_v2() {
	if alice_swap_v == legacy_swap_version() \|\| !ctx.use_trading_proto_v2() {

	if bob_swap_v == 1u32 \|\| !ctx.use_trading_proto_v2() {
	if bob_swap_v == legacy_swap_version() \|\| !ctx.use_trading_proto_v2() {

		@@ -706,6 +706,8 @@ mod tests {

		wasm_bindgen_test_configure!(run_in_browser);

		const LEGACY_SWAP_V: u32 = 1;

feat(tpu-v2): provide swap protocol versioning #2324

Are you sure you want to change the base?

feat(tpu-v2): provide swap protocol versioning #2324

Conversation

laruh commented Jan 17, 2025 • edited Loading

onur-ozkan left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

laruh commented Jan 20, 2025

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

laruh Jan 21, 2025 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

laruh Jan 21, 2025 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

onur-ozkan Jan 21, 2025 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

laruh Jan 21, 2025 • edited Loading

Choose a reason for hiding this comment

laruh commented Jan 17, 2025 •

edited

Loading

laruh Jan 21, 2025 •

edited

Loading

laruh Jan 21, 2025 •

edited

Loading

onur-ozkan Jan 21, 2025 •

edited

Loading

laruh Jan 21, 2025 •

edited

Loading