Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

performance issue related to lodash/isEqual function #4291

Open
3 of 4 tasks
igorbrasileiro opened this issue Sep 5, 2024 · 7 comments · Fixed by #4292
Open
3 of 4 tasks

performance issue related to lodash/isEqual function #4291

igorbrasileiro opened this issue Sep 5, 2024 · 7 comments · Fixed by #4292

Comments

@igorbrasileiro
Copy link
Contributor

Prerequisites

What theme are you using?

core

Version

5.x

Current Behavior

No response

Expected Behavior

No response

Steps To Reproduce

  1. Run the gist https://gist.github.com/igorbrasileiro/754a1a0fe7bb4f8a080ca2c0ed3426e0

the Gist was made with deno bench, but can be done with other js runtime.

Environment

- OS: macOS Version 14.6
- deno: 1.46.2

Anything else?

The results of the benchmark, in all three cases, the fast-deep-equal is better than lodash/isEqual
image

@igorbrasileiro igorbrasileiro added bug needs triage Initial label given, to be assigned correct labels and assigned labels Sep 5, 2024
@igorbrasileiro
Copy link
Contributor Author

igorbrasileiro commented Sep 5, 2024

I already have changed all isEqual occurrences in the RJSF igorbrasileiro@274a0a5. Can I apply this improvement?

@igorbrasileiro
Copy link
Contributor Author

I did a test running the playground locally with a bigger schema and big formdata and had 20% improvement. Others tests could be done

Steps to test:

  1. open the playground
  2. clean schema, formdata and uischema
  3. click on live validation
  4. fill the Schema and formData
  5. wait form renders
  6. click to start the browser profiling
  7. click on input name (root_name)
  8. press one key

version with fast-deep-equal: https://github.com/igorbrasileiro/react-jsonschema-form. This problem starts to be more serious when you have realtime forms with schema or data changes.

Results:

  • at RJSF main: 549ms
    Pasted Graphic

  • with fast-deep-equal: 419ms
    419 79 ms (self 1 17 ms) toPathSchema.

@heath-freenome
Copy link
Member

heath-freenome commented Sep 6, 2024

@igorbrasileiro We have one concern about the fast-deep-equals as it has an issue where it does not detect cycles. We looked over your MR and from what we can tell you are only using it to compare formData and schema objects... So neither of them should have memory cycles. We recommend that you simply update the deepEquals() function in the utils to use fast-deep-equal instead, and change all the other places where you are changing isEqual() to deepEquals() in the utils. You can probably skip merging the formatting changes since our linter will likely fail those.

Also, we noticed that we are using isEqual() in the validator-ajv8 library so we would recommend updating it there to use deepEquals() too.

Please submit the PR for our consideration. Thanks for the good work.

@heath-freenome heath-freenome added help wanted and removed needs triage Initial label given, to be assigned correct labels and assigned labels Sep 6, 2024
@igorbrasileiro
Copy link
Contributor Author

Ok, I will open a PR considering everything you mentioned. Thank you for the explanation too

@igorbrasileiro
Copy link
Contributor Author

igorbrasileiro commented Sep 9, 2024

Hi @heath-freenome, thank you for the suggestion! Unfortunately, we can't replace deepEquals with fast-deep-equal because fast-deep-equal returns false when comparing nested functions, like in the example below:

function deepEquals(a: any, b: any): boolean {
  return isEqualWith(a, b, (obj: any, other: any) => {
    if (typeof obj === "function" && typeof other === "function") {
      // Assume all functions are equivalent
      // see https://github.com/rjsf-team/react-jsonschema-form/issues/255
      return true;
    }
    return fastDeepEqual(obj, other); // fallback to default isEquals behavior
  });
}

console.log(deepEquals({ foo: { bar() {} } }, { foo: { bar() {} } })) // false

Given this limitation, I suggest we keep the current deepEquals implementation. Alternatively, we could create a new wrapper function for cases where fast-deep-equal is more appropriate. What do you think?

@igorbrasileiro
Copy link
Contributor Author

igorbrasileiro commented Sep 9, 2024

@heath-freenome I found a faster package that works with a custom comparator, to allow compare functions

https://github.com/planttheidea/fast-equals. Can you give your considerations about it?

Same benchmark I did above (gist), but with the fast-equal as baseline

image

@igorbrasileiro
Copy link
Contributor Author

igorbrasileiro commented Sep 16, 2024

@heath-freenome should reopen this issue?

#4292 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants