The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks - CoNLL2023 The code can be found in https://github.com/facebookresearch/CompositionalityValidity.
For questions, feel free to open an issue and ping me on {email, Twitter, Slack}.