Inventory GUIS don't sync the player inventory (1.19.4/1.20)

[Owen1212055]

CartographyTableGui gui = new CartographyTableGui("Click the Emerald Block");
gui.show(bukkitPlayer);

Attempting to interact with the player inventory causes desync issues. This is an issue with a large amount of inventory guis.
(Tested with enchantment gui, beacon gui, and cartography gui)

Screen.Recording.2023-06-13.at.12.59.37.AM.mov

[Owen1212055]

The main issue is the buggy behavior in the GUI. My issue is I was directly setting items using setItem, so they weren't displaying. So although I can now get them to display correctly, there appears to be desync issues within the GUI itself.

EDIT: This also seems to be an issue with a large amount of inventories, tested with enchantment table gui too.