Toward Evaluating the Reproducibility of Information Retrieval Systems with Simulated Users

This repository accompanies our short paper submission. It features all of the code and resources to reproduce the experimental results. The Jupyter notebook can be run with Google Colab or from within a local Python environment. The notebook is self-contained, as it installs the dependencies and fetches the data resources from the web. The subdirectories in this repository contain compressed archives with the experimental results.