Add file directory for each experiment result.

DataResponsibly · Jul 4, 2023 · b8520db · b8520db
1 parent 5a509ea
commit b8520db
Show file tree

Hide file tree

Showing 17 changed files with 42 additions and 19 deletions.
diff --git a/README.md b/README.md
@@ -23,10 +23,31 @@ Below are the steps to prepare for an independent Python environment with requir
 1. Install [Miniconda](https://conda.io/projects/conda/en/stable/user-guide/install/linux.html)
 2. `conda env create -f environment.yml`
 
-### 2.3 Re-run all experiments
+### 2.3 Run all experiments
 
 Execute `run_experiments.sh`
 
 ### 2.4 Generate all figures in paper
 
-Each experiment has its own folder in `./experiments/real/` or `./experiments/synthetic/`. The figures in the paper are generated by the `plot.ipynb` in each experiment folder.
+Each experiment has its own folder in `./experiments/real/` or `./experiments/synthetic/`. 
+- Fig. 3(a): `experiments/synthetic/posets_for_candidate_pruning/plot.ipynb`
+- Fig. 3(b): `experiments/synthetic/posets_for_voter_grouping/plot.ipynb`
+- Fig. 4: `experiments/synthetic/posets_for_parallelization/plot.ipynb`
+- Fig. 5: `experiments/synthetic/posets/plot.ipynb`
+- Fig. 6: `experiments/synthetic/posets_for_cover_width/plot.ipynb`
+- Fig. 7: `experiments/synthetic/ppwm/plot.ipynb`
+- Fig. 8: `experiments/synthetic/pp/plot.ipynb`
+- Fig. 9: `experiments/synthetic/pc/plot.ipynb`
+- Fig. 10: `experiments/synthetic/tr/plot.ipynb`
+- Fig. 11: `experiments/synthetic/mallows/plot.ipynb`
+- Fig. 12: `experiments/synthetic/rsm/plot.ipynb`
+- Fig. 13(a): `experiments/synthetic/mallows_pp/plot.ipynb`
+- Fig. 13(b): `experiments/synthetic/mallows_tr/plot.ipynb`
+- Fig. 13(c): `experiments/synthetic/mallows_poset/plot.ipynb`
+- Fig. 14: `experiments/real/crowdrank/plot.ipynb`
+- Fig. 15: `experiments/synthetic/mpw_parallel_pluarlity/plot.ipynb`
+- Fig. 16: `experiments/synthetic/mpw_parallel_borda/plot_new.ipynb`
+
+In addition, you can find the experiment results in Table 6 in the files below:
+- MovieLens: `experiments/real/movielens/movielens_output.tsv`
+- Travel: `experiments/real/travel/travel_output.tsv`
diff --git a/experiments/real/crowdrank/plot.ipynb b/experiments/real/crowdrank/plot.ipynb
@@ -53,7 +53,7 @@
     "plt.ylim(4, 13)\n",
     "plt.yticks(list(range(4, 14, 2)))\n",
     "plt.tight_layout(pad=0)\n",
-    "# plt.savefig('real_crowdrank__time_vs_rule.pdf')"
+    "plt.savefig('real_crowdrank__time_vs_rule.pdf')"
    ]
   },
   {

diff --git a/experiments/synthetic/mallows/plot.ipynb b/experiments/synthetic/mallows/plot.ipynb
@@ -47,7 +47,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "savemode = False"
+    "savemode = True"
    ]
   },
   {

diff --git a/experiments/synthetic/mallows_poset/plot.ipynb b/experiments/synthetic/mallows_poset/plot.ipynb
@@ -59,7 +59,7 @@
     "           borderpad=0.2, labelspacing=0.2, handlelength=1, \n",
     "           handletextpad=0.2, borderaxespad=0.2, columnspacing=0.5);\n",
     "plt.tight_layout(pad=0)\n",
-    "# plt.savefig('synthetic_mallowsWpo_10_candidates_1000_voters__time_vs_phi.pdf')"
+    "plt.savefig('synthetic_mallowsWpo_10_candidates_1000_voters__time_vs_phi.pdf')"
    ]
   },
   {

diff --git a/experiments/synthetic/mallows_pp/plot.ipynb b/experiments/synthetic/mallows_pp/plot.ipynb
@@ -59,7 +59,7 @@
     "           borderpad=0.2, labelspacing=0.2, handlelength=1, \n",
     "           handletextpad=0.2, borderaxespad=0.2, columnspacing=0.5);\n",
     "plt.tight_layout(pad=0)\n",
-    "# plt.savefig('synthetic_mallowsWfp_10_candidates_1000_voters__time_vs_phi.pdf')"
+    "plt.savefig('synthetic_mallowsWfp_10_candidates_1000_voters__time_vs_phi.pdf')"
    ]
   },
   {

diff --git a/experiments/synthetic/mallows_tr/plot.ipynb b/experiments/synthetic/mallows_tr/plot.ipynb
@@ -59,7 +59,7 @@
     "           borderpad=0.2, labelspacing=0.2, handlelength=1, \n",
     "           handletextpad=0.2, borderaxespad=0.2, columnspacing=0.5);\n",
     "plt.tight_layout(pad=0)\n",
-    "# plt.savefig('synthetic_mallowsWtr_10_candidates_1000_voters__time_vs_phi.pdf')"
+    "plt.savefig('synthetic_mallowsWtr_10_candidates_1000_voters__time_vs_phi.pdf')"
    ]
   },
   {

diff --git a/experiments/synthetic/mpw_parallel_borda/plot_new.ipynb b/experiments/synthetic/mpw_parallel_borda/plot_new.ipynb
@@ -26,6 +26,7 @@
    ]
   },
   {
+   "attachments": {},
    "cell_type": "markdown",
    "id": "6152cc1b-f55a-47ef-966d-cb6b1f907daa",
    "metadata": {},
@@ -46,6 +47,7 @@
    ]
   },
   {
+   "attachments": {},
    "cell_type": "markdown",
    "id": "c9e075fe-7d8a-496b-b1a1-1756ccd1b387",
    "metadata": {},
@@ -95,7 +97,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "savemode = False"
+    "savemode = True"
    ]
   },
   {

diff --git a/experiments/synthetic/mpw_parallel_pluarlity/plot.ipynb b/experiments/synthetic/mpw_parallel_pluarlity/plot.ipynb
@@ -70,7 +70,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "savemode = False"
+    "savemode = True"
    ]
   },
   {

diff --git a/experiments/synthetic/pc/plot.ipynb b/experiments/synthetic/pc/plot.ipynb
@@ -48,7 +48,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "savemode = False"
+    "savemode = True"
    ]
   },
   {

diff --git a/experiments/synthetic/posets/plot.ipynb b/experiments/synthetic/posets/plot.ipynb
@@ -57,7 +57,7 @@
     "           borderpad=0.2, labelspacing=0.2, handlelength=1, \n",
     "           handletextpad=0.2, borderaxespad=0.2, columnspacing=0.5);\n",
     "plt.tight_layout(pad=0)\n",
-    "# plt.savefig('synthetic_posets_10_candidates_1000_voters__time_vs_phi.pdf')"
+    "plt.savefig('synthetic_posets_10_candidates_1000_voters__time_vs_phi.pdf')"
    ]
   },
   {
@@ -79,7 +79,7 @@
     "           borderpad=0.2, labelspacing=0.2, handlelength=1, \n",
     "           handletextpad=0.2, borderaxespad=0.2, columnspacing=0.5);\n",
     "plt.tight_layout(pad=0)\n",
-    "# plt.savefig('synthetic_posets_10_candidates_1000_voters__time_vs_voters.pdf')"
+    "plt.savefig('synthetic_posets_10_candidates_1000_voters__time_vs_voters.pdf')"
    ]
   },
   {

diff --git a/experiments/synthetic/posets_for_candidate_pruning/plot.ipynb b/experiments/synthetic/posets_for_candidate_pruning/plot.ipynb
@@ -89,7 +89,7 @@
     "       borderpad=0.2, labelspacing=0.2, handlelength=1, \n",
     "       handletextpad=0.2, borderaxespad=0.2, columnspacing=0.5);\n",
     "plt.tight_layout(pad=0)\n",
-    "# plt.savefig(f'synthetic_posets_10_candidates_{n}_voters__speedup_vs_pmax.pdf')"
+    "plt.savefig(f'synthetic_posets_10_candidates_{n}_voters__speedup_vs_pmax.pdf')"
    ]
   },
   {

diff --git a/experiments/synthetic/posets_for_cover_width/plot.ipynb b/experiments/synthetic/posets_for_cover_width/plot.ipynb
@@ -69,7 +69,7 @@
     "plt.ylim(0.0004, 0.14)\n",
     "# plt.xticks(list(range(1, 8)))\n",
     "plt.tight_layout(pad=0)\n",
-    "# plt.savefig('synthetic_posets_cw__time_vs_cw.pdf')"
+    "plt.savefig('synthetic_posets_cw__time_vs_cw.pdf')"
    ]
   },
   {

diff --git a/experiments/synthetic/posets_for_parallelization/plot.ipynb b/experiments/synthetic/posets_for_parallelization/plot.ipynb
@@ -72,7 +72,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "savemode = False"
+    "savemode = True"
    ]
   },
   {

diff --git a/experiments/synthetic/posets_for_voter_grouping/plot.ipynb b/experiments/synthetic/posets_for_voter_grouping/plot.ipynb
@@ -98,7 +98,7 @@
     "       borderpad=0.2, labelspacing=0.2, handlelength=1, \n",
     "       handletextpad=0.2, borderaxespad=0.2, columnspacing=0.5);\n",
     "plt.tight_layout(pad=0)\n",
-    "# plt.savefig(f'synthetic_posets_10_candidates__grouping_speedup_vs_voters.pdf')"
+    "plt.savefig(f'synthetic_posets_10_candidates__grouping_speedup_vs_voters.pdf')"
    ]
   },
   {

diff --git a/experiments/synthetic/ppwm/plot.ipynb b/experiments/synthetic/ppwm/plot.ipynb
@@ -46,7 +46,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "savemode = False"
+    "savemode = True"
    ]
   },
   {

diff --git a/experiments/synthetic/rsm/plot.ipynb b/experiments/synthetic/rsm/plot.ipynb
@@ -47,7 +47,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "savemode = False"
+    "savemode = True"
    ]
   },
   {

diff --git a/experiments/synthetic/tr/plot.ipynb b/experiments/synthetic/tr/plot.ipynb
@@ -48,7 +48,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "savemode = False"
+    "savemode = True"
    ]
   },
   {