+evidence opensource +input type

NovelQA · May 22, 2024 · c9210c6 · c9210c6
1 parent 8bcf09b
commit c9210c6
Show file tree

Hide file tree

Showing 2 changed files with 24 additions and 20 deletions.
diff --git a/README.md b/README.md
@@ -11,7 +11,7 @@
 - [🚀 Introduction](#-introduction)
 - [📝 Dataset](#-dataset)
   - [Data Description](#data-description)
-- [🏆 Evaluation \& Submission](#-evaluation--submission)
+- [🏆 Evaluation \& Submission Procedure](#-evaluation--submission-procedure)
 - [📜 License](#-license)
 - [📚 Citation](#-citation)
 - [📮 Contact](#-contact)
@@ -57,8 +57,9 @@
         "Aspect": "times"
     }
 ```
-
-# 🏆 Evaluation & Submission
+Currently we are only open-sourcing the fields above, without including the `Evidences` field in the case of answer leaking. However, individuals in need of the `Evidences` field for analysis can contact us (see [📮 Contact](#-contact)) to obtain it.
+
+# 🏆 Evaluation & Submission Procedure
 
   Due to confidentiality considerations, the submission procedure is deployed through multiple steps on several platforms. An overview of the submission is shown in the following flowchart.
 
@@ -94,9 +95,12 @@ If you use this dataset in your research, please cite it as follows:
 }
 ```
 # 📮 Contact
-We welcome contributions to improve this dataset! 
-If you have any questions or feedback, please feel free to reach out at [email protected].
+
+If you have any questions or feedback, please feel free to reach out [email protected] or [email protected]. 
+
+We welcome suggestions and contributions in any aspects to improve this dataset. 
+
 
 # 🎨 Website Template
 
-This leaderboard adopts the style of [bird-bench](https://github.com/bird-bench/bird-bench.github.io).
+This leaderboard adopts the style of [bird-bench](https://github.com/bird-bench/bird-bench.github.io).
diff --git a/index.html b/index.html
@@ -228,7 +228,7 @@ <h4>Citation</h4>
                   <th scope="col" rowspan="1" class="align-middle text-center">Acc</th>
                   <th scope="col" rowspan="1" class="align-middle text-center">Parameter Size</th>
                   <th scope="col" rowspan="1" class="align-middle text-center">Context Window</th>
-                  <th scope="col" rowspan="1" class="align-middle text-center">Openbook?</th>
+                  <th scope="col" rowspan="1" class="align-middle text-center">Text Input by</th>
                 </tr>
               </thead>
               <tbody>
@@ -240,7 +240,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center"><b>90.00</b></td>
                   <td class="align-middle text-center"><b></b></td>
                   <td class="align-middle text-center"><b></b></td>
-                  <td class="align-middle text-center"><b>✅</b></td>
+                  <td class="align-middle text-center"><b>Long-context</b></td>
                 </tr>
 
                 <tr>
@@ -251,7 +251,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center">53.66</td>
                   <td class="align-middle text-center">-</td>
                   <td class="align-middle text-center">200K</td>
-                  <td class="align-middle text-center">✅</td>
+                  <td class="align-middle text-center">Long-context</td>
                 </tr>
 
                 <tr>
@@ -262,7 +262,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center">46.88</td>
                   <td class="align-middle text-center">-</td>
                   <td class="align-middle text-center">128K</td>
-                  <td class="align-middle text-center">✅</td>
+                  <td class="align-middle text-center">Long-context</td>
                 </tr>
 
                 <tr>
@@ -273,7 +273,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center">46.04</td>
                   <td class="align-middle text-center">-</td>
                   <td class="align-middle text-center">200K</td>
-                  <td class="align-middle text-center">✅</td>
+                  <td class="align-middle text-center">Long-context</td>
                 </tr>
 
                 <tr>
@@ -284,7 +284,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center">32.37</td>
                   <td class="align-middle text-center">20b</td>
                   <td class="align-middle text-center">200K</td>
-                  <td class="align-middle text-center">✅</td>
+                  <td class="align-middle text-center">Long-context</td>
                 </tr>
 
                 <tr>
@@ -295,7 +295,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center">30.90</td>
                   <td class="align-middle text-center">7b</td>
                   <td class="align-middle text-center">200K</td>
-                  <td class="align-middle text-center">✅</td>
+                  <td class="align-middle text-center">Long-context</td>
                 </tr>
 
                 <tr>
@@ -340,7 +340,7 @@ <h4>Citation</h4>
                   <th scope="col" rowspan="1" class="align-middle text-center">Acc</th>
                   <th scope="col" rowspan="1" class="align-middle text-center">Parameter Size</th>
                   <th scope="col" rowspan="1" class="align-middle text-center">Context Window</th>
-                  <th scope="col" rowspan="1" class="align-middle text-center">Openbook?</th>
+                  <th scope="col" rowspan="1" class="align-middle text-center">Text Input by</th>
                 </tr>
               </thead>
               <tbody>
@@ -352,7 +352,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center"><b>97.00</b></td>
                   <td class="align-middle text-center"><b></b></td>
                   <td class="align-middle text-center"><b></b></td>
-                  <td class="align-middle text-center"><b>✅</b></td>
+                  <td class="align-middle text-center"><b>Long-context</b></td>
 
                 </tr>
 
@@ -364,7 +364,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center">71.80</td>
                   <td class="align-middle text-center">-</td>
                   <td class="align-middle text-center">128K</td>
-                  <td class="align-middle text-center">✅</td>
+                  <td class="align-middle text-center">Long-context</td>
 
                 </tr>
 
@@ -376,7 +376,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center">71.11</td>
                   <td class="align-middle text-center">-</td>
                   <td class="align-middle text-center">200K</td>
-                  <td class="align-middle text-center">✅</td>
+                  <td class="align-middle text-center">Long-context</td>
                 </tr>
 
                 <tr>
@@ -387,7 +387,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center">66.84</td>
                   <td class="align-middle text-center">-</td>
                   <td class="align-middle text-center">200K</td>
-                  <td class="align-middle text-center">✅</td>
+                  <td class="align-middle text-center">Long-context</td>
                 </tr>
 
                 <tr>
@@ -398,7 +398,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center">49.18</td>
                   <td class="align-middle text-center">20b</td>
                   <td class="align-middle text-center">200K</td>
-                  <td class="align-middle text-center">✅</td>
+                  <td class="align-middle text-center">Long-context</td>
                 </tr>
 
                 <tr>
@@ -409,7 +409,7 @@ <h4>Citation</h4>
                   <td class="align-middle text-center">43.51</td>
                   <td class="align-middle text-center">7b</td>
                   <td class="align-middle text-center">200K</td>
-                  <td class="align-middle text-center">✅</td>
+                  <td class="align-middle text-center">Long-context</td>
                 </tr>
 
                 <tr>