Create README.md

README.md

@@ -0,0 +1,37 @@
+# Less is More: Pre-train a Strong Text Encoder for Dense Retrieval Using a Weak Decoder
+
+Please check the [official repository](https://github.com/microsoft/SEED-Encoder) for more details and updates.
+
+
+# Fine-tuning on Marco passage/doc ranking tasks and NQ tasks
+
+|   MSMARCO Dev Passage Retrieval    | MRR@10  | Recall@1k |
+|------------------------------|---------------|--------------------- |
+| BM25 warmup checkpoint     |     0.329     |      0.953     |
+| ANCE Passage  checkpoint  |     0.334   |   0.961       |
+
+|   MSMARCO Document Retrieval    | MRR@10 (Dev)  |  MRR@10 (Eval) |
+|---------------- | -------------- | -------------- |
+|  ANCE Document (FirstP)  checkpoint   |     0.394       |    0.362     | 
+
+
+| NQ Task      | Top-1  |  Top-5    | Top-20  |  Top-100 |  MRR@20    | P@20  |
+|---------------- | -------------- | -------------- |-------------- | -------------- | -------------- |-------------- |
+| DPR checkpoint    |     46.1       |        68.8     |    80.4     |   87.1      |   56.2    |    20.1   |
+| ANCE NQ checkpoint    |   52.5        |       73.1      |      83.1   |   88.7   |       61.5   |    22.5 
+
+
+# Citation
+
+If you find SEED-Encoder useful for your work, please cite the following paper:
+
+ ```
+  @article{lu2021less,
+    title={Less is More: Pre-training a Strong Siamese Encoder Using a Weak Decoder},
+    author={Lu, Shuqi and Xiong, Chenyan and He, Di and Ke, Guolin and Malik, Waleed and Dou, Zhicheng and Bennett, Paul and Liu, Tieyan and Overwijk, Arnold},
+    journal={arXiv preprint arXiv:2102.09206},
+    year={2021}
+  }
+ ```
+
+