Commit
·
5a1b512
1
Parent(s):
4c7b827
Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator (#2)
Browse files- Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator (2876f6f6d18a49e19585f1a82e15088d35ed171d)
Co-authored-by: Evaluation Bot <[email protected]>
README.md
CHANGED
|
@@ -1,27 +1,26 @@
|
|
| 1 |
---
|
| 2 |
language:
|
| 3 |
- en
|
| 4 |
-
tags:
|
| 5 |
- summarization
|
| 6 |
datasets:
|
| 7 |
- xsum
|
| 8 |
metrics:
|
| 9 |
- rouge
|
| 10 |
widget:
|
| 11 |
-
- text:
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
model-index:
|
| 26 |
- name: human-centered-summarization/financial-summarization-pegasus
|
| 27 |
results:
|
|
@@ -34,30 +33,36 @@ model-index:
|
|
| 34 |
config: default
|
| 35 |
split: test
|
| 36 |
metrics:
|
| 37 |
-
-
|
| 38 |
-
type: rouge
|
| 39 |
value: 35.2055
|
|
|
|
| 40 |
verified: true
|
| 41 |
-
|
| 42 |
-
|
| 43 |
value: 16.5689
|
|
|
|
| 44 |
verified: true
|
| 45 |
-
|
| 46 |
-
|
| 47 |
value: 30.1285
|
|
|
|
| 48 |
verified: true
|
| 49 |
-
|
| 50 |
-
|
| 51 |
value: 30.1706
|
|
|
|
| 52 |
verified: true
|
| 53 |
-
|
| 54 |
-
|
| 55 |
value: 2.7092134952545166
|
|
|
|
| 56 |
verified: true
|
| 57 |
-
|
| 58 |
-
|
| 59 |
value: 15.1414
|
|
|
|
| 60 |
verified: true
|
|
|
|
| 61 |
---
|
| 62 |
|
| 63 |
### PEGASUS for Financial Summarization
|
|
|
|
| 1 |
---
|
| 2 |
language:
|
| 3 |
- en
|
| 4 |
+
tags:
|
| 5 |
- summarization
|
| 6 |
datasets:
|
| 7 |
- xsum
|
| 8 |
metrics:
|
| 9 |
- rouge
|
| 10 |
widget:
|
| 11 |
+
- text: National Commercial Bank (NCB), Saudi Arabia’s largest lender by assets, agreed
|
| 12 |
+
to buy rival Samba Financial Group for $15 billion in the biggest banking takeover
|
| 13 |
+
this year.NCB will pay 28.45 riyals ($7.58) for each Samba share, according to
|
| 14 |
+
a statement on Sunday, valuing it at about 55.7 billion riyals. NCB will offer
|
| 15 |
+
0.739 new shares for each Samba share, at the lower end of the 0.736-0.787 ratio
|
| 16 |
+
the banks set when they signed an initial framework agreement in June.The offer
|
| 17 |
+
is a 3.5% premium to Samba’s Oct. 8 closing price of 27.50 riyals and about 24%
|
| 18 |
+
higher than the level the shares traded at before the talks were made public.
|
| 19 |
+
Bloomberg News first reported the merger discussions.The new bank will have total
|
| 20 |
+
assets of more than $220 billion, creating the Gulf region’s third-largest lender.
|
| 21 |
+
The entity’s $46 billion market capitalization nearly matches that of Qatar National
|
| 22 |
+
Bank QPSC, which is still the Middle East’s biggest lender with about $268 billion
|
| 23 |
+
of assets.
|
|
|
|
| 24 |
model-index:
|
| 25 |
- name: human-centered-summarization/financial-summarization-pegasus
|
| 26 |
results:
|
|
|
|
| 33 |
config: default
|
| 34 |
split: test
|
| 35 |
metrics:
|
| 36 |
+
- type: rouge
|
|
|
|
| 37 |
value: 35.2055
|
| 38 |
+
name: ROUGE-1
|
| 39 |
verified: true
|
| 40 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMTA5OTZkY2YxMDU1YzE3NGJlMmE1OTg1NjlmNzcxOTg4YzY2OThlOTlkNGFhMGFjZWY4YjdiMjU5NDdmMWYzNSIsInZlcnNpb24iOjF9.ufBRoV2JoX4UlEfAUOYq7F3tZougwngdpKlnaC37tYXJU3omsR5hTsWM69hSdYO-k0cKUbAWCAMzjmoGwIaPAw
|
| 41 |
+
- type: rouge
|
| 42 |
value: 16.5689
|
| 43 |
+
name: ROUGE-2
|
| 44 |
verified: true
|
| 45 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOWQwMmM2NjJjNzM1N2Y3NjZmMmE5NzNlNjRjNjEwNzNhNjcyZTRiMGRlODY3NWUyMGQ0YzZmMGFhODYzOTRmOSIsInZlcnNpb24iOjF9.AZZkbaYBZG6rw6-QHYjRlSl-p0gBT2EtJxwjIP7QYH5XIQjeoiQsTnDPIq25dSMDbmQLSZnpHC104ZctX0f_Dg
|
| 46 |
+
- type: rouge
|
| 47 |
value: 30.1285
|
| 48 |
+
name: ROUGE-L
|
| 49 |
verified: true
|
| 50 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTRjYThlMTllZjI4MGFiMDZhZTVkYmRjMTNhZDUzNTQ0OWQyNDQxMmQ5ODJiMmJiNGI3OTAzYjhiMzc2MTI4NCIsInZlcnNpb24iOjF9.zTHd3F4ZlgS-azl-ZVjOckcTrtrJmDOGWVaC3qQsvvn2UW9TnseNkmo7KBc3DJU7_NmlxWZArl1BdSetED0NCg
|
| 51 |
+
- type: rouge
|
| 52 |
value: 30.1706
|
| 53 |
+
name: ROUGE-LSUM
|
| 54 |
verified: true
|
| 55 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGMzZGFjNzVkYWI0NTJkMmZjZDQ0YjhiYjIxN2VkNmJjMTgwZTk1NjFlOGU2NjNjM2VjYTNlYTBhNTQ5MGZkNSIsInZlcnNpb24iOjF9.xQ2LoI3PwlEiXo1OT2o4Pq9o2thYCd9lSCKCWlLmZdxI5GxdsjcASBKmHKopzUcwCGBPR7zF95MHSAPyszOODA
|
| 56 |
+
- type: loss
|
| 57 |
value: 2.7092134952545166
|
| 58 |
+
name: loss
|
| 59 |
verified: true
|
| 60 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzQzODE0NDc5YTYzYjJlMWU2YTVjOGRjN2JmYWVkOWNkNTRlMTZlOWIyN2NiODJkMDljMjI3YzZmYzM3N2JjYSIsInZlcnNpb24iOjF9.Vv_pdeFuRMoKK3cPr5P6n7D6_18ChJX-2qcT0y4is3XX3mS98fk3U1AYEuy9nBHOwYR3o0U8WBgQ-Ya_FqefBg
|
| 61 |
+
- type: gen_len
|
| 62 |
value: 15.1414
|
| 63 |
+
name: gen_len
|
| 64 |
verified: true
|
| 65 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjk5OTk3NWRiNjZlZmQzMmYwOTU2MmQwOWE1MDNlNTg3YWVkOTgwOTc2ZTQ0MTBiZjliOWMyZTYwMDI2MDUzYiIsInZlcnNpb24iOjF9.Zvj84JzIhM50rWTQ2GrEeOU7HrS8KsILH-8ApTcSWSI6kVnucY0MyW2ODxvRAa_zHeCygFW6Q13TFGrT5kLNAA
|
| 66 |
---
|
| 67 |
|
| 68 |
### PEGASUS for Financial Summarization
|