Keyurjotaniya007 commited on
Commit
4410ab3
·
verified ·
1 Parent(s): a573903

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -1
README.md CHANGED
@@ -13,4 +13,47 @@ datasets:
13
  language:
14
  - en
15
  pipeline_tag: token-classification
16
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  language:
14
  - en
15
  pipeline_tag: token-classification
16
+ ---
17
+ ## NER-Advance
18
+ This model is a fine-tuned version of xlm-roberta-base on an unimelb-nlp/wikiann dataset. It achieves the following results on the evaluation set:
19
+
20
+ • Loss: 0.27204614877700806
21
+
22
+ • F1: 0.9195951994165037
23
+
24
+ ## Training hyperparameters
25
+
26
+ The following hyperparameters were used during training:
27
+
28
+ • learning_rate: 2e-5
29
+
30
+ • train_batch_size: 24
31
+
32
+ • eval_batch_size: 24
33
+
34
+ • seed: 42
35
+
36
+ • weight_decay=0.01
37
+
38
+ • lr_scheduler_type: linear
39
+
40
+ • warmup_ratio=0.1
41
+
42
+ • num_epochs: 2
43
+
44
+ ## Training results
45
+
46
+ # Training Loss | Epoch | Validation Loss | F1
47
+ 0.2895 1.0 0.3054 0.8916
48
+
49
+ 0.2422 2.0 0.2720 0.9195
50
+
51
+ ## Framework versions
52
+
53
+ • Transformers 4.38.2
54
+
55
+ • Pytorch 2.2.1+cu121
56
+
57
+ • Datasets 2.18.0
58
+
59
+ • Tokenizers 0.15.2