samirmsallem commited on
Commit
e594e40
·
verified ·
1 Parent(s): 3911c39

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -5
README.md CHANGED
@@ -26,7 +26,7 @@ model-index:
26
  metrics:
27
  - name: Accuracy
28
  type: accuracy
29
- value: 0.9416861046317894
30
  ---
31
 
32
  ## Text classification model for coherence evaluation in German scientific texts
@@ -41,9 +41,28 @@ It was trained using a custom annotated dataset of around 12,000 training and 3,
41
  | 1 | COHERENT | The text is coherent and cohesive. |
42
 
43
 
44
- Training was conducted using a standard Text classification objective. The model achieves an accuracy of approximately 98% on the evaluation set.
 
45
 
46
- Here are the overall final metrics on the test dataset after 3 epochs of training:
47
- - **Accuracy**: 0.9416861046317894
48
- - **Loss**: 0.2770719528198242
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
 
 
26
  metrics:
27
  - name: Accuracy
28
  type: accuracy
29
+ value: 0.943352215928024
30
  ---
31
 
32
  ## Text classification model for coherence evaluation in German scientific texts
 
41
  | 1 | COHERENT | The text is coherent and cohesive. |
42
 
43
 
44
+ ### Training
45
+ Training was conducted on a 10 epoch fine-tuning approach:
46
 
47
+ | Epoch | Eval Loss | Eval Accuracy |
48
+ |-------|-----------|----------------|
49
+ | 1.0 | **0.2347**| 0.9310 |
50
+ | 2.0 | 0.3376 | 0.9327 |
51
+ | 3.0 | 0.2771 | 0.9417 |
52
+ | 4.0 | 0.3466 | 0.9374 |
53
+ | 5.0 | 0.4178 | 0.9347 |
54
+ | 6.0 | 0.4174 | 0.9410 |
55
+ | 7.0 | 0.4337 | 0.9387 |
56
+ | 8.0 | 0.4563 | 0.9387 |
57
+ | 9.0 | 0.4575 | 0.9430 |
58
+ | 10.0 | 0.4884 | **0.9434** |
59
+
60
+
61
+
62
+
63
+ Training was conducted using a standard Text classification objective. The model achieves an accuracy of approximately 94% on the evaluation set.
64
+
65
+ Here are the overall final metrics on the test dataset after 10 epochs of training:
66
+ - **Accuracy**: 0.943352215928024
67
+ - **Loss**: 0.48842695355415344
68