Training in progress epoch 0

README.md

@@ -14,9 +14,9 @@ probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 6.4095
-- Validation Loss: 6.2491
-- Epoch: 1
+- Train Loss: 7.0931
+- Validation Loss: 6.5030
+- Epoch: 0
 
 ## Model description
 
@@ -42,13 +42,12 @@ The following hyperparameters were used during training:
 
 | Train Loss | Validation Loss | Epoch |
 |:----------:|:---------------:|:-----:|
-| 7.0968     | 6.4818          | 0     |
-| 6.4095     | 6.2491          | 1     |
+| 7.0931     | 6.5030          | 0     |
 
 
 ### Framework versions
 
-- Transformers 4.19.0.dev0
-- TensorFlow 2.8.0-rc0
-- Datasets 2.1.1.dev0
+- Transformers 4.21.0.dev0
+- TensorFlow 2.9.1
+- Datasets 2.3.3.dev0
 - Tokenizers 0.11.0

config.json

@@ -18,7 +18,7 @@
   "num_hidden_layers": 12,
   "pad_token_id": 0,
   "position_embedding_type": "absolute",
-  "transformers_version": "4.19.0.dev0",
+  "transformers_version": "4.21.0.dev0",
   "type_vocab_size": 2,
   "use_cache": true,
   "vocab_size": 28996

logs/train/events.out.tfevents.1656602207.matt-TRX40-AORUS-PRO-WIFI.40046.0.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e45bc253669df67eefd8b87d5f50cb11d7af2d733eb34de8d411eb5b128888c2
+size 1937003

logs/validation/events.out.tfevents.1656602359.matt-TRX40-AORUS-PRO-WIFI.40046.1.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:140df6b51058d79f190f2b9d8f3d54a94f0584314744b1be09e239a20374058f
+size 194

special_tokens_map.json

@@ -1 +1,7 @@
-{"unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}
+{
+  "cls_token": "[CLS]",
+  "mask_token": "[MASK]",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "unk_token": "[UNK]"
+}

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:80935281dab85916ae8aaba99ba0ef3cdae027bf6582531affdca94d08cafbc0
+oid sha256:e2eaea045c012b8431dc44dd4faa783297738bef248e1c519a40cf3e58e146b6
 size 524305832

tokenizer_config.json

@@ -1 +1,14 @@
-{"do_lower_case": false, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]", "tokenize_chinese_chars": true, "strip_accents": null, "model_max_length": 512, "special_tokens_map_file": null, "name_or_path": "sgugger/bert-like-tokenizer", "tokenizer_class": "BertTokenizer"}
+{
+  "cls_token": "[CLS]",
+  "do_lower_case": false,
+  "mask_token": "[MASK]",
+  "model_max_length": 512,
+  "name_or_path": "sgugger/bert-like-tokenizer",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "special_tokens_map_file": null,
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}