Upload folder using huggingface_hub

README.md

@@ -15,10 +15,21 @@ tags:
 - llama-3-instruct
 - llama-3-instruct-8b
 - 8b
+- science
+- physics
+- biology
+- chemistry
+- compsci
+- computer-science
+- engineering
+- technical
 - conversational
 - chat
 - instruct
 base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
+datasets:
+- sequelbox/Celestia
+- sequelbox/Supernova
 model_type: llama
 license: llama3.1
 ---
@@ -29,14 +40,16 @@ license: llama3.1
 
 Shining Valiant 2 is a chat model built on Llama 3.1 8b, finetuned on our data for friendship, insight, knowledge and enthusiasm.
   - Finetuned on [meta-llama/Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) for best available general performance
-  - Trained on our data, focused on science, engineering, technical knowledge, and structured reasoning
+  - Trained on a variety of high quality data; focused on science, engineering, technical knowledge, and structured reasoning
 
 
 ## Version
 
-This is the **2024-08-06** release of Shining Valiant 2 for Llama 3.1 8b.
+This is the **2024-09-16** release of Shining Valiant 2 for Llama 3.1 8b.
 
-Our newest dataset improves specialist knowledge and response consistency.
+We've improved and open-sourced our new baseline [science-instruct dataset](https://huggingface.co/datasets/sequelbox/Celestia). This release features improvements in physics, chemistry, biology, and computer science.
+
+Future upgrades will continue to expand Shining Valiant's technical knowledge base.
 
 Help us and recommend Shining Valiant 2 to your friends!
 
@@ -73,9 +86,9 @@ print(outputs[0]["generated_text"][-1])
 ## The Model
 Shining Valiant 2 is built on top of Llama 3.1 8b Instruct.
 
-The current version of Shining Valiant 2 is trained mostly on our private Shining Valiant data, supplemented by [LDJnr/Pure-Dove](https://huggingface.co/datasets/LDJnr/Pure-Dove) for response flexibility.
+The current version of Shining Valiant 2 is trained on technical knowledge using [sequelbox/Celestia](https://huggingface.co/datasets/sequelbox/Celestia) and general chat capability using [sequelbox/Supernova.](https://huggingface.co/datasets/sequelbox/Supernova)
 
-Our private data adds specialist knowledge and Shining Valiant's personality: she's friendly, enthusiastic, insightful, knowledgeable, and loves to learn! Magical.
+Our private data adds specialist knowledge and Shining Valiant's personality: she's friendly, enthusiastic, insightful, knowledgeable, and loves to learn! Magical. (As a general note: we're hoping to replace and open-source this part of Shining Valiant's dataset with synthetic data soon!)
 
 
 ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/63444f2687964b331809eb55/VCJ8Fmefd8cdVhXSSxJiD.jpeg)

config.json

@@ -33,7 +33,7 @@
   "rope_theta": 500000.0,
   "tie_word_embeddings": false,
   "torch_dtype": "float32",
-  "transformers_version": "4.43.4",
+  "transformers_version": "4.44.2",
   "use_cache": true,
   "vocab_size": 128256
 }

generation_config.json

@@ -8,5 +8,5 @@
   ],
   "temperature": 0.6,
   "top_p": 0.9,
-  "transformers_version": "4.43.4"
+  "transformers_version": "4.44.2"
 }

model-00001-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b0d1ed2a26f2b4eeab0fb60d978ced49dc02f48cf15e3b673c9285362d3235d3
+oid sha256:dcebe7b4eacb57cbc4e03e60f0d4e1eec8a1471455a3fdbc953edfaca5c8763e
 size 4886466168

model-00002-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:35c1a72443bebf94e622d74a37e2422f94d5a5b75467d5f8d1e1cee97982ce72
+oid sha256:756b38e9412a00dc12d14823d48c9a71732a1c0318fd9bb48661e9589ddb9ac1
 size 4832007448

model-00003-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:51a3940aeb1dea207ab0b79f170caf808c7df03074eb2cb846f93bd2ad36e339
+oid sha256:4d3ff8801d13032241f11b23af8bf458181a87b41b3e6497cf7cc503a0469ce6
 size 4999813112

model-00004-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:465cd5f44c4439f2c32c32b9988d8b7ad2c47dae174f6c75adb921f5b1b1187c
+oid sha256:35ee4a044f0e1c92ba26c63b584ac344740d70fff1f3d86d073810bc8e610d66
 size 4999813128

model-00005-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a0eacfe5fd93fbae3df398581ccba51ff0bf304bc547b5a802ab05130d5b7541
+oid sha256:7b6123fecf735935528930e989780254f5bd5eb78b872cda5677f04479d09c25
 size 4832007496

model-00006-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4d23dc663b4bdaa81cf646143095eb021b8a730b9a563fc629eac84324532a13
+oid sha256:895b3445cc9cb423b5c8b67c289eecd411f860ea3d7255857beb8fcb8e990621
 size 4999813120

tokenizer.json

@@ -1,11 +1,6 @@
 {
   "version": "1.0",
-  "truncation": {
-    "direction": "Right",
-    "max_length": 6900,
-    "strategy": "LongestFirst",
-    "stride": 0
-  },
+  "truncation": null,
   "padding": null,
   "added_tokens": [
     {