Upload folder using huggingface_hub
Browse files- .gitattributes +9 -35
- Mistral-7B-Instruct-v0.2-Neural-Story-Q3_K_L.gguf +3 -0
- Mistral-7B-Instruct-v0.2-Neural-Story-Q3_K_M.gguf +3 -0
- Mistral-7B-Instruct-v0.2-Neural-Story-Q3_K_S.gguf +3 -0
- Mistral-7B-Instruct-v0.2-Neural-Story-Q4_K_M.gguf +3 -0
- Mistral-7B-Instruct-v0.2-Neural-Story-Q4_K_S.gguf +3 -0
- Mistral-7B-Instruct-v0.2-Neural-Story-Q5_K_M.gguf +3 -0
- Mistral-7B-Instruct-v0.2-Neural-Story-Q5_K_S.gguf +3 -0
- Mistral-7B-Instruct-v0.2-Neural-Story-Q6_K.gguf +3 -0
- Mistral-7B-Instruct-v0.2-Neural-Story-Q8_0.gguf +3 -0
- README.md +67 -0
    	
        .gitattributes
    CHANGED
    
    | @@ -1,35 +1,9 @@ | |
| 1 | 
            -
             | 
| 2 | 
            -
             | 
| 3 | 
            -
             | 
| 4 | 
            -
             | 
| 5 | 
            -
             | 
| 6 | 
            -
             | 
| 7 | 
            -
             | 
| 8 | 
            -
             | 
| 9 | 
            -
             | 
| 10 | 
            -
            *.lfs.* filter=lfs diff=lfs merge=lfs -text
         | 
| 11 | 
            -
            *.mlmodel filter=lfs diff=lfs merge=lfs -text
         | 
| 12 | 
            -
            *.model filter=lfs diff=lfs merge=lfs -text
         | 
| 13 | 
            -
            *.msgpack filter=lfs diff=lfs merge=lfs -text
         | 
| 14 | 
            -
            *.npy filter=lfs diff=lfs merge=lfs -text
         | 
| 15 | 
            -
            *.npz filter=lfs diff=lfs merge=lfs -text
         | 
| 16 | 
            -
            *.onnx filter=lfs diff=lfs merge=lfs -text
         | 
| 17 | 
            -
            *.ot filter=lfs diff=lfs merge=lfs -text
         | 
| 18 | 
            -
            *.parquet filter=lfs diff=lfs merge=lfs -text
         | 
| 19 | 
            -
            *.pb filter=lfs diff=lfs merge=lfs -text
         | 
| 20 | 
            -
            *.pickle filter=lfs diff=lfs merge=lfs -text
         | 
| 21 | 
            -
            *.pkl filter=lfs diff=lfs merge=lfs -text
         | 
| 22 | 
            -
            *.pt filter=lfs diff=lfs merge=lfs -text
         | 
| 23 | 
            -
            *.pth filter=lfs diff=lfs merge=lfs -text
         | 
| 24 | 
            -
            *.rar filter=lfs diff=lfs merge=lfs -text
         | 
| 25 | 
            -
            *.safetensors filter=lfs diff=lfs merge=lfs -text
         | 
| 26 | 
            -
            saved_model/**/* filter=lfs diff=lfs merge=lfs -text
         | 
| 27 | 
            -
            *.tar.* filter=lfs diff=lfs merge=lfs -text
         | 
| 28 | 
            -
            *.tar filter=lfs diff=lfs merge=lfs -text
         | 
| 29 | 
            -
            *.tflite filter=lfs diff=lfs merge=lfs -text
         | 
| 30 | 
            -
            *.tgz filter=lfs diff=lfs merge=lfs -text
         | 
| 31 | 
            -
            *.wasm filter=lfs diff=lfs merge=lfs -text
         | 
| 32 | 
            -
            *.xz filter=lfs diff=lfs merge=lfs -text
         | 
| 33 | 
            -
            *.zip filter=lfs diff=lfs merge=lfs -text
         | 
| 34 | 
            -
            *.zst filter=lfs diff=lfs merge=lfs -text
         | 
| 35 | 
            -
            *tfevents* filter=lfs diff=lfs merge=lfs -text
         | 
|  | |
| 1 | 
            +
            Mistral-7B-Instruct-v0.2-Neural-Story-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
         | 
| 2 | 
            +
            Mistral-7B-Instruct-v0.2-Neural-Story-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
         | 
| 3 | 
            +
            Mistral-7B-Instruct-v0.2-Neural-Story-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
         | 
| 4 | 
            +
            Mistral-7B-Instruct-v0.2-Neural-Story-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
         | 
| 5 | 
            +
            Mistral-7B-Instruct-v0.2-Neural-Story-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
         | 
| 6 | 
            +
            Mistral-7B-Instruct-v0.2-Neural-Story-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
         | 
| 7 | 
            +
            Mistral-7B-Instruct-v0.2-Neural-Story-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
         | 
| 8 | 
            +
            Mistral-7B-Instruct-v0.2-Neural-Story-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
         | 
| 9 | 
            +
            Mistral-7B-Instruct-v0.2-Neural-Story-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
         | 
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | 
    	
        Mistral-7B-Instruct-v0.2-Neural-Story-Q3_K_L.gguf
    ADDED
    
    | @@ -0,0 +1,3 @@ | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:aeb92d1c3fc5fc03da33c80441ff819e47db89ec3231f7c6693dbc1727f21ddd
         | 
| 3 | 
            +
            size 3822024864
         | 
    	
        Mistral-7B-Instruct-v0.2-Neural-Story-Q3_K_M.gguf
    ADDED
    
    | @@ -0,0 +1,3 @@ | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:9d4abaef7c666375c6915c0b673ef243df8b1c749e87d490745e7fb736ceb7ba
         | 
| 3 | 
            +
            size 3518986400
         | 
    	
        Mistral-7B-Instruct-v0.2-Neural-Story-Q3_K_S.gguf
    ADDED
    
    | @@ -0,0 +1,3 @@ | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:2a77c8deb78fad2e7bcc427b95fa00d41c814931954e7ab5ac2a07cc290a526c
         | 
| 3 | 
            +
            size 3164567712
         | 
    	
        Mistral-7B-Instruct-v0.2-Neural-Story-Q4_K_M.gguf
    ADDED
    
    | @@ -0,0 +1,3 @@ | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:a9c5e61f31da2bcbab4e1887e466cc833e8f90a032dc8f75676a3bf60b6cac5a
         | 
| 3 | 
            +
            size 4368439456
         | 
    	
        Mistral-7B-Instruct-v0.2-Neural-Story-Q4_K_S.gguf
    ADDED
    
    | @@ -0,0 +1,3 @@ | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:cf6fffc06460acc0bd760c469387d8e323cdfc9ea494bcb58c25ae2daa84b7b2
         | 
| 3 | 
            +
            size 4140374176
         | 
    	
        Mistral-7B-Instruct-v0.2-Neural-Story-Q5_K_M.gguf
    ADDED
    
    | @@ -0,0 +1,3 @@ | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:b8875e6cfa268d9d5fe6d90bbac1903f7a9ba8391b7b12381f775a305beab1d3
         | 
| 3 | 
            +
            size 5131409568
         | 
    	
        Mistral-7B-Instruct-v0.2-Neural-Story-Q5_K_S.gguf
    ADDED
    
    | @@ -0,0 +1,3 @@ | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:5df580a1aacaabc5a264369e62ed94f3aaed893564af966266957ffe9dd06b5c
         | 
| 3 | 
            +
            size 4997716128
         | 
    	
        Mistral-7B-Instruct-v0.2-Neural-Story-Q6_K.gguf
    ADDED
    
    | @@ -0,0 +1,3 @@ | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:8c037be147c7d7cedb57ae85a42e421611f2d0bd697a50e8372ade52f245d925
         | 
| 3 | 
            +
            size 5942065312
         | 
    	
        Mistral-7B-Instruct-v0.2-Neural-Story-Q8_0.gguf
    ADDED
    
    | @@ -0,0 +1,3 @@ | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:71aaa5bd31f8b9d229f0019701d30f5c3d70112880b892432acb6791bafc4dfc
         | 
| 3 | 
            +
            size 7695857824
         | 
    	
        README.md
    ADDED
    
    | @@ -0,0 +1,67 @@ | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            ---
         | 
| 2 | 
            +
            license: apache-2.0
         | 
| 3 | 
            +
            base_model: mistralai/Mistral-7B-Instruct-v0.2
         | 
| 4 | 
            +
            datasets:
         | 
| 5 | 
            +
            - NeuralNovel/Neural-Story-v1
         | 
| 6 | 
            +
            library_name: transformers
         | 
| 7 | 
            +
            inference: false
         | 
| 8 | 
            +
            ---
         | 
| 9 | 
            +
             | 
| 10 | 
            +
            
         | 
| 11 | 
            +
            # NeuralNovel/Mistral-7B-Instruct-v0.2-Neural-Story
         | 
| 12 | 
            +
             | 
| 13 | 
            +
             | 
| 14 | 
            +
             | 
| 15 | 
            +
            The **Mistral-7B-Instruct-v0.2-Neural-Story** model, developed by NeuralNovel and funded by Techmind, is a language model finetuned from Mistral-7B-Instruct-v0.2.
         | 
| 16 | 
            +
             | 
| 17 | 
            +
            Designed to generate instructive and narrative text, with a specific focus on storytelling.
         | 
| 18 | 
            +
            This fine-tune has been tailored to provide detailed and creative responses in the context of narrative and optimised for short story telling.
         | 
| 19 | 
            +
             | 
| 20 | 
            +
            Based on mistralAI, with apache-2.0 license, suitable for commercial or non-commercial use.
         | 
| 21 | 
            +
             | 
| 22 | 
            +
            ### Data-set
         | 
| 23 | 
            +
            The model was finetuned using the Neural-Story-v1 dataset.
         | 
| 24 | 
            +
             | 
| 25 | 
            +
            ### Benchmark
         | 
| 26 | 
            +
            | Metric                | Value                     |
         | 
| 27 | 
            +
            |-----------------------|---------------------------|
         | 
| 28 | 
            +
            | Avg.                  | **64.96**   |
         | 
| 29 | 
            +
            | ARC          | 64.08          |
         | 
| 30 | 
            +
            | HellaSwag    | **66.89**   |
         | 
| 31 | 
            +
            | MMLU         | 60.67         |
         | 
| 32 | 
            +
            | TruthfulQA    | 66.89   |
         | 
| 33 | 
            +
            | Winogrande    | **75.85**   |
         | 
| 34 | 
            +
            | GSM8K         | 38.29        |
         | 
| 35 | 
            +
             | 
| 36 | 
            +
            Evaluated on **HuggingFaceH4/open_llm_leaderboard**
         | 
| 37 | 
            +
             | 
| 38 | 
            +
            ### Summary
         | 
| 39 | 
            +
             | 
| 40 | 
            +
            Fine-tuned with the intention of generating creative and narrative text, making it more suitable for creative writing prompts and storytelling.
         | 
| 41 | 
            +
             | 
| 42 | 
            +
            #### Out-of-Scope Use
         | 
| 43 | 
            +
             | 
| 44 | 
            +
            The model may not perform well in scenarios unrelated to instructive and narrative text generation. Misuse or applications outside its designed scope may result in suboptimal outcomes.
         | 
| 45 | 
            +
             | 
| 46 | 
            +
            ### Bias, Risks, and Limitations
         | 
| 47 | 
            +
             | 
| 48 | 
            +
            The model may exhibit biases or limitations inherent in the training data. It is essential to consider these factors when deploying the model to avoid unintended consequences.
         | 
| 49 | 
            +
             | 
| 50 | 
            +
            While the Neural-Story-v0.1 dataset serves as an excellent starting point for testing language models, users are advised to exercise caution, as there might be some inherent genre or writing bias.
         | 
| 51 | 
            +
             | 
| 52 | 
            +
            ### Hardware and Training
         | 
| 53 | 
            +
             | 
| 54 | 
            +
            Trained using NVIDIA Tesla T40 24 GB. 
         | 
| 55 | 
            +
             | 
| 56 | 
            +
            ```
         | 
| 57 | 
            +
             | 
| 58 | 
            +
              n_epochs = 3,
         | 
| 59 | 
            +
              n_checkpoints = 3,
         | 
| 60 | 
            +
              batch_size = 12,
         | 
| 61 | 
            +
              learning_rate = 1e-5,
         | 
| 62 | 
            +
             | 
| 63 | 
            +
             | 
| 64 | 
            +
             | 
| 65 | 
            +
            ```
         | 
| 66 | 
            +
             | 
| 67 | 
            +
            *Sincere appreciation to Techmind for their generous sponsorship.*
         |