File size: 1,951 Bytes
d5e6e3f
 
 
 
1990840
44ca624
1990840
44ca624
1990840
44ca624
1990840
44ca624
1990840
44ca624
1990840
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
44ca624
 
1990840
44ca624
1990840
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
---
base_model:
- Gryphe/Codex-24B-Small-3.2
---
# Wot is this

Just another checkpoint, better to use the -Winton model but this is released to keep in line with being an actual OSS Finetuner. (Unlike some others who don't release datasets or checkpoints!)

This is the SFT part of the MS3.2 train ontop of Codex

Wandb: https://wandb.ai/gum1h0x/austral/artifacts/axolotl-config/config-4hspge7d/v0/files/axolotl_config_ept225f_.yml

Datasets:

```
datasets:
  - path: Delta-Vector/Hydrus-Claude-Instruct-2.7K
    type: dan-chat-advanced
  - path: Delta-Vector/Hydrus-Claude-Instruct-5K
    type: dan-chat-advanced
  - path: Delta-Vector/Orion-Shoujo-AI-Filtered-ShareGPT
    type: dan-chat-advanced
  - path: PocketDoc/Dans-Personamaxx-VN
    type: dan-chat-advanced
  - path: NewEden/LIMARP-Complexity
    type: dan-chat-advanced
  - path: NewEden/PIPPA-Mega-Filtered
    type: dan-chat-advanced
  - path: NewEden/OpenCAI-ShareGPT
    type: dan-chat-advanced
  - path: NewEden/Creative_Writing-Complexity
    type: dan-chat-advanced
  - path: NewEden/Light-Novels-Roleplay-Logs-Books-Oh-My-duplicate-turns-removed
    type: dan-chat-advanced
  - path: PocketDoc/Dans-Failuremaxx-Adventure-3
    type: dan-chat-advanced
  - path: NewEden/Books-V2-ShareGPT
    type: dan-chat-advanced
  - path: NewEden/Deepseek-V3-RP-Filtered
    type: dan-chat-advanced
  - path: NewEden/Final-Alpindale-LNs-ShareGPT
    type: dan-chat-advanced
  - path: NewEden/DeepseekRP-Filtered
    type: dan-chat-advanced
  - path: NewEden/RP-logs-V2-Experimental
    type: dan-chat-advanced
  - path: anthracite-org/kalo_opus_misc_240827
    type: dan-chat-advanced
  - path: anthracite-org/kalo_misc_part2
    type: dan-chat-advanced
  - path: NewEden/Storium-Prefixed-Clean
    type: dan-chat-advanced
  - path: Delta-Vector/Hydrus-AM-Thinking-IF
    type: dan-chat-advanced
```


TYSM to Gum1hox for sponsering the run, Trained on 1xB200 for 30 hours

https://x.com/gum1h0x