ivnle commited on
Commit
4ccfaf4
·
verified ·
1 Parent(s): 0af81b0

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +17 -13
README.md CHANGED
@@ -20,21 +20,25 @@ Ivan Lee, Cheng Yang, Taylor Berg-Kirkpatrick
20
 
21
  ## Available Checkpoints
22
 
23
- | Checkpoint | Objective | Hybrid Tokens | Training | PPL |
24
- |------------|-----------|---------------|----------|-----|
25
- | `vision_base_hybrid0_reconstruction` | Reconstruction | 0 | Direct | 1.03 |
26
- | `vision_base_hybrid0_lm_direct` | Language Modeling | 0 | Direct (no recon init) | 5.08 |
27
- | `vision_base_hybrid0_lm_recon_init` | Language Modeling | 0 | Initialized from reconstruction | 5.06 |
28
 
29
- ### Naming Convention
30
 
31
- `{regime}_{size}_{hybrid}_[reconstruction|lm]_[direct|recon_init]`
 
 
32
 
33
- - **regime**: vision, conv1d_residual, meanpool, text
34
- - **size**: tiny, small, base, large (for vision); compression target (for others)
35
- - **hybrid**: hybrid0 (pure vision/compression) or hybrid100 (100 text tokens + vision)
36
- - **objective**: reconstruction or lm (language modeling)
37
- - **training**: direct (trained from scratch) or recon_init (initialized from reconstruction checkpoint)
 
 
38
 
39
  ## Model Details
40
 
@@ -51,7 +55,7 @@ from huggingface_hub import hf_hub_download
51
  # Download a specific checkpoint
52
  checkpoint_path = hf_hub_download(
53
  repo_id="ivnle/bad-autoencoding",
54
- filename="vision_base_hybrid0_lm_direct/model.pt",
55
  repo_type="model"
56
  )
57
  ```
 
20
 
21
  ## Available Checkpoints
22
 
23
+ | Checkpoint | Objective | Hybrid | Training | PPL |
24
+ |------------|-----------|--------|----------|-----|
25
+ | `vision_base_h0_recon` | Reconstruction | 0 | - | 1.03 |
26
+ | `vision_base_h0_lm` | LM | 0 | Direct | 5.08 |
27
+ | `vision_base_h0_lm_recon-init` | LM | 0 | From reconstruction | 5.06 |
28
 
29
+ ## Naming Convention
30
 
31
+ ```
32
+ {regime}_{config}_h{N}_{objective}[_recon-init]
33
+ ```
34
 
35
+ | Field | Values | Description |
36
+ |-------|--------|-------------|
37
+ | regime | vision, conv1d, meanpool, text | Compression architecture |
38
+ | config | base/small/tiny/large, t500/t250, w10s10, ctx525 | Regime-specific config |
39
+ | h{N} | h0, h100 | Hybrid text tokens (0 = pure vision) |
40
+ | objective | recon, lm | Training objective |
41
+ | recon-init | (optional) | LM initialized from reconstruction checkpoint |
42
 
43
  ## Model Details
44
 
 
55
  # Download a specific checkpoint
56
  checkpoint_path = hf_hub_download(
57
  repo_id="ivnle/bad-autoencoding",
58
+ filename="vision_base_h0_lm/model.pt",
59
  repo_type="model"
60
  )
61
  ```