ivnle commited on
Commit
f4927e9
·
verified ·
1 Parent(s): 9a7b870

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +16 -6
README.md CHANGED
@@ -20,11 +20,21 @@ Ivan Lee, Cheng Yang, Taylor Berg-Kirkpatrick
20
 
21
  ## Available Checkpoints
22
 
23
- | Checkpoint | Objective | Training | PPL |
24
- |------------|-----------|----------|-----|
25
- | `vision_base_reconstruction` | Reconstruction | Direct | 1.03 |
26
- | `vision_base_lm_direct` | Language Modeling | Direct (no recon init) | 5.08 |
27
- | `vision_base_lm_recon_init` | Language Modeling | Initialized from reconstruction | 5.06 |
 
 
 
 
 
 
 
 
 
 
28
 
29
  ## Model Details
30
 
@@ -41,7 +51,7 @@ from huggingface_hub import hf_hub_download
41
  # Download a specific checkpoint
42
  checkpoint_path = hf_hub_download(
43
  repo_id="ivnle/bad-autoencoding",
44
- filename="vision_base_lm_direct/model.pt",
45
  repo_type="model"
46
  )
47
  ```
 
20
 
21
  ## Available Checkpoints
22
 
23
+ | Checkpoint | Objective | Hybrid Tokens | Training | PPL |
24
+ |------------|-----------|---------------|----------|-----|
25
+ | `vision_base_hybrid0_reconstruction` | Reconstruction | 0 | Direct | 1.03 |
26
+ | `vision_base_hybrid0_lm_direct` | Language Modeling | 0 | Direct (no recon init) | 5.08 |
27
+ | `vision_base_hybrid0_lm_recon_init` | Language Modeling | 0 | Initialized from reconstruction | 5.06 |
28
+
29
+ ### Naming Convention
30
+
31
+ `{regime}_{size}_{hybrid}_[reconstruction|lm]_[direct|recon_init]`
32
+
33
+ - **regime**: vision, conv1d_residual, meanpool, text
34
+ - **size**: tiny, small, base, large (for vision); compression target (for others)
35
+ - **hybrid**: hybrid0 (pure vision/compression) or hybrid100 (100 text tokens + vision)
36
+ - **objective**: reconstruction or lm (language modeling)
37
+ - **training**: direct (trained from scratch) or recon_init (initialized from reconstruction checkpoint)
38
 
39
  ## Model Details
40
 
 
51
  # Download a specific checkpoint
52
  checkpoint_path = hf_hub_download(
53
  repo_id="ivnle/bad-autoencoding",
54
+ filename="vision_base_hybrid0_lm_direct/model.pt",
55
  repo_type="model"
56
  )
57
  ```