AbstractPhil commited on
Commit
24fe2e9
·
verified ·
1 Parent(s): 6d745f7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -13,7 +13,10 @@ license: mit
13
  # Overcooked and refactored
14
 
15
  I cooked an incorrect cross-attention mechanism based version where the clip_l was learning from the clip_g.
16
- This next version will have correctly decoupled behaviors and the correct cantor cross-attention formula
 
 
 
17
 
18
  Apologies for the incorrect formulas.
19
 
 
13
  # Overcooked and refactored
14
 
15
  I cooked an incorrect cross-attention mechanism based version where the clip_l was learning from the clip_g.
16
+ This next version will have correctly decoupled behaviors and the correct cantor cross-attention formula.
17
+ The simple logistics outcome is latents modified by invalid projections - not even cantor - and the representations
18
+ housing the incorrect behavior towards the t5_xl. This version essentially weighted 20/60/5% reconstruction accuracy; L/G/T5.
19
+ This means that it failed for obvious reasons. The t5 is supposed to come out different, but the L and G are supposed to be useful.
20
 
21
  Apologies for the incorrect formulas.
22