Update README.md
Browse files
README.md
CHANGED
|
@@ -13,7 +13,10 @@ license: mit
|
|
| 13 |
# Overcooked and refactored
|
| 14 |
|
| 15 |
I cooked an incorrect cross-attention mechanism based version where the clip_l was learning from the clip_g.
|
| 16 |
-
This next version will have correctly decoupled behaviors and the correct cantor cross-attention formula
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
Apologies for the incorrect formulas.
|
| 19 |
|
|
|
|
| 13 |
# Overcooked and refactored
|
| 14 |
|
| 15 |
I cooked an incorrect cross-attention mechanism based version where the clip_l was learning from the clip_g.
|
| 16 |
+
This next version will have correctly decoupled behaviors and the correct cantor cross-attention formula.
|
| 17 |
+
The simple logistics outcome is latents modified by invalid projections - not even cantor - and the representations
|
| 18 |
+
housing the incorrect behavior towards the t5_xl. This version essentially weighted 20/60/5% reconstruction accuracy; L/G/T5.
|
| 19 |
+
This means that it failed for obvious reasons. The t5 is supposed to come out different, but the L and G are supposed to be useful.
|
| 20 |
|
| 21 |
Apologies for the incorrect formulas.
|
| 22 |
|