sonicwater
pool
archive
signal
about
esc · surface
0:00 / 6:10
the pool
positional encoding
134 bpm
9A
E minor
6:10
Oct 26, 2026
Δ 4 900 M
SW-008.11
experiment · generative untrained transformers
Surface
lens
ripple
mixes well with
Marine Snow
9A · 140
Hoarfrost
8A · 138
Nqrsvl
9B · 132
Glass Teeth
9A · 136
from the experiment
generative untrained transformers
1
attention heads
138 bpm · 11B
4:38
2
xavier uniform
118 bpm
5:25
3
masked tokens
100 bpm
4:48
4
residual stream
124 bpm · 12A
4:07
5
exploding gradients
86 bpm · 12A
3:54
6
emergent abilities
165 bpm · 12B
4:40
7
grokking
112 bpm · 4B
5:25
8
mixture of experts
136 bpm · 7A
4:42
9
latent walk
122 bpm · 12B
4:11
10
backpropagation
164 bpm · 4A
2:51
11
positional encoding
134 bpm · 9A
6:10