pool archive signal about

© 2026 sonicwatersonicwater

archive signal rss api · mcp media kit privacy? keys

0:00 / 4:56

emergence

136 bpm4:56Oct 26, 2026Δ 4 310 MSW-008.15experiment · generative untrained transformers

at the same tempo

mixture of experts7A · 136 The Other Side4B · 136 Lanternfish4A · 136 Cold Light2B · 136 Sun Over the Ridge7A · 136 Glass Teeth9A · 136

from the experiment

generative untrained transformers

attention heads138 bpm · 11B4:38
xavier uniform118 bpm5:25
latent space134 bpm · 11B5:00
dropout140 bpm · 7A4:34
masked tokens100 bpm4:48
residual stream124 bpm · 12A4:07
exploding gradients86 bpm · 12A3:54
emergent abilities165 bpm · 12B4:40
vanishing gradient132 bpm · 9A4:50
grokking112 bpm · 4B5:25
mixture of experts136 bpm · 7A4:42
latent walk122 bpm · 12B4:11
backpropagation164 bpm · 4A2:51
positional encoding134 bpm · 9A6:10
emergence136 bpm4:56