~/transformer debugger // arcade // advanced
Transformer Debugger.
A tiny transformer is training badly. Read the telemetry, find the bug.
attention · masking · normalization · gradients
all games
loading weights…
~/transformer debugger // arcade // advanced
A tiny transformer is training badly. Read the telemetry, find the bug.
attention · masking · normalization · gradients
loading weights…