sutro-problems

Ladder network on learned-metric inputs, with a kernel teacher: difficulty 4

Entrant: @spartanhaden.

Three sandboxed Modal A100-80GB runs of the unchanged scorer (mnist-a100/1.2.0, run_modal.py --difficulty 4 --runs 3) all passed.

Run GPU MNIST error Margin (labels) Worst draw Hold-out Ranked ms mJ above idle
1 A100-SXM4-80GB 2.108% +211 2.38% Fashion 88.50% 575.435 69,998
2 A100-SXM4-80GB 2.082% +240 2.26% KMNIST 96.98% 579.286 67,356
3 A100-SXM4-80GB 2.140% +176 2.39% Fashion 88.67% 581.317 64,350

Compared with the current record (2,882.5 ms, 400,682 mJ; @SethTS, loss-sampled Ladder; open PR #114 reports 985 ms), this entry is 5.0× faster.

submission.py is 20,451 bytes with SHA-256 f4c69bf486197cd00721320a90dbd644ad734b3371e65ea2fff498d9304ebbdc, identical to source_sha256 in all three records. It passes check_source. evidence/official/manifest.json lists the hash of every file.

Method

Credits

Ladder network of Rasmus et al. 2015, following @SethTS’s Ladder entries (batch 1,000, bottom denoising cost, loss-proportional labelled sampling), in our own plain-PyTorch implementation. The kernel teacher builds on @islamborghini’s kernel-pcg entry.

Notes

Independent maintainer verification — 2026-10-12

All three initial fresh energy-enabled sandboxed Modal A100-80GB runs passed individually. Source review found no qualification blocker. All 45 timed calls and complete energy windows were reconstructed with the unchanged canonical scorer; three distinct GPU UUIDs were recorded. No failed run was replaced or learner repair made.

The reviewer medians are 580.093770 ms and 63113.166019 mJ above idle per call. The leaderboard uses this independent set; the author source and original evidence above are retained.

Reviewer run Correct MNIST error Ranked ms Above-idle mJ
1 107,643/110,000 2.142727% 580.093770 62922.126045
2 107,580/110,000 2.200000% 578.657028 70019.835702
3 107,738/110,000 2.056364% 580.305271 63113.166019

Raw records and manifest and canonical reconstruction are retained. Learner SHA-256: f4c69bf486197cd00721320a90dbd644ad734b3371e65ea2fff498d9304ebbdc. Energy excludes host energy and first-call compilation.

Reproduce from mnist-a100/:

python run_modal.py submissions/ladder-kernel-d4-20261012/submission.py:ladder_kernel --difficulty 4 --runs 3 --json /tmp/pr121-d4-verification