{
 "returncode": 0,
 "stdout": "submission.py:ladder_kernel at 1.90% error: 15 timed calls, each in a fresh process\n  review flag: embedded weights? 531 numeric literals\n  review flag: 20,461 bytes, close to the 20,480-byte limit\n  NVIDIA A100-SXM4-80GB, torch 2.12.0+cu130, sandbox on\n  call  1/15: 228.284 ms, scorer's clock 231.819 ms\n  call  2/15: 209.138 ms, scorer's clock 212.611 ms\n  call  3/15: 209.992 ms, scorer's clock 213.796 ms\n  call  4/15: 221.389 ms, scorer's clock 224.792 ms\n  call  5/15: 226.730 ms, scorer's clock 230.902 ms\n  call  6/15: 222.527 ms, scorer's clock 226.133 ms\n  call  7/15: 224.765 ms, scorer's clock 230.000 ms\n  call  8/15: 227.482 ms, scorer's clock 231.154 ms\n  call  9/15: 212.272 ms, scorer's clock 216.368 ms\n  call 10/15: 227.305 ms, scorer's clock 230.851 ms\n  call 11/15: 228.007 ms, scorer's clock 231.356 ms\n  call 12/15: 226.914 ms, scorer's clock 230.325 ms\n  call 13/15: 228.448 ms, scorer's clock 231.982 ms\n  call 14/15: 227.285 ms, scorer's clock 230.433 ms\n  call 15/15: 227.424 ms, scorer's clock 231.181 ms\nMNIST 98.32% (108,154/110,000), 224.206 ms/call; hold-out (kmnist) 97.32%, 229.800 ms/call (floored by the scorer's clock); score 229.800 ms\nenergy: one more fresh process runs the method back to back on fresh MNIST draws for 20 s, between idle windows in which it is frozen\n  NVIDIA A100-SXM4-80GB: idle 72.5 W with the method frozen; telemetry reference 18.4 TFLOP/s at 9.04 J/TFLOP above idle (a healthy NVIDIA A100-SXM4-80GB reads 6-11)\n  the round trip alone: 15.9 mJ per call over 3,525 empty calls, subtracted\n  the method: 103 calls in 20.1 s, MNIST 98.29%, 190.169 ms per call, 241.7 W on average\nenergy 33029.333 mJ per call above idle\n",
 "stderr": "uards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:13:24.790000 1177 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:14:11.859000 1407 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:14:57.934000 1637 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:15:43.223000 1867 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:16:28.919000 2097 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:17:13.363000 2327 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:17:59.924000 2557 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:18:45.310000 2787 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:19:32.161000 3017 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:20:18.055000 3247 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:21:28.533000 3478 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n",
 "record": {
  "version": "mnist-a100/1.2.0 (protections of sutro-mnist-medium/3.0.0, tightened; energy column)",
  "file": "submission.py",
  "function": "ladder_kernel",
  "source_sha256": "132a5e02097ae2d8a776d0e5dd9706bb935a3d5a39ae27ffe025e299511f7b44",
  "band_bp": 190,
  "sandboxed": true,
  "holdout": "kmnist",
  "device": "NVIDIA A100-SXM4-80GB",
  "torch": "2.12.0+cu130",
  "calls": [
   {
    "dataset": "kmnist",
    "ms": 228.28440856933594,
    "parent_ms": 233.98559199999625,
    "correct": 9746,
    "total": 10000,
    "overhead_ms": 2.1660954983470475
   },
   {
    "dataset": "mnist",
    "ms": 209.13766479492188,
    "parent_ms": 215.20930999999166,
    "correct": 9825,
    "total": 10000,
    "overhead_ms": 2.598728003112967
   },
   {
    "dataset": "mnist",
    "ms": 209.99168395996094,
    "parent_ms": 216.79652800000326,
    "correct": 9823,
    "total": 10000,
    "overhead_ms": 3.000533999727054
   },
   {
    "dataset": "mnist",
    "ms": 221.3887939453125,
    "parent_ms": 227.22215199999596,
    "correct": 9816,
    "total": 10000,
    "overhead_ms": 2.429988000288972
   },
   {
    "dataset": "mnist",
    "ms": 226.72998046875,
    "parent_ms": 233.45930199999998,
    "correct": 9827,
    "total": 10000,
    "overhead_ms": 2.5572375011208806
   },
   {
    "dataset": "mnist",
    "ms": 222.52748107910156,
    "parent_ms": 228.67576800001643,
    "correct": 9830,
    "total": 10000,
    "overhead_ms": 2.5426415014683243
   },
   {
    "dataset": "mnist",
    "ms": 224.76492309570312,
    "parent_ms": 231.88917499999206,
    "correct": 9838,
    "total": 10000,
    "overhead_ms": 1.8888524982378385
   },
   {
    "dataset": "kmnist",
    "ms": 227.48159790039062,
    "parent_ms": 232.9411619999746,
    "correct": 9708,
    "total": 10000,
    "overhead_ms": 1.78730249816158
   },
   {
    "dataset": "mnist",
    "ms": 212.27212524414062,
    "parent_ms": 218.76181999999744,
    "correct": 9850,
    "total": 10000,
    "overhead_ms": 2.393692496708809
   },
   {
    "dataset": "kmnist",
    "ms": 227.3054656982422,
    "parent_ms": 233.23483500001885,
    "correct": 9735,
    "total": 10000,
    "overhead_ms": 2.3836395016894585
   },
   {
    "dataset": "mnist",
    "ms": 228.0069122314453,
    "parent_ms": 233.50207900000441,
    "correct": 9815,
    "total": 10000,
    "overhead_ms": 2.145689498955562
   },
   {
    "dataset": "kmnist",
    "ms": 226.914306640625,
    "parent_ms": 232.73919900009332,
    "correct": 9740,
    "total": 10000,
    "overhead_ms": 2.414094499447856
   },
   {
    "dataset": "mnist",
    "ms": 228.44825744628906,
    "parent_ms": 234.25215300005675,
    "correct": 9843,
    "total": 10000,
    "overhead_ms": 2.270251999453194
   },
   {
    "dataset": "mnist",
    "ms": 227.2849884033203,
    "parent_ms": 233.3942099999149,
    "correct": 9853,
    "total": 10000,
    "overhead_ms": 2.9608825020459335
   },
   {
    "dataset": "mnist",
    "ms": 227.42425537109375,
    "parent_ms": 233.4456810000347,
    "correct": 9834,
    "total": 10000,
    "overhead_ms": 2.265003501431238
   }
  ],
  "problems": [],
  "summary": "MNIST 98.32% (108,154/110,000), 224.206 ms/call; hold-out (kmnist) 97.32%, 229.800 ms/call (floored by the scorer's clock)",
  "ranked_ms": 229.79993177709852,
  "energy": {
   "mj_per_call": 33029.33347574434,
   "problems": [],
   "net_mj_before_control": 33045.242874289506,
   "control_mj_per_call": 15.909398545169395,
   "control_calls": 3525,
   "gross_mj_per_call": 47213.83495145631,
   "idle_w": 72.5326678856832,
   "active_w": 241.69976744988094,
   "calls": 103,
   "seconds": 20.12010624300001,
   "ms_median": 190.16908264160156,
   "timed_mnist_ms_median": 224.76492309570312,
   "correct": 1012434,
   "total": 1030000,
   "reference": {
    "tflops_per_s": 18.439036719824447,
    "j_per_tflop": 9.041741804237127,
    "exact": true,
    "band": [
     [
      6.0,
      11.0
     ],
     [
      15.0,
      23.0
     ]
    ]
   },
   "device": {
    "name": "NVIDIA A100-SXM4-80GB",
    "uuid": "GPU-f4250b58-b773-c0fd-8d13-0318783286f6",
    "vbios": "92.00.9E.00.03",
    "driver": "610.57.04",
    "power_limit_w": 400.0
   },
   "windows": [
    {
     "name": "idle 1",
     "seconds": 5.006858187000034,
     "joules": 366.708,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "reference",
     "seconds": 5.187771632000022,
     "joules": 1242.175,
     "matmuls": 696,
     "dim": 4096,
     "exact": true
    },
    {
     "name": "idle 2",
     "seconds": 5.01926456800004,
     "joules": 362.404,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "control",
     "seconds": 5.004889518999903,
     "joules": 419.718,
     "calls": 3525
    },
    {
     "name": "idle 3",
     "seconds": 5.048992011999985,
     "joules": 369.133,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "method",
     "seconds": 20.12010624300001,
     "joules": 4863.025,
     "calls": 103,
     "ms": [
      226.61016845703125,
      190.36160278320312,
      189.981689453125,
      189.8086395263672,
      190.8817901611328,
      190.0001220703125,
      190.02674865722656,
      189.83628845214844,
      190.95960998535156,
      190.08102416992188,
      189.87930297851562,
      189.86904907226562,
      189.83526611328125,
      189.84141540527344,
      190.87359619140625,
      189.99398803710938,
      190.29913330078125,
      189.88748168945312,
      190.29708862304688,
      189.88543701171875,
      189.92640686035156,
      189.918212890625,
      190.0298309326172,
      190.11276245117188,
      190.71693420410156,
      190.00320434570312,
      189.9735107421875,
      189.90284729003906,
      190.74867248535156,
      190.78553771972656,
      189.97862243652344,
      190.08204650878906,
      190.46400451660156,
      190.01036071777344,
      190.7711944580078,
      190.43533325195312,
      190.53875732421875,
      190.10047912597656,
      190.07078552246094,
      189.98477172851562,
      190.02777099609375,
      189.9694061279297,
      189.94586181640625,
      190.26535034179688,
      190.50189208984375,
      190.1649932861328,
      190.166015625,
      190.16806030273438,
      190.97906494140625,
      190.34214782714844,
      190.3206329345703,
      190.171142578125,
      190.48141479492188,
      190.06874084472656,
      189.9315185546875,
      190.15475463867188,
      189.92434692382812,
      190.00933837890625,
      190.67391967773438,
      190.68313598632812,
      190.3073272705078,
      190.10354614257812,
      190.08819580078125,
      190.71795654296875,
      190.39027404785156,
      190.60223388671875,
      190.10354614257812,
      190.0113983154297,
      190.7589111328125,
      190.74867248535156,
      190.06771850585938,
      189.98374938964844,
      190.53567504882812,
      190.10252380371094,
      190.69747924804688,
      190.67494201660156,
      190.4865264892578,
      190.13221740722656,
      189.97657775878906,
      189.9253692626953,
      190.0195770263672,
      190.76197814941406,
      190.455810546875,
      190.7394561767578,
      190.38925170898438,
      190.0062713623047,
      190.96678161621094,
      190.19570922851562,
      190.74252319335938,
      190.71795654296875,
      190.69541931152344,
      190.2520294189453,
      190.50802612304688,
      190.26124572753906,
      190.70156860351562,
      190.7025909423828,
      190.39231872558594,
      190.21414184570312,
      190.10047912597656,
      190.16908264160156,
      190.41075134277344,
      190.19468688964844,
      190.12197875976562
     ],
     "correct": [
      9838,
      9810,
      9817,
      9841,
      9824,
      9844,
      9834,
      9821,
      9823,
      9822,
      9817,
      9835,
      9849,
      9795,
      9829,
      9822,
      9806,
      9840,
      9842,
      9825,
      9824,
      9834,
      9844,
      9828,
      9833,
      9841,
      9851,
      9816,
      9821,
      9822,
      9824,
      9836,
      9830,
      9818,
      9803,
      9834,
      9816,
      9836,
      9843,
      9822,
      9819,
      9822,
      9804,
      9833,
      9855,
      9811,
      9823,
      9830,
      9829,
      9857,
      9845,
      9837,
      9835,
      9823,
      9841,
      9825,
      9834,
      9841,
      9838,
      9802,
      9824,
      9828,
      9833,
      9826,
      9841,
      9824,
      9823,
      9845,
      9826,
      9842,
      9830,
      9816,
      9839,
      9832,
      9804,
      9838,
      9841,
      9811,
      9825,
      9826,
      9814,
      9839,
      9852,
      9837,
      9822,
      9833,
      9844,
      9828,
      9838,
      9826,
      9841,
      9818,
      9817,
      9826,
      9828,
      9844,
      9836,
      9813,
      9826,
      9835,
      9833,
      9850,
      9846
     ]
    },
    {
     "name": "idle 4",
     "seconds": 5.029761665000024,
     "joules": 361.917,
     "utilization_max": 0,
     "contexts": 1
    }
   ]
  }
 }
}
