{
 "returncode": 0,
 "stdout": "submission.py:ladder_kernel at 1.90% error: 15 timed calls, each in a fresh process\n  review flag: embedded weights? 531 numeric literals\n  review flag: 20,461 bytes, close to the 20,480-byte limit\n  NVIDIA A100-SXM4-80GB, torch 2.12.0+cu130, sandbox on\n  call  1/15: 227.132 ms, scorer's clock 230.158 ms\n  call  2/15: 215.173 ms, scorer's clock 218.188 ms\n  call  3/15: 227.855 ms, scorer's clock 230.804 ms\n  call  4/15: 220.827 ms, scorer's clock 223.299 ms\n  call  5/15: 283.406 ms, scorer's clock 425.030 ms\n  call  6/15: 226.762 ms, scorer's clock 229.365 ms\n  call  7/15: 209.718 ms, scorer's clock 212.450 ms\n  call  8/15: 217.539 ms, scorer's clock 220.817 ms\n  call  9/15: 226.680 ms, scorer's clock 229.577 ms\n  call 10/15: 227.054 ms, scorer's clock 230.103 ms\n  call 11/15: 226.700 ms, scorer's clock 229.538 ms\n  call 12/15: 223.129 ms, scorer's clock 226.755 ms\n  call 13/15: 222.938 ms, scorer's clock 226.117 ms\n  call 14/15: 228.633 ms, scorer's clock 231.870 ms\n  call 15/15: 227.463 ms, scorer's clock 230.836 ms\nMNIST 98.34% (108,172/110,000), 242.864 ms/call; hold-out (kmnist) 97.42%, 226.213 ms/call (floored by the scorer's clock); score 242.864 ms\nenergy: one more fresh process runs the method back to back on fresh MNIST draws for 20 s, between idle windows in which it is frozen\n  NVIDIA A100-SXM4-80GB: idle 69.4 W with the method frozen; telemetry reference 18.3 TFLOP/s at 7.86 J/TFLOP above idle (a healthy NVIDIA A100-SXM4-80GB reads 6-11)\n  the round trip alone: 20.1 mJ per call over 2,244 empty calls, subtracted\n  the method: 102 calls in 20.2 s, MNIST 98.33%, 190.803 ms per call, 227.3 W on average\nenergy 31225.197 mJ per call above idle\n",
 "stderr": "uards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:14:07.763000 1181 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:15:01.689000 1411 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:15:49.855000 1641 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:16:38.979000 1871 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:17:28.741000 2101 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:18:19.092000 2331 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:19:08.402000 2561 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:19:55.712000 2791 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:20:48.036000 3021 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:21:36.948000 3251 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:22:51.201000 3482 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n",
 "record": {
  "version": "mnist-a100/1.2.0 (protections of sutro-mnist-medium/3.0.0, tightened; energy column)",
  "file": "submission.py",
  "function": "ladder_kernel",
  "source_sha256": "132a5e02097ae2d8a776d0e5dd9706bb935a3d5a39ae27ffe025e299511f7b44",
  "band_bp": 190,
  "sandboxed": true,
  "holdout": "kmnist",
  "device": "NVIDIA A100-SXM4-80GB",
  "torch": "2.12.0+cu130",
  "calls": [
   {
    "dataset": "mnist",
    "ms": 227.13241577148438,
    "parent_ms": 233.6358759999939,
    "correct": 9845,
    "total": 10000,
    "overhead_ms": 3.47774799713061
   },
   {
    "dataset": "kmnist",
    "ms": 215.17312622070312,
    "parent_ms": 221.4539670000022,
    "correct": 9752,
    "total": 10000,
    "overhead_ms": 3.2658469996472377
   },
   {
    "dataset": "mnist",
    "ms": 227.85536193847656,
    "parent_ms": 234.7866730000021,
    "correct": 9837,
    "total": 10000,
    "overhead_ms": 3.982251997916933
   },
   {
    "dataset": "mnist",
    "ms": 220.82662963867188,
    "parent_ms": 227.2253660000274,
    "correct": 9831,
    "total": 10000,
    "overhead_ms": 3.926312999472998
   },
   {
    "dataset": "mnist",
    "ms": 283.4063415527344,
    "parent_ms": 428.45111599996244,
    "correct": 9842,
    "total": 10000,
    "overhead_ms": 3.421084498948858
   },
   {
    "dataset": "mnist",
    "ms": 226.76173400878906,
    "parent_ms": 232.955091000008,
    "correct": 9824,
    "total": 10000,
    "overhead_ms": 3.590448998611919
   },
   {
    "dataset": "mnist",
    "ms": 209.71827697753906,
    "parent_ms": 215.80734700000903,
    "correct": 9838,
    "total": 10000,
    "overhead_ms": 3.3573805003532016
   },
   {
    "dataset": "mnist",
    "ms": 217.53855895996094,
    "parent_ms": 224.10612500004845,
    "correct": 9816,
    "total": 10000,
    "overhead_ms": 3.288936500013051
   },
   {
    "dataset": "kmnist",
    "ms": 226.6798095703125,
    "parent_ms": 233.13187399998014,
    "correct": 9721,
    "total": 10000,
    "overhead_ms": 3.554503498450231
   },
   {
    "dataset": "kmnist",
    "ms": 227.05357360839844,
    "parent_ms": 233.91657000001942,
    "correct": 9737,
    "total": 10000,
    "overhead_ms": 3.813721502078124
   },
   {
    "dataset": "mnist",
    "ms": 226.70028686523438,
    "parent_ms": 233.09421400006158,
    "correct": 9836,
    "total": 10000,
    "overhead_ms": 3.555783500027701
   },
   {
    "dataset": "mnist",
    "ms": 223.12857055664062,
    "parent_ms": 229.96807499998795,
    "correct": 9831,
    "total": 10000,
    "overhead_ms": 3.2133515007453752
   },
   {
    "dataset": "mnist",
    "ms": 222.9381103515625,
    "parent_ms": 229.77953100007653,
    "correct": 9830,
    "total": 10000,
    "overhead_ms": 3.662676500984162
   },
   {
    "dataset": "kmnist",
    "ms": 228.63258361816406,
    "parent_ms": 235.38825800005725,
    "correct": 9760,
    "total": 10000,
    "overhead_ms": 3.518027000613074
   },
   {
    "dataset": "mnist",
    "ms": 227.46316528320312,
    "parent_ms": 234.3645529999776,
    "correct": 9842,
    "total": 10000,
    "overhead_ms": 3.5280920026002605
   }
  ],
  "problems": [],
  "summary": "MNIST 98.34% (108,172/110,000), 242.864 ms/call; hold-out (kmnist) 97.42%, 226.213 ms/call (floored by the scorer's clock)",
  "ranked_ms": 242.86386843125715,
  "energy": {
   "mj_per_call": 31225.196570207045,
   "problems": [],
   "net_mj_before_control": 31245.339236393385,
   "control_mj_per_call": 20.142666186341483,
   "control_calls": 2244,
   "gross_mj_per_call": 44985.294117647056,
   "idle_w": 69.43515709721026,
   "active_w": 227.33415001127204,
   "calls": 102,
   "seconds": 20.183945085999994,
   "ms_median": 190.80345153808594,
   "timed_mnist_ms_median": 226.70028686523438,
   "correct": 1002946,
   "total": 1020000,
   "reference": {
    "tflops_per_s": 18.315767093341996,
    "j_per_tflop": 7.864810869763519,
    "exact": true,
    "band": [
     [
      6.0,
      11.0
     ],
     [
      15.0,
      23.0
     ]
    ]
   },
   "device": {
    "name": "NVIDIA A100-SXM4-80GB",
    "uuid": "GPU-76d99f25-6bb9-148e-e3cd-7b75bac6e782",
    "vbios": "92.00.45.00.0E",
    "driver": "610.57.04",
    "power_limit_w": 400.0
   },
   "windows": [
    {
     "name": "idle 1",
     "seconds": 5.007298509000066,
     "joules": 347.089,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "reference",
     "seconds": 5.162655733000065,
     "joules": 1103.102,
     "matmuls": 688,
     "dim": 4096,
     "exact": true
    },
    {
     "name": "idle 2",
     "seconds": 5.005072306999978,
     "joules": 349.966,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "control",
     "seconds": 5.0047284839999975,
     "joules": 395.199,
     "calls": 2244
    },
    {
     "name": "idle 3",
     "seconds": 5.0791332969999985,
     "joules": 355.26,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "method",
     "seconds": 20.183945085999994,
     "joules": 4588.5,
     "calls": 102,
     "ms": [
      219.83436584472656,
      197.85113525390625,
      190.92274475097656,
      190.49778747558594,
      190.69644165039062,
      190.55718994140625,
      190.69337463378906,
      335.2412109375,
      190.53465270996094,
      190.26637268066406,
      190.5121307373047,
      190.3994903564453,
      190.94937133789062,
      190.7210235595703,
      190.63296508789062,
      190.80703735351562,
      190.94732666015625,
      190.887939453125,
      190.70054626464844,
      190.59507751464844,
      190.603271484375,
      190.6360321044922,
      190.8469696044922,
      190.71693420410156,
      190.53363037109375,
      190.5418243408203,
      190.77734375,
      190.87770080566406,
      190.86642456054688,
      190.64627075195312,
      190.57254028320312,
      190.59405517578125,
      190.9872589111328,
      190.76710510253906,
      190.8387908935547,
      190.8633575439453,
      190.7589111328125,
      190.81216430664062,
      191.04051208496094,
      191.0118408203125,
      190.8889617919922,
      190.83981323242188,
      190.71795654296875,
      190.67800903320312,
      190.78041076660156,
      190.58277893066406,
      190.7906494140625,
      190.60531616210938,
      190.98214721679688,
      190.92172241210938,
      190.67904663085938,
      190.9739532470703,
      191.1173095703125,
      190.9063720703125,
      190.96371459960938,
      190.87155151367188,
      191.00364685058594,
      190.9606475830078,
      191.05690002441406,
      191.2473602294922,
      190.85107421875,
      190.60633850097656,
      190.67698669433594,
      190.5182647705078,
      190.91456604003906,
      190.79986572265625,
      190.81727600097656,
      190.70669555664062,
      190.8633575439453,
      190.76197814941406,
      191.0302734375,
      190.77427673339844,
      190.6728973388672,
      190.69747924804688,
      191.0179901123047,
      191.07737731933594,
      190.8326416015625,
      190.99034118652344,
      190.86131286621094,
      190.82546997070312,
      190.92787170410156,
      190.8152313232422,
      190.7415008544922,
      190.7415008544922,
      190.79270935058594,
      190.91661071777344,
      190.7415008544922,
      190.8828125,
      190.64627075195312,
      190.97804260253906,
      191.04666137695312,
      191.02105712890625,
      190.74354553222656,
      190.68826293945312,
      190.635009765625,
      190.5991668701172,
      190.8633575439453,
      191.0425567626953,
      190.59507751464844,
      190.635009765625,
      190.28480529785156,
      191.08966064453125
     ],
     "correct": [
      9842,
      9844,
      9837,
      9833,
      9846,
      9822,
      9819,
      9826,
      9832,
      9825,
      9831,
      9817,
      9857,
      9821,
      9832,
      9819,
      9844,
      9847,
      9846,
      9839,
      9857,
      9840,
      9810,
      9783,
      9825,
      9824,
      9843,
      9839,
      9823,
      9818,
      9833,
      9828,
      9838,
      9829,
      9841,
      9827,
      9838,
      9832,
      9830,
      9817,
      9829,
      9831,
      9840,
      9836,
      9854,
      9818,
      9831,
      9827,
      9830,
      9841,
      9850,
      9832,
      9849,
      9834,
      9839,
      9833,
      9831,
      9845,
      9845,
      9830,
      9837,
      9843,
      9835,
      9819,
      9844,
      9806,
      9844,
      9827,
      9836,
      9831,
      9821,
      9845,
      9815,
      9834,
      9841,
      9821,
      9831,
      9845,
      9842,
      9789,
      9835,
      9836,
      9857,
      9832,
      9841,
      9828,
      9831,
      9837,
      9842,
      9839,
      9848,
      9836,
      9843,
      9822,
      9838,
      9788,
      9828,
      9841,
      9843,
      9838,
      9834,
      9824
     ]
    },
    {
     "name": "idle 4",
     "seconds": 5.309399410000083,
     "joules": 365.952,
     "utilization_max": 0,
     "contexts": 1
    }
   ]
  }
 }
}
