{
 "returncode": 0,
 "stdout": "submission.py:ladder_kernel at 1.90% error: 15 timed calls, each in a fresh process\n  review flag: embedded weights? 531 numeric literals\n  review flag: 20,461 bytes, close to the 20,480-byte limit\n  NVIDIA A100-SXM4-80GB, torch 2.12.0+cu130, sandbox on\n  call  1/15: 209.969 ms, scorer's clock 214.150 ms\n  call  2/15: 212.520 ms, scorer's clock 219.578 ms\n  call  3/15: 213.776 ms, scorer's clock 218.660 ms\n  call  4/15: 228.086 ms, scorer's clock 230.008 ms\n  call  5/15: 229.278 ms, scorer's clock 233.453 ms\n  call  6/15: 233.439 ms, scorer's clock 240.531 ms\n  call  7/15: 224.691 ms, scorer's clock 228.097 ms\n  call  8/15: 224.724 ms, scorer's clock 228.073 ms\n  call  9/15: 231.051 ms, scorer's clock 239.057 ms\n  call 10/15: 227.893 ms, scorer's clock 232.231 ms\n  call 11/15: 218.610 ms, scorer's clock 225.148 ms\n  call 12/15: 229.871 ms, scorer's clock 237.780 ms\n  call 13/15: 229.668 ms, scorer's clock 233.156 ms\n  call 14/15: 225.231 ms, scorer's clock 228.827 ms\n  call 15/15: 209.712 ms, scorer's clock 213.140 ms\nMNIST 98.28% (108,105/110,000), 228.705 ms/call; hold-out (fashion) 88.72%, 221.973 ms/call (floored by the scorer's clock); score 228.705 ms\nenergy: one more fresh process runs the method back to back on fresh MNIST draws for 20 s, between idle windows in which it is frozen\n  NVIDIA A100-SXM4-80GB: idle 70.2 W with the method frozen; telemetry reference 18.4 TFLOP/s at 8.20 J/TFLOP above idle (a healthy NVIDIA A100-SXM4-80GB reads 6-11)\n  the round trip alone: 11.2 mJ per call over 2,446 empty calls, subtracted\n  the method: 102 calls in 20.0 s, MNIST 98.31%, 189.979 ms per call, 230.7 W on average\nenergy 31490.036 mJ per call above idle\n",
 "stderr": "uards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:14:10.749000 1177 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:14:58.647000 1407 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:15:45.713000 1637 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:16:36.636000 1867 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:17:40.304000 2097 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:18:41.462000 2327 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:19:40.126000 2557 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:20:37.661000 2787 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:21:27.050000 3017 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:22:16.191000 3247 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\nW1102 02:23:29.209000 3478 site-packages/torch/_logging/_internal.py:1311] [1/0] Profiler record function <class 'torch.autograd.profiler.record_function'> will be ignored\n/usr/local/lib/python3.13/site-packages/torch/_dynamo/guards.py:1317: RuntimeWarning: Guards may run slower on Python 3.13.0. Consider upgrading to Python 3.13.1+.\n  warnings.warn(\n",
 "record": {
  "version": "mnist-a100/1.2.0 (protections of sutro-mnist-medium/3.0.0, tightened; energy column)",
  "file": "submission.py",
  "function": "ladder_kernel",
  "source_sha256": "132a5e02097ae2d8a776d0e5dd9706bb935a3d5a39ae27ffe025e299511f7b44",
  "band_bp": 190,
  "sandboxed": true,
  "holdout": "fashion",
  "device": "NVIDIA A100-SXM4-80GB",
  "torch": "2.12.0+cu130",
  "calls": [
   {
    "dataset": "fashion",
    "ms": 209.96914672851562,
    "parent_ms": 216.30510300000338,
    "correct": 8889,
    "total": 10000,
    "overhead_ms": 2.1551634983471395
   },
   {
    "dataset": "mnist",
    "ms": 212.5199432373047,
    "parent_ms": 222.1265809999977,
    "correct": 9814,
    "total": 10000,
    "overhead_ms": 2.5490515032850283
   },
   {
    "dataset": "mnist",
    "ms": 213.77638244628906,
    "parent_ms": 223.45000800001458,
    "correct": 9832,
    "total": 10000,
    "overhead_ms": 4.789903497118587
   },
   {
    "dataset": "mnist",
    "ms": 228.08575439453125,
    "parent_ms": 233.75824300001113,
    "correct": 9819,
    "total": 10000,
    "overhead_ms": 3.750307496859932
   },
   {
    "dataset": "mnist",
    "ms": 229.27769470214844,
    "parent_ms": 235.69837799999505,
    "correct": 9839,
    "total": 10000,
    "overhead_ms": 2.2456980000428075
   },
   {
    "dataset": "mnist",
    "ms": 233.43923950195312,
    "parent_ms": 244.43901500001175,
    "correct": 9836,
    "total": 10000,
    "overhead_ms": 3.908244498231852
   },
   {
    "dataset": "mnist",
    "ms": 224.69119262695312,
    "parent_ms": 230.128800999978,
    "correct": 9817,
    "total": 10000,
    "overhead_ms": 2.031805501037752
   },
   {
    "dataset": "mnist",
    "ms": 224.72396850585938,
    "parent_ms": 230.25574899997991,
    "correct": 9820,
    "total": 10000,
    "overhead_ms": 2.1827109981220474
   },
   {
    "dataset": "mnist",
    "ms": 231.05126953125,
    "parent_ms": 241.08123100000967,
    "correct": 9845,
    "total": 10000,
    "overhead_ms": 2.0239690000253177
   },
   {
    "dataset": "fashion",
    "ms": 227.89324951171875,
    "parent_ms": 236.97811900001398,
    "correct": 8872,
    "total": 10000,
    "overhead_ms": 4.74670649749055
   },
   {
    "dataset": "mnist",
    "ms": 218.6096649169922,
    "parent_ms": 227.50785599998835,
    "correct": 9833,
    "total": 10000,
    "overhead_ms": 2.360065999487688
   },
   {
    "dataset": "mnist",
    "ms": 229.87059020996094,
    "parent_ms": 241.7251890000216,
    "correct": 9819,
    "total": 10000,
    "overhead_ms": 3.945111002221438
   },
   {
    "dataset": "fashion",
    "ms": 229.6678466796875,
    "parent_ms": 235.57089500002348,
    "correct": 8843,
    "total": 10000,
    "overhead_ms": 2.4146409985842183
   },
   {
    "dataset": "mnist",
    "ms": 225.23085021972656,
    "parent_ms": 231.38388300003498,
    "correct": 9831,
    "total": 10000,
    "overhead_ms": 2.556590001053337
   },
   {
    "dataset": "fashion",
    "ms": 209.71212768554688,
    "parent_ms": 215.79757200004224,
    "correct": 8882,
    "total": 10000,
    "overhead_ms": 2.6576510027134645
   }
  ],
  "problems": [],
  "summary": "MNIST 98.28% (108,105/110,000), 228.705 ms/call; hold-out (fashion) 88.72%, 221.973 ms/call (floored by the scorer's clock)",
  "ranked_ms": 228.70500852282657,
  "energy": {
   "mj_per_call": 31490.035826112286,
   "problems": [],
   "net_mj_before_control": 31501.278682116383,
   "control_mj_per_call": 11.242856004097455,
   "control_calls": 2446,
   "gross_mj_per_call": 45272.25490196078,
   "idle_w": 70.18309078385002,
   "active_w": 230.72778030037242,
   "calls": 102,
   "seconds": 20.013931543000012,
   "ms_median": 189.97914123535156,
   "timed_mnist_ms_median": 225.23085021972656,
   "correct": 1002792,
   "total": 1020000,
   "reference": {
    "tflops_per_s": 18.374537380750674,
    "j_per_tflop": 8.201739759573366,
    "exact": true,
    "band": [
     [
      6.0,
      11.0
     ],
     [
      15.0,
      23.0
     ]
    ]
   },
   "device": {
    "name": "NVIDIA A100-SXM4-80GB",
    "uuid": "GPU-380be5fd-a9bc-9baa-5331-aa2e2fc0731e",
    "vbios": "92.00.9E.00.02",
    "driver": "610.57.04",
    "power_limit_w": 500.0
   },
   "windows": [
    {
     "name": "idle 1",
     "seconds": 5.009445034000009,
     "joules": 350.31,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "reference",
     "seconds": 5.146143166999991,
     "joules": 1136.159,
     "matmuls": 688,
     "dim": 4096,
     "exact": true
    },
    {
     "name": "idle 2",
     "seconds": 5.006392027000061,
     "joules": 351.555,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "control",
     "seconds": 5.005186479000031,
     "joules": 378.586,
     "calls": 2446
    },
    {
     "name": "idle 3",
     "seconds": 5.006305347999955,
     "joules": 350.78,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "method",
     "seconds": 20.013931543000012,
     "joules": 4617.77,
     "calls": 102,
     "ms": [
      221.47174072265625,
      189.97042846679688,
      189.63046264648438,
      189.7216033935547,
      190.12608337402344,
      190.17523193359375,
      190.53363037109375,
      190.55206298828125,
      190.29913330078125,
      190.34317016601562,
      190.21005249023438,
      190.1486053466797,
      190.3697967529297,
      190.2950439453125,
      190.3687744140625,
      190.44863891601562,
      190.51417541503906,
      190.08717346191406,
      189.97555541992188,
      190.4312286376953,
      190.25100708007812,
      189.84243774414062,
      189.5782470703125,
      189.3887939453125,
      190.31961059570312,
      189.65811157226562,
      189.57005310058594,
      190.1117401123047,
      189.49221801757812,
      189.41030883789062,
      189.4246368408203,
      189.34271240234375,
      189.5546875,
      190.1537322998047,
      190.1834259033203,
      190.15475463867188,
      190.0011444091797,
      189.63763427734375,
      190.060546875,
      189.95814514160156,
      189.48095703125,
      189.3560333251953,
      189.67552185058594,
      189.3509063720703,
      190.14247131347656,
      189.50656127929688,
      190.05746459960938,
      190.44146728515625,
      190.01036071777344,
      190.20799255371094,
      189.94277954101562,
      189.97247314453125,
      190.18240356445312,
      190.28172302246094,
      190.19468688964844,
      189.63148498535156,
      189.49530029296875,
      189.44921875,
      189.5219268798828,
      189.42874145507812,
      189.93869018554688,
      190.08409118652344,
      189.99603271484375,
      190.16397094726562,
      189.49734497070312,
      190.2274627685547,
      190.1158447265625,
      189.4318084716797,
      190.13938903808594,
      189.92640686035156,
      189.49427795410156,
      189.47891235351562,
      190.28684997558594,
      190.19161987304688,
      190.17727661132812,
      189.67654418945312,
      190.13221740722656,
      189.58335876464844,
      189.4676513671875,
      189.35398864746094,
      189.39596557617188,
      189.36524963378906,
      189.34579467773438,
      189.54342651367188,
      189.45843505859375,
      190.0564422607422,
      190.2274627685547,
      189.47378540039062,
      189.4993896484375,
      190.1649932861328,
      190.00320434570312,
      189.98272705078125,
      189.739013671875,
      190.23052978515625,
      189.51475524902344,
      189.62124633789062,
      189.52703857421875,
      189.50860595703125,
      190.2223358154297,
      190.0748748779297,
      189.34169006347656,
      190.41690063476562
     ],
     "correct": [
      9829,
      9835,
      9826,
      9837,
      9813,
      9815,
      9843,
      9807,
      9834,
      9841,
      9845,
      9808,
      9824,
      9840,
      9831,
      9851,
      9826,
      9832,
      9840,
      9831,
      9834,
      9815,
      9848,
      9860,
      9822,
      9828,
      9827,
      9846,
      9841,
      9835,
      9845,
      9841,
      9835,
      9836,
      9830,
      9827,
      9816,
      9824,
      9850,
      9815,
      9842,
      9839,
      9827,
      9850,
      9828,
      9830,
      9822,
      9866,
      9828,
      9839,
      9841,
      9832,
      9818,
      9803,
      9837,
      9835,
      9826,
      9832,
      9823,
      9850,
      9809,
      9818,
      9838,
      9840,
      9816,
      9832,
      9823,
      9823,
      9813,
      9826,
      9845,
      9811,
      9846,
      9840,
      9833,
      9824,
      9817,
      9839,
      9820,
      9852,
      9844,
      9828,
      9836,
      9829,
      9824,
      9805,
      9843,
      9840,
      9826,
      9848,
      9836,
      9841,
      9835,
      9807,
      9839,
      9851,
      9828,
      9834,
      9820,
      9832,
      9810,
      9820
     ]
    },
    {
     "name": "idle 4",
     "seconds": 5.006206263999957,
     "joules": 351.929,
     "utilization_max": 0,
     "contexts": 1
    }
   ]
  }
 }
}
