{
 "returncode": 0,
 "stdout": "submission.py:hybrid_d4 at 2.30% error: 15 timed calls, each in a fresh process\n  review flag: embedded weights? 417 numeric literals\n  review flag: 20,429 bytes, close to the 20,480-byte limit\n  NVIDIA A100-SXM4-80GB, torch 2.12.0+cu130, sandbox on\n  call  1/15: 18.531 ms, scorer's clock 18.493 ms\n  call  2/15: 18.571 ms, scorer's clock 22.486 ms\n  call  3/15: 18.569 ms, scorer's clock 21.167 ms\n  call  4/15: 18.586 ms, scorer's clock 22.103 ms\n  call  5/15: 18.587 ms, scorer's clock 21.278 ms\n  call  6/15: 18.563 ms, scorer's clock 21.465 ms\n  call  7/15: 18.605 ms, scorer's clock 22.589 ms\n  call  8/15: 18.527 ms, scorer's clock 21.225 ms\n  call  9/15: 18.569 ms, scorer's clock 21.331 ms\n  call 10/15: 18.510 ms, scorer's clock 21.059 ms\n  call 11/15: 18.565 ms, scorer's clock 21.843 ms\n  call 12/15: 18.516 ms, scorer's clock 22.379 ms\n  call 13/15: 18.537 ms, scorer's clock 20.887 ms\n  call 14/15: 18.641 ms, scorer's clock 22.091 ms\n  call 15/15: 18.584 ms, scorer's clock 21.909 ms\nMNIST 97.79% (107,574/110,000), 21.240 ms/call; hold-out (fashion) 88.58%, 21.443 ms/call (floored by the scorer's clock); score 21.443 ms\nenergy: one more fresh process runs the method back to back on fresh MNIST draws for 20 s, between idle windows in which it is frozen\n  NVIDIA A100-SXM4-80GB: idle 71.3 W with the method frozen; telemetry reference 18.4 TFLOP/s at 8.23 J/TFLOP above idle (a healthy NVIDIA A100-SXM4-80GB reads 6-11)\n  the round trip alone: 13.9 mJ per call over 3,267 empty calls, subtracted\n  the method: 1,003 calls in 20.0 s, MNIST 97.88%, 15.266 ms per call, 184.7 W on average\nenergy 2248.734 mJ per call above idle\n",
 "stderr": "/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n",
 "record": {
  "version": "mnist-a100/1.2.0 (protections of sutro-mnist-medium/3.0.0, tightened; energy column)",
  "file": "submission.py",
  "function": "hybrid_d4",
  "source_sha256": "02755ca6031242b0ef29ded5ba2f4f78ee7e592e120694edb3a4d2ed65f9d010",
  "band_bp": 230,
  "sandboxed": true,
  "holdout": "fashion",
  "device": "NVIDIA A100-SXM4-80GB",
  "torch": "2.12.0+cu130",
  "calls": [
   {
    "dataset": "mnist",
    "ms": 18.531328201293945,
    "parent_ms": 20.539222000000024,
    "correct": 9768,
    "total": 10000,
    "overhead_ms": 2.0462535003388567
   },
   {
    "dataset": "mnist",
    "ms": 18.571264266967773,
    "parent_ms": 25.102173000000505,
    "correct": 9759,
    "total": 10000,
    "overhead_ms": 2.6157910013783408
   },
   {
    "dataset": "mnist",
    "ms": 18.569215774536133,
    "parent_ms": 23.92870099998845,
    "correct": 9779,
    "total": 10000,
    "overhead_ms": 2.761788998518199
   },
   {
    "dataset": "mnist",
    "ms": 18.585599899291992,
    "parent_ms": 24.575443999992785,
    "correct": 9808,
    "total": 10000,
    "overhead_ms": 2.472054000515527
   },
   {
    "dataset": "mnist",
    "ms": 18.586624145507812,
    "parent_ms": 24.031713999988824,
    "correct": 9786,
    "total": 10000,
    "overhead_ms": 2.753348999127354
   },
   {
    "dataset": "mnist",
    "ms": 18.563072204589844,
    "parent_ms": 23.34826899999598,
    "correct": 9784,
    "total": 10000,
    "overhead_ms": 1.8832184975675546
   },
   {
    "dataset": "fashion",
    "ms": 18.605056762695312,
    "parent_ms": 24.817708999989918,
    "correct": 8886,
    "total": 10000,
    "overhead_ms": 2.229187998518455
   },
   {
    "dataset": "fashion",
    "ms": 18.527231216430664,
    "parent_ms": 24.3395790000136,
    "correct": 8853,
    "total": 10000,
    "overhead_ms": 3.114080499730335
   },
   {
    "dataset": "mnist",
    "ms": 18.569215774536133,
    "parent_ms": 23.539932999995017,
    "correct": 9788,
    "total": 10000,
    "overhead_ms": 2.2093960011987974
   },
   {
    "dataset": "mnist",
    "ms": 18.509824752807617,
    "parent_ms": 23.753536999976177,
    "correct": 9786,
    "total": 10000,
    "overhead_ms": 2.694279497213529
   },
   {
    "dataset": "fashion",
    "ms": 18.565120697021484,
    "parent_ms": 24.175016000015148,
    "correct": 8853,
    "total": 10000,
    "overhead_ms": 2.3315285000735457
   },
   {
    "dataset": "mnist",
    "ms": 18.515968322753906,
    "parent_ms": 24.506843000011713,
    "correct": 9757,
    "total": 10000,
    "overhead_ms": 2.1282505003260894
   },
   {
    "dataset": "fashion",
    "ms": 18.537471771240234,
    "parent_ms": 23.65627599999698,
    "correct": 8840,
    "total": 10000,
    "overhead_ms": 2.7693370005572433
   },
   {
    "dataset": "mnist",
    "ms": 18.64089584350586,
    "parent_ms": 24.41305999997212,
    "correct": 9783,
    "total": 10000,
    "overhead_ms": 2.3217075006821233
   },
   {
    "dataset": "mnist",
    "ms": 18.58355140686035,
    "parent_ms": 23.752267999952892,
    "correct": 9776,
    "total": 10000,
    "overhead_ms": 1.8430624995880862
   }
  ],
  "problems": [],
  "summary": "MNIST 97.79% (107,574/110,000), 21.240 ms/call; hold-out (fashion) 88.58%, 21.443 ms/call (floored by the scorer's clock)",
  "ranked_ms": 21.443317899724782,
  "energy": {
   "mj_per_call": 2248.733750501629,
   "problems": [],
   "net_mj_before_control": 2262.6600244375377,
   "control_mj_per_call": 13.926273935908807,
   "control_calls": 3267,
   "gross_mj_per_call": 3685.8035892323032,
   "idle_w": 71.32743591901652,
   "active_w": 184.73113031218426,
   "calls": 1003,
   "seconds": 20.012117036000006,
   "ms_median": 15.265791893005371,
   "timed_mnist_ms_median": 18.569215774536133,
   "correct": 9817470,
   "total": 10030000,
   "reference": {
    "tflops_per_s": 18.405091405182734,
    "j_per_tflop": 8.227224167622612,
    "exact": true,
    "band": [
     [
      6.0,
      11.0
     ],
     [
      15.0,
      23.0
     ]
    ]
   },
   "device": {
    "name": "NVIDIA A100-SXM4-80GB",
    "uuid": "GPU-aab08630-b0d3-1ced-2dbd-e2ba2b1715f7",
    "vbios": "92.00.9E.00.03",
    "driver": "610.57.04",
    "power_limit_w": 400.0
   },
   "windows": [
    {
     "name": "idle 1",
     "seconds": 5.0059165110000095,
     "joules": 347.142,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "reference",
     "seconds": 5.197339666000005,
     "joules": 1152.447,
     "matmuls": 696,
     "dim": 4096,
     "exact": true
    },
    {
     "name": "idle 2",
     "seconds": 5.005291417000024,
     "joules": 356.796,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "control",
     "seconds": 5.004020765000007,
     "joules": 401.113,
     "calls": 3267
    },
    {
     "name": "idle 3",
     "seconds": 5.007954481000013,
     "joules": 354.805,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "method",
     "seconds": 20.012117036000006,
     "joules": 3696.861,
     "calls": 1003,
     "ms": [
      18.61427116394043,
      18.542591094970703,
      18.556928634643555,
      18.489343643188477,
      18.506752014160156,
      18.488319396972656,
      18.516992568969727,
      18.493440628051758,
      17.973247528076172,
      15.270912170410156,
      15.255552291870117,
      15.235072135925293,
      15.30675220489502,
      15.318016052246094,
      15.324159622192383,
      15.3057279586792,
      15.316991806030273,
      15.29139232635498,
      15.303680419921875,
      15.265791893005371,
      15.304703712463379,
      15.265791893005371,
      15.313920021057129,
      15.255552291870117,
      15.246335983276367,
      15.233023643493652,
      15.253503799438477,
      15.292415618896484,
      15.228927612304688,
      15.2739839553833,
      15.243264198303223,
      15.247360229492188,
      15.251456260681152,
      15.265791893005371,
      15.256575584411621,
      15.254528045654297,
      15.262720108032227,
      15.255552291870117,
      15.323136329650879,
      15.302656173706055,
      15.276032447814941,
      15.28320026397705,
      15.248384475708008,
      15.29958438873291,
      15.225855827331543,
      15.300607681274414,
      15.271936416625977,
      15.284223556518555,
      15.263744354248047,
      15.278079986572266,
      15.28831958770752,
      15.285247802734375,
      15.29753589630127,
      15.270912170410156,
      15.261695861816406,
      15.295488357543945,
      15.302656173706055,
      15.2739839553833,
      15.28012752532959,
      15.256575584411621,
      15.267840385437012,
      15.304703712463379,
      15.276032447814941,
      15.267840385437012,
      15.276032447814941,
      15.346688270568848,
      15.27295970916748,
      15.293439865112305,
      15.316991806030273,
      15.271936416625977,
      15.278079986572266,
      15.325183868408203,
      15.279104232788086,
      15.265791893005371,
      15.284223556518555,
      15.285247802734375,
      15.318016052246094,
      15.279104232788086,
      15.28320026397705,
      15.328255653381348,
      15.240192413330078,
      15.262720108032227,
      15.28012752532959,
      15.310848236083984,
      15.279104232788086,
      15.320063591003418,
      15.247360229492188,
      15.249407768249512,
      15.261695861816406,
      15.30777645111084,
      15.313920021057129,
      15.310848236083984,
      15.279104232788086,
      15.301631927490234,
      15.312895774841309,
      15.277055740356445,
      15.292415618896484,
      15.246335983276367,
      15.28934383392334,
      15.286272048950195,
      15.271936416625977,
      15.300607681274414,
      15.2739839553833,
      15.284223556518555,
      15.31494426727295,
      15.29651165008545,
      15.284223556518555,
      15.254528045654297,
      15.271936416625977,
      15.26476764678955,
      15.285247802734375,
      15.29036808013916,
      15.266816139221191,
      15.267840385437012,
      15.245311737060547,
      15.240192413330078,
      15.277055740356445,
      15.28934383392334,
      15.243264198303223,
      15.285247802734375,
      15.279104232788086,
      15.335424423217773,
      15.324159622192383,
      15.321087837219238,
      15.28217601776123,
      15.327232360839844,
      15.270912170410156,
      15.28320026397705,
      15.279104232788086,
      15.262720108032227,
      15.257599830627441,
      15.29139232635498,
      15.267840385437012,
      15.2739839553833,
      15.27295970916748,
      15.258624076843262,
      15.248384475708008,
      15.28115177154541,
      15.235072135925293,
      15.256575584411621,
      15.294464111328125,
      15.309823989868164,
      15.28217601776123,
      15.350784301757812,
      15.286272048950195,
      15.28320026397705,
      15.287296295166016,
      15.268863677978516,
      15.258624076843262,
      15.252479553222656,
      15.255552291870117,
      15.2739839553833,
      15.27295970916748,
      15.28115177154541,
      15.30777645111084,
      15.293439865112305,
      15.270912170410156,
      15.246335983276367,
      15.294464111328125,
      15.250432014465332,
      15.256575584411621,
      15.275008201599121,
      15.271936416625977,
      15.253503799438477,
      15.261695861816406,
      15.247360229492188,
      15.3057279586792,
      15.247360229492188,
      15.249407768249512,
      15.269887924194336,
      15.267840385437012,
      15.304703712463379,
      15.253503799438477,
      15.29139232635498,
      15.270912170410156,
      15.322112083435059,
      15.276032447814941,
      15.313920021057129,
      15.334400177001953,
      15.244288444519043,
      15.28115177154541,
      15.250432014465332,
      15.316991806030273,
      15.259648323059082,
      15.28320026397705,
      15.261695861816406,
      15.268863677978516,
      15.275008201599121,
      15.266816139221191,
      15.241215705871582,
      15.293439865112305,
      15.362048149108887,
      15.3057279586792,
      15.29651165008545,
      15.29753589630127,
      15.371264457702637,
      15.28831958770752,
      15.318016052246094,
      15.2739839553833,
      15.28115177154541,
      15.333375930786133,
      15.265791893005371,
      15.304703712463379,
      15.261695861816406,
      15.303680419921875,
      15.245311737060547,
      15.271936416625977,
      15.28217601776123,
      15.257599830627441,
      15.257599830627441,
      15.271936416625977,
      15.279104232788086,
      15.31494426727295,
      15.28320026397705,
      15.278079986572266,
      15.266816139221191,
      15.332351684570312,
      15.30777645111084,
      15.338496208190918,
      15.28012752532959,
      15.278079986572266,
      15.232000350952148,
      15.28012752532959,
      15.244288444519043,
      15.29139232635498,
      15.252479553222656,
      15.28320026397705,
      15.29036808013916,
      15.267840385437012,
      15.275008201599121,
      15.327232360839844,
      15.26476764678955,
      15.250432014465332,
      15.258624076843262,
      15.242239952087402,
      15.29856014251709,
      15.270912170410156,
      15.276032447814941,
      15.259648323059082,
      15.263744354248047,
      15.242239952087402,
      15.237119674682617,
      15.255552291870117,
      15.270912170410156,
      15.235072135925293,
      15.253503799438477,
      15.315967559814453,
      15.252479553222656,
      15.331328392028809,
      15.263744354248047,
      15.271936416625977,
      15.239168167114258,
      15.262720108032227,
      15.270912170410156,
      15.29036808013916,
      15.294464111328125,
      15.321087837219238,
      15.29036808013916,
      15.268863677978516,
      15.263744354248047,
      15.329279899597168,
      15.316991806030273,
      15.326208114624023,
      15.303680419921875,
      15.294464111328125,
      15.308799743652344,
      15.255552291870117,
      15.29753589630127,
      15.29036808013916,
      15.247360229492188,
      15.253503799438477,
      15.286272048950195,
      15.279104232788086,
      15.244288444519043,
      15.263744354248047,
      15.226880073547363,
      15.267840385437012,
      15.332351684570312,
      15.278079986572266,
      15.29139232635498,
      15.313920021057129,
      15.328255653381348,
      15.279104232788086,
      15.310848236083984,
      15.237119674682617,
      15.287296295166016,
      15.245311737060547,
      15.250432014465332,
      15.294464111328125,
      15.249407768249512,
      15.256575584411621,
      15.28012752532959,
      15.26476764678955,
      15.252479553222656,
      15.29139232635498,
      15.323136329650879,
      15.326208114624023,
      15.252479553222656,
      15.279104232788086,
      15.261695861816406,
      15.287296295166016,
      15.261695861816406,
      15.252479553222656,
      15.309823989868164,
      15.2739839553833,
      15.29139232635498,
      15.269887924194336,
      15.260671615600586,
      15.309823989868164,
      15.260671615600586,
      15.258624076843262,
      15.258624076843262,
      15.316991806030273,
      15.266816139221191,
      15.277055740356445,
      15.29958438873291,
      15.28012752532959,
      15.287296295166016,
      15.270912170410156,
      15.300607681274414,
      15.292415618896484,
      15.257599830627441,
      15.287296295166016,
      15.263744354248047,
      15.29651165008545,
      15.303680419921875,
      15.243264198303223,
      15.3057279586792,
      15.293439865112305,
      15.29958438873291,
      15.26476764678955,
      15.292415618896484,
      15.302656173706055,
      15.278079986572266,
      15.258624076843262,
      15.249407768249512,
      15.259648323059082,
      15.259648323059082,
      15.250432014465332,
      15.255552291870117,
      15.28934383392334,
      15.301631927490234,
      15.261695861816406,
      15.277055740356445,
      15.285247802734375,
      15.255552291870117,
      15.261695861816406,
      15.2739839553833,
      15.263744354248047,
      15.262720108032227,
      15.271936416625977,
      15.262720108032227,
      15.285247802734375,
      15.301631927490234,
      15.261695861816406,
      15.237119674682617,
      15.278079986572266,
      15.2739839553833,
      15.278079986572266,
      15.336447715759277,
      15.29139232635498,
      15.276032447814941,
      15.3057279586792,
      15.253503799438477,
      15.258624076843262,
      15.284223556518555,
      15.309823989868164,
      15.329279899597168,
      15.239168167114258,
      15.239168167114258,
      15.326208114624023,
      15.318016052246094,
      15.26476764678955,
      15.28320026397705,
      15.300607681274414,
      15.295488357543945,
      15.265791893005371,
      15.263744354248047,
      15.243264198303223,
      15.329279899597168,
      15.265791893005371,
      15.344639778137207,
      15.250432014465332,
      15.245311737060547,
      15.266816139221191,
      15.277055740356445,
      15.27295970916748,
      15.268863677978516,
      15.246335983276367,
      15.365119934082031,
      15.327232360839844,
      15.28320026397705,
      15.319040298461914,
      15.28320026397705,
      15.308799743652344,
      15.262720108032227,
      15.27295970916748,
      15.261695861816406,
      15.277055740356445,
      15.29958438873291,
      15.261695861816406,
      15.303680419921875,
      15.312895774841309,
      15.29036808013916,
      15.29753589630127,
      15.308799743652344,
      15.265791893005371,
      15.259648323059082,
      15.241215705871582,
      15.28934383392334,
      15.266816139221191,
      15.254528045654297,
      15.267840385437012,
      15.256575584411621,
      15.255552291870117,
      15.265791893005371,
      15.259648323059082,
      15.247360229492188,
      15.302656173706055,
      15.271936416625977,
      15.248384475708008,
      15.236096382141113,
      15.278079986572266,
      15.250432014465332,
      15.229951858520508,
      15.285247802734375,
      15.246335983276367,
      15.248384475708008,
      15.269887924194336,
      15.301631927490234,
      15.261695861816406,
      15.28320026397705,
      15.247360229492188,
      15.229951858520508,
      15.28831958770752,
      15.276032447814941,
      15.277055740356445,
      15.28012752532959,
      15.257599830627441,
      15.224831581115723,
      15.249407768249512,
      15.255552291870117,
      15.262720108032227,
      15.263744354248047,
      15.240192413330078,
      15.232000350952148,
      15.29036808013916,
      15.26476764678955,
      15.284223556518555,
      15.30777645111084,
      15.315967559814453,
      15.276032447814941,
      15.321087837219238,
      15.250432014465332,
      15.279104232788086,
      15.258624076843262,
      15.310848236083984,
      15.265791893005371,
      15.240192413330078,
      15.270912170410156,
      15.258624076843262,
      15.263744354248047,
      15.28012752532959,
      15.260671615600586,
      15.268863677978516,
      15.251456260681152,
      15.266816139221191,
      15.248384475708008,
      15.265791893005371,
      15.311871528625488,
      15.268863677978516,
      15.304703712463379,
      15.28831958770752,
      15.249407768249512,
      15.251456260681152,
      15.315967559814453,
      15.255552291870117,
      15.257599830627441,
      15.29139232635498,
      15.277055740356445,
      15.269887924194336,
      15.261695861816406,
      15.261695861816406,
      15.238143920898438,
      15.293439865112305,
      15.343615531921387,
      15.29651165008545,
      15.2739839553833,
      15.261695861816406,
      15.251456260681152,
      15.250432014465332,
      15.256575584411621,
      15.28320026397705,
      15.243264198303223,
      15.248384475708008,
      15.271936416625977,
      15.269887924194336,
      15.261695861816406,
      15.256575584411621,
      15.295488357543945,
      15.265791893005371,
      15.29139232635498,
      15.233023643493652,
      15.2739839553833,
      15.235072135925293,
      15.301631927490234,
      15.248384475708008,
      15.221759796142578,
      15.2739839553833,
      15.240192413330078,
      15.252479553222656,
      15.249407768249512,
      15.261695861816406,
      15.214591979980469,
      15.249407768249512,
      15.28831958770752,
      15.251456260681152,
      15.27295970916748,
      15.224831581115723,
      15.243264198303223,
      15.252479553222656,
      15.241215705871582,
      15.269887924194336,
      15.252479553222656,
      15.242239952087402,
      15.253503799438477,
      15.239168167114258,
      15.257599830627441,
      15.249407768249512,
      15.238143920898438,
      15.259648323059082,
      15.256575584411621,
      15.28831958770752,
      15.301631927490234,
      15.26476764678955,
      15.303680419921875,
      15.279104232788086,
      15.254528045654297,
      15.29753589630127,
      15.2739839553833,
      15.263744354248047,
      15.267840385437012,
      15.259648323059082,
      15.268863677978516,
      15.276032447814941,
      15.259648323059082,
      15.255552291870117,
      15.251456260681152,
      15.253503799438477,
      15.261695861816406,
      15.244288444519043,
      15.28012752532959,
      15.271936416625977,
      15.227904319763184,
      15.260671615600586,
      15.239168167114258,
      15.239168167114258,
      15.261695861816406,
      15.245311737060547,
      15.247360229492188,
      15.26476764678955,
      15.251456260681152,
      15.251456260681152,
      15.278079986572266,
      15.253503799438477,
      15.246335983276367,
      15.257599830627441,
      15.242239952087402,
      15.27295970916748,
      15.237119674682617,
      15.259648323059082,
      15.278079986572266,
      15.245311737060547,
      15.253503799438477,
      15.258624076843262,
      15.254528045654297,
      15.260671615600586,
      15.239168167114258,
      15.265791893005371,
      15.260671615600586,
      15.247360229492188,
      15.259648323059082,
      15.256575584411621,
      15.254528045654297,
      15.2739839553833,
      15.268863677978516,
      15.245311737060547,
      15.29753589630127,
      15.255552291870117,
      15.248384475708008,
      15.258624076843262,
      15.260671615600586,
      15.253503799438477,
      15.251456260681152,
      15.259648323059082,
      15.242239952087402,
      15.250432014465332,
      15.254528045654297,
      15.275008201599121,
      15.248384475708008,
      15.262720108032227,
      15.249407768249512,
      15.238143920898438,
      15.259648323059082,
      15.235072135925293,
      15.242239952087402,
      15.244288444519043,
      15.255552291870117,
      15.260671615600586,
      15.228927612304688,
      15.31494426727295,
      15.268863677978516,
      15.224831581115723,
      15.247360229492188,
      15.257599830627441,
      15.301631927490234,
      15.301631927490234,
      15.260671615600586,
      15.230976104736328,
      15.284223556518555,
      15.275008201599121,
      15.247360229492188,
      15.212544441223145,
      15.256575584411621,
      15.248384475708008,
      15.248384475708008,
      15.257599830627441,
      15.224831581115723,
      15.267840385437012,
      15.259648323059082,
      15.249407768249512,
      15.269887924194336,
      15.253503799438477,
      15.238143920898438,
      15.246335983276367,
      15.226880073547363,
      15.262720108032227,
      15.242239952087402,
      15.252479553222656,
      15.268863677978516,
      15.267840385437012,
      15.241215705871582,
      15.251456260681152,
      15.261695861816406,
      15.244288444519043,
      15.250432014465332,
      15.254528045654297,
      15.259648323059082,
      15.258624076843262,
      15.229951858520508,
      15.240192413330078,
      15.261695861816406,
      15.250432014465332,
      15.265791893005371,
      15.228927612304688,
      15.247360229492188,
      15.265791893005371,
      15.237119674682617,
      15.256575584411621,
      15.256575584411621,
      15.263744354248047,
      15.249407768249512,
      15.268863677978516,
      15.327232360839844,
      15.284223556518555,
      15.261695861816406,
      15.248384475708008,
      15.292415618896484,
      15.27295970916748,
      15.29036808013916,
      15.263744354248047,
      15.249407768249512,
      15.286272048950195,
      15.217663764953613,
      15.244288444519043,
      15.261695861816406,
      15.26476764678955,
      15.262720108032227,
      15.265791893005371,
      15.269887924194336,
      15.271936416625977,
      15.308799743652344,
      15.30675220489502,
      15.236096382141113,
      15.233023643493652,
      15.266816139221191,
      15.237119674682617,
      15.28012752532959,
      15.257599830627441,
      15.246335983276367,
      15.292415618896484,
      15.238143920898438,
      15.335424423217773,
      15.29856014251709,
      15.271936416625977,
      15.277055740356445,
      15.260671615600586,
      15.259648323059082,
      15.28831958770752,
      15.28012752532959,
      15.285247802734375,
      15.260671615600586,
      15.3057279586792,
      15.28934383392334,
      15.262720108032227,
      15.265791893005371,
      15.26476764678955,
      15.326208114624023,
      15.28831958770752,
      15.271936416625977,
      15.255552291870117,
      15.29651165008545,
      15.237119674682617,
      15.224831581115723,
      15.292415618896484,
      15.256575584411621,
      15.247360229492188,
      15.277055740356445,
      15.258624076843262,
      15.250432014465332,
      15.240192413330078,
      15.248384475708008,
      15.253503799438477,
      15.275008201599121,
      15.257599830627441,
      15.235072135925293,
      15.235072135925293,
      15.228927612304688,
      15.270912170410156,
      15.229951858520508,
      15.236096382141113,
      15.295488357543945,
      15.309823989868164,
      15.267840385437012,
      15.255552291870117,
      15.28320026397705,
      15.266816139221191,
      15.261695861816406,
      15.287296295166016,
      15.265791893005371,
      15.253503799438477,
      15.29139232635498,
      15.285247802734375,
      15.249407768249512,
      15.28320026397705,
      15.252479553222656,
      15.250432014465332,
      15.255552291870117,
      15.327232360839844,
      15.265791893005371,
      15.241215705871582,
      15.26476764678955,
      15.263744354248047,
      15.262720108032227,
      15.261695861816406,
      15.28012752532959,
      15.249407768249512,
      15.308799743652344,
      15.285247802734375,
      15.260671615600586,
      15.271936416625977,
      15.258624076843262,
      15.257599830627441,
      15.27295970916748,
      15.233023643493652,
      15.239168167114258,
      15.263744354248047,
      15.254528045654297,
      15.313920021057129,
      15.27295970916748,
      15.260671615600586,
      15.287296295166016,
      15.284223556518555,
      15.258624076843262,
      15.277055740356445,
      15.235072135925293,
      15.321087837219238,
      15.263744354248047,
      15.259648323059082,
      15.247360229492188,
      15.293439865112305,
      15.278079986572266,
      15.238143920898438,
      15.279104232788086,
      15.270912170410156,
      15.250432014465332,
      15.258624076843262,
      15.29753589630127,
      15.304703712463379,
      15.247360229492188,
      15.237119674682617,
      15.223808288574219,
      15.312895774841309,
      15.295488357543945,
      15.28012752532959,
      15.246335983276367,
      15.245311737060547,
      15.250432014465332,
      15.287296295166016,
      15.28320026397705,
      15.262720108032227,
      15.2739839553833,
      15.252479553222656,
      15.250432014465332,
      15.268863677978516,
      15.269887924194336,
      15.232000350952148,
      15.258624076843262,
      15.244288444519043,
      15.249407768249512,
      15.241215705871582,
      15.2739839553833,
      15.245311737060547,
      15.255552291870117,
      15.267840385437012,
      15.244288444519043,
      15.246335983276367,
      15.223808288574219,
      15.251456260681152,
      15.236096382141113,
      15.251456260681152,
      15.261695861816406,
      15.254528045654297,
      15.254528045654297,
      15.259648323059082,
      15.247360229492188,
      15.232000350952148,
      15.260671615600586,
      15.267840385437012,
      15.261695861816406,
      15.269887924194336,
      15.245311737060547,
      15.29651165008545,
      15.267840385437012,
      15.266816139221191,
      15.270912170410156,
      15.245311737060547,
      15.252479553222656,
      15.250432014465332,
      15.243264198303223,
      15.252479553222656,
      15.248384475708008,
      15.242239952087402,
      15.243264198303223,
      15.237119674682617,
      15.28934383392334,
      15.262720108032227,
      15.27295970916748,
      15.263744354248047,
      15.251456260681152,
      15.256575584411621,
      15.227904319763184,
      15.336447715759277,
      15.247360229492188,
      15.267840385437012,
      15.276032447814941,
      15.261695861816406,
      15.256575584411621,
      15.28012752532959,
      15.279104232788086,
      15.258624076843262,
      15.278079986572266,
      15.26476764678955,
      15.28012752532959,
      15.240192413330078,
      15.254528045654297,
      15.248384475708008,
      15.239168167114258,
      15.2739839553833,
      15.263744354248047,
      15.260671615600586,
      15.270912170410156,
      15.248384475708008,
      15.243264198303223,
      15.321087837219238,
      15.29651165008545,
      15.257599830627441,
      15.259648323059082,
      15.256575584411621,
      15.262720108032227,
      15.247360229492188,
      15.249407768249512,
      15.259648323059082,
      15.251456260681152,
      15.300607681274414,
      15.261695861816406,
      15.28012752532959,
      15.240192413330078,
      15.27295970916748,
      15.284223556518555,
      15.256575584411621,
      15.252479553222656,
      15.263744354248047,
      15.279104232788086,
      15.28115177154541,
      15.243264198303223,
      15.240192413330078,
      15.275008201599121,
      15.270912170410156,
      15.284223556518555,
      15.252479553222656,
      15.259648323059082,
      15.277055740356445,
      15.259648323059082,
      15.303680419921875,
      15.246335983276367,
      15.253503799438477,
      15.271936416625977,
      15.265791893005371,
      15.30675220489502,
      15.309823989868164,
      15.287296295166016,
      15.28012752532959,
      15.279104232788086,
      15.27295970916748,
      15.243264198303223,
      15.319040298461914,
      15.300607681274414,
      15.302656173706055,
      15.256575584411621,
      15.31494426727295,
      15.222784042358398,
      15.241215705871582,
      15.268863677978516,
      15.247360229492188,
      15.261695861816406,
      15.255552291870117,
      15.234047889709473,
      15.275008201599121,
      15.29958438873291,
      15.270912170410156,
      15.266816139221191,
      15.245311737060547,
      15.26476764678955,
      15.256575584411621,
      15.250432014465332,
      15.303680419921875,
      15.223808288574219,
      15.238143920898438,
      15.286272048950195,
      15.259648323059082,
      15.258624076843262,
      15.230976104736328,
      15.250432014465332,
      15.28831958770752,
      15.278079986572266,
      15.268863677978516,
      15.237119674682617,
      15.293439865112305,
      15.28115177154541,
      15.336447715759277,
      15.330304145812988,
      15.259648323059082,
      15.241215705871582,
      15.249407768249512,
      15.268863677978516,
      15.270912170410156,
      15.251456260681152,
      15.267840385437012,
      15.294464111328125,
      15.245311737060547,
      15.29753589630127,
      15.255552291870117,
      15.228927612304688,
      15.266816139221191,
      15.241215705871582,
      15.255552291870117,
      15.28934383392334,
      15.279104232788086,
      15.232000350952148,
      15.295488357543945,
      15.3057279586792,
      15.285247802734375,
      15.279104232788086,
      15.28320026397705,
      15.338496208190918,
      15.269887924194336,
      15.276032447814941,
      15.357952117919922,
      15.268863677978516,
      15.256575584411621,
      15.28012752532959,
      15.236096382141113,
      15.256575584411621,
      15.246335983276367,
      15.262720108032227,
      15.301631927490234,
      15.233023643493652,
      15.29139232635498,
      15.313920021057129,
      15.29139232635498,
      15.241215705871582,
      15.233023643493652,
      15.253503799438477,
      15.286272048950195,
      15.263744354248047,
      15.260671615600586,
      15.28012752532959,
      15.263744354248047,
      15.253503799438477,
      15.271936416625977,
      15.293439865112305,
      15.313920021057129
     ],
     "correct": [
      9785,
      9792,
      9783,
      9786,
      9786,
      9798,
      9785,
      9800,
      9781,
      9790,
      9795,
      9806,
      9800,
      9778,
      9782,
      9808,
      9780,
      9776,
      9783,
      9791,
      9787,
      9777,
      9791,
      9805,
      9772,
      9762,
      9786,
      9783,
      9801,
      9804,
      9782,
      9794,
      9777,
      9803,
      9790,
      9796,
      9786,
      9795,
      9789,
      9800,
      9778,
      9794,
      9794,
      9802,
      9794,
      9768,
      9779,
      9807,
      9786,
      9775,
      9771,
      9791,
      9785,
      9775,
      9780,
      9793,
      9782,
      9767,
      9797,
      9780,
      9809,
      9790,
      9781,
      9795,
      9777,
      9815,
      9785,
      9785,
      9778,
      9803,
      9781,
      9802,
      9782,
      9800,
      9793,
      9809,
      9795,
      9771,
      9776,
      9802,
      9788,
      9760,
      9776,
      9793,
      9785,
      9769,
      9790,
      9788,
      9779,
      9768,
      9788,
      9783,
      9801,
      9792,
      9784,
      9797,
      9779,
      9804,
      9791,
      9792,
      9785,
      9806,
      9784,
      9793,
      9782,
      9792,
      9796,
      9794,
      9791,
      9767,
      9787,
      9799,
      9790,
      9774,
      9782,
      9790,
      9785,
      9778,
      9787,
      9790,
      9778,
      9775,
      9784,
      9790,
      9803,
      9802,
      9788,
      9801,
      9783,
      9804,
      9787,
      9788,
      9779,
      9798,
      9789,
      9791,
      9781,
      9792,
      9793,
      9794,
      9782,
      9763,
      9781,
      9799,
      9790,
      9775,
      9783,
      9791,
      9788,
      9774,
      9792,
      9795,
      9790,
      9761,
      9796,
      9792,
      9805,
      9788,
      9792,
      9797,
      9780,
      9795,
      9789,
      9797,
      9770,
      9809,
      9782,
      9798,
      9784,
      9791,
      9792,
      9805,
      9792,
      9770,
      9778,
      9810,
      9787,
      9770,
      9790,
      9789,
      9785,
      9777,
      9781,
      9790,
      9776,
      9766,
      9793,
      9786,
      9803,
      9797,
      9782,
      9791,
      9777,
      9803,
      9787,
      9790,
      9779,
      9811,
      9784,
      9787,
      9787,
      9795,
      9800,
      9802,
      9789,
      9768,
      9780,
      9803,
      9796,
      9774,
      9786,
      9792,
      9789,
      9780,
      9788,
      9808,
      9783,
      9764,
      9793,
      9789,
      9803,
      9786,
      9787,
      9795,
      9777,
      9802,
      9781,
      9790,
      9782,
      9807,
      9787,
      9791,
      9783,
      9799,
      9785,
      9793,
      9794,
      9772,
      9773,
      9810,
      9793,
      9772,
      9780,
      9788,
      9782,
      9776,
      9790,
      9794,
      9792,
      9762,
      9786,
      9779,
      9809,
      9793,
      9784,
      9799,
      9786,
      9806,
      9788,
      9792,
      9786,
      9801,
      9790,
      9795,
      9786,
      9791,
      9796,
      9798,
      9790,
      9769,
      9777,
      9789,
      9797,
      9773,
      9788,
      9790,
      9782,
      9775,
      9783,
      9797,
      9778,
      9758,
      9798,
      9784,
      9809,
      9794,
      9791,
      9797,
      9783,
      9802,
      9791,
      9787,
      9778,
      9795,
      9787,
      9797,
      9785,
      9800,
      9787,
      9801,
      9788,
      9769,
      9771,
      9805,
      9788,
      9766,
      9775,
      9786,
      9775,
      9778,
      9786,
      9794,
      9774,
      9771,
      9791,
      9779,
      9804,
      9788,
      9783,
      9792,
      9779,
      9809,
      9793,
      9792,
      9766,
      9796,
      9789,
      9785,
      9791,
      9790,
      9795,
      9799,
      9793,
      9775,
      9782,
      9803,
      9789,
      9773,
      9786,
      9783,
      9789,
      9767,
      9785,
      9792,
      9770,
      9768,
      9794,
      9787,
      9803,
      9789,
      9787,
      9792,
      9784,
      9800,
      9787,
      9796,
      9780,
      9810,
      9783,
      9793,
      9785,
      9788,
      9800,
      9794,
      9788,
      9764,
      9775,
      9797,
      9797,
      9777,
      9787,
      9788,
      9790,
      9778,
      9781,
      9802,
      9779,
      9768,
      9791,
      9790,
      9807,
      9794,
      9787,
      9799,
      9780,
      9806,
      9791,
      9794,
      9765,
      9799,
      9777,
      9803,
      9783,
      9794,
      9797,
      9802,
      9793,
      9772,
      9780,
      9806,
      9792,
      9766,
      9780,
      9792,
      9791,
      9771,
      9787,
      9798,
      9786,
      9763,
      9787,
      9787,
      9803,
      9794,
      9785,
      9796,
      9782,
      9802,
      9787,
      9793,
      9773,
      9815,
      9784,
      9798,
      9785,
      9798,
      9794,
      9801,
      9794,
      9775,
      9766,
      9802,
      9786,
      9770,
      9781,
      9788,
      9785,
      9773,
      9789,
      9799,
      9778,
      9773,
      9799,
      9787,
      9807,
      9790,
      9788,
      9792,
      9779,
      9798,
      9780,
      9791,
      9785,
      9803,
      9782,
      9794,
      9783,
      9795,
      9789,
      9810,
      9785,
      9769,
      9777,
      9802,
      9784,
      9772,
      9782,
      9796,
      9784,
      9764,
      9787,
      9784,
      9785,
      9761,
      9785,
      9784,
      9803,
      9789,
      9781,
      9798,
      9786,
      9807,
      9786,
      9788,
      9780,
      9803,
      9789,
      9798,
      9783,
      9794,
      9792,
      9807,
      9794,
      9775,
      9770,
      9795,
      9796,
      9769,
      9786,
      9785,
      9788,
      9774,
      9784,
      9789,
      9781,
      9769,
      9795,
      9777,
      9808,
      9805,
      9787,
      9800,
      9787,
      9796,
      9791,
      9789,
      9774,
      9796,
      9792,
      9793,
      9781,
      9793,
      9794,
      9799,
      9798,
      9776,
      9783,
      9807,
      9786,
      9764,
      9777,
      9786,
      9787,
      9779,
      9785,
      9789,
      9779,
      9767,
      9795,
      9788,
      9808,
      9802,
      9778,
      9793,
      9787,
      9799,
      9787,
      9785,
      9784,
      9797,
      9784,
      9798,
      9789,
      9793,
      9787,
      9798,
      9799,
      9772,
      9776,
      9795,
      9789,
      9773,
      9790,
      9794,
      9780,
      9775,
      9794,
      9797,
      9775,
      9765,
      9793,
      9796,
      9807,
      9798,
      9783,
      9793,
      9783,
      9803,
      9790,
      9790,
      9770,
      9800,
      9778,
      9804,
      9782,
      9805,
      9799,
      9804,
      9797,
      9772,
      9783,
      9802,
      9792,
      9770,
      9779,
      9797,
      9789,
      9770,
      9791,
      9797,
      9782,
      9762,
      9785,
      9785,
      9798,
      9796,
      9787,
      9794,
      9782,
      9805,
      9781,
      9782,
      9777,
      9806,
      9785,
      9798,
      9780,
      9805,
      9794,
      9802,
      9791,
      9770,
      9767,
      9802,
      9796,
      9770,
      9787,
      9790,
      9788,
      9780,
      9786,
      9797,
      9791,
      9769,
      9794,
      9779,
      9798,
      9802,
      9786,
      9795,
      9776,
      9801,
      9791,
      9788,
      9782,
      9798,
      9781,
      9797,
      9781,
      9787,
      9787,
      9803,
      9800,
      9768,
      9776,
      9803,
      9791,
      9768,
      9779,
      9782,
      9787,
      9774,
      9785,
      9798,
      9781,
      9759,
      9797,
      9789,
      9797,
      9800,
      9778,
      9801,
      9783,
      9801,
      9784,
      9784,
      9779,
      9798,
      9791,
      9794,
      9790,
      9794,
      9791,
      9793,
      9796,
      9772,
      9771,
      9806,
      9789,
      9769,
      9780,
      9787,
      9782,
      9780,
      9795,
      9792,
      9777,
      9771,
      9783,
      9791,
      9802,
      9802,
      9781,
      9793,
      9775,
      9804,
      9785,
      9788,
      9778,
      9802,
      9783,
      9789,
      9780,
      9797,
      9794,
      9795,
      9786,
      9772,
      9772,
      9806,
      9788,
      9769,
      9778,
      9791,
      9785,
      9776,
      9783,
      9795,
      9784,
      9773,
      9794,
      9781,
      9802,
      9791,
      9794,
      9802,
      9781,
      9803,
      9792,
      9784,
      9779,
      9800,
      9784,
      9801,
      9785,
      9797,
      9795,
      9801,
      9794,
      9762,
      9783,
      9804,
      9796,
      9773,
      9779,
      9784,
      9780,
      9772,
      9786,
      9798,
      9775,
      9768,
      9793,
      9792,
      9809,
      9793,
      9785,
      9791,
      9780,
      9802,
      9792,
      9793,
      9769,
      9796,
      9780,
      9803,
      9784,
      9804,
      9789,
      9799,
      9792,
      9776,
      9776,
      9807,
      9801,
      9766,
      9785,
      9796,
      9790,
      9772,
      9788,
      9791,
      9784,
      9766,
      9803,
      9784,
      9814,
      9796,
      9782,
      9790,
      9778,
      9803,
      9792,
      9787,
      9776,
      9808,
      9785,
      9803,
      9793,
      9790,
      9789,
      9790,
      9797,
      9774,
      9780,
      9801,
      9792,
      9761,
      9795,
      9782,
      9790,
      9776,
      9788,
      9797,
      9785,
      9771,
      9783,
      9777,
      9808,
      9781,
      9790,
      9794,
      9776,
      9803,
      9790,
      9792,
      9788,
      9807,
      9780,
      9785,
      9798,
      9791,
      9781,
      9803,
      9800,
      9770,
      9779,
      9813,
      9789,
      9775,
      9782,
      9784,
      9783,
      9776,
      9787,
      9795,
      9785,
      9773,
      9790,
      9792,
      9809,
      9790,
      9784,
      9794,
      9783,
      9801,
      9789,
      9784,
      9781,
      9805,
      9791,
      9795,
      9786,
      9798,
      9799,
      9797,
      9799,
      9771,
      9783,
      9805,
      9795,
      9774,
      9776,
      9791,
      9779,
      9778,
      9784,
      9794,
      9779,
      9770,
      9790,
      9782,
      9804,
      9791,
      9795,
      9803,
      9786,
      9803,
      9787,
      9790,
      9777,
      9812,
      9784,
      9794,
      9789,
      9788,
      9791,
      9803,
      9795,
      9775,
      9773,
      9805,
      9788,
      9777,
      9786,
      9779,
      9787,
      9779,
      9791,
      9793,
      9772,
      9762,
      9791,
      9785,
      9807,
      9798,
      9785,
      9795,
      9781,
      9797,
      9788,
      9778,
      9776,
      9803,
      9791,
      9797,
      9780,
      9793,
      9805,
      9803,
      9792,
      9778,
      9779,
      9798,
      9793,
      9779,
      9782,
      9793,
      9779,
      9775,
      9784,
      9791,
      9778,
      9768,
      9777,
      9793,
      9801,
      9797,
      9788,
      9792,
      9784,
      9804,
      9793,
      9792,
      9778,
      9803,
      9782,
      9796,
      9787,
      9792,
      9794,
      9805,
      9799,
      9771,
      9778,
      9799,
      9796,
      9771,
      9779,
      9787,
      9786,
      9779,
      9787,
      9794,
      9782,
      9773,
      9788,
      9780,
      9803,
      9797,
      9791,
      9792,
      9778,
      9807,
      9792,
      9796,
      9777,
      9794,
      9783,
      9794,
      9776,
      9797,
      9799
     ]
    },
    {
     "name": "idle 4",
     "seconds": 5.005000648000021,
     "joules": 359.392,
     "utilization_max": 0,
     "contexts": 1
    }
   ]
  }
 }
}
