{
 "returncode": 0,
 "stdout": "submission.py:hybrid_d4 at 2.30% error: 15 timed calls, each in a fresh process\n  review flag: embedded weights? 417 numeric literals\n  review flag: 20,429 bytes, close to the 20,480-byte limit\n  NVIDIA A100-SXM4-80GB, torch 2.12.0+cu130, sandbox on\n  call  1/15: 18.693 ms, scorer's clock 19.127 ms\n  call  2/15: 18.673 ms, scorer's clock 22.454 ms\n  call  3/15: 18.604 ms, scorer's clock 22.011 ms\n  call  4/15: 18.761 ms, scorer's clock 21.924 ms\n  call  5/15: 18.632 ms, scorer's clock 21.374 ms\n  call  6/15: 18.746 ms, scorer's clock 22.672 ms\n  call  7/15: 18.610 ms, scorer's clock 22.060 ms\n  call  8/15: 18.696 ms, scorer's clock 22.589 ms\n  call  9/15: 18.718 ms, scorer's clock 23.475 ms\n  call 10/15: 18.674 ms, scorer's clock 22.530 ms\n  call 11/15: 18.703 ms, scorer's clock 22.098 ms\n  call 12/15: 18.686 ms, scorer's clock 21.999 ms\n  call 13/15: 18.634 ms, scorer's clock 22.185 ms\n  call 14/15: 18.578 ms, scorer's clock 22.182 ms\n  call 15/15: 18.755 ms, scorer's clock 22.134 ms\nMNIST 97.89% (107,679/110,000), 22.072 ms/call; hold-out (fashion) 88.47%, 21.282 ms/call (floored by the scorer's clock); score 22.072 ms\nenergy: one more fresh process runs the method back to back on fresh MNIST draws for 20 s, between idle windows in which it is frozen\n  NVIDIA A100-SXM4-80GB: idle 71.5 W with the method frozen; telemetry reference 18.3 TFLOP/s at 7.70 J/TFLOP above idle (a healthy NVIDIA A100-SXM4-80GB reads 6-11)\n  the round trip alone: 13.1 mJ per call over 2,349 empty calls, subtracted\n  the method: 835 calls in 20.0 s, MNIST 97.87%, 15.265 ms per call, 164.9 W on average\nenergy 2223.927 mJ per call above idle\n",
 "stderr": "/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n/usr/local/lib/python3.13/site-packages/torch/_inductor/lowering.py:2158: FutureWarning: `torch._prims_common.check` is deprecated and will be removed in the future. Please use `torch._check*` functions instead.\n  check(\n",
 "record": {
  "version": "mnist-a100/1.2.0 (protections of sutro-mnist-medium/3.0.0, tightened; energy column)",
  "file": "submission.py",
  "function": "hybrid_d4",
  "source_sha256": "02755ca6031242b0ef29ded5ba2f4f78ee7e592e120694edb3a4d2ed65f9d010",
  "band_bp": 230,
  "sandboxed": true,
  "holdout": "fashion",
  "device": "NVIDIA A100-SXM4-80GB",
  "torch": "2.12.0+cu130",
  "calls": [
   {
    "dataset": "fashion",
    "ms": 18.693119049072266,
    "parent_ms": 22.212032000002324,
    "correct": 8832,
    "total": 10000,
    "overhead_ms": 3.0851030025863224
   },
   {
    "dataset": "mnist",
    "ms": 18.672639846801758,
    "parent_ms": 25.262933000000487,
    "correct": 9790,
    "total": 10000,
    "overhead_ms": 2.8093005015491315
   },
   {
    "dataset": "mnist",
    "ms": 18.604032516479492,
    "parent_ms": 24.95365899999058,
    "correct": 9787,
    "total": 10000,
    "overhead_ms": 2.9422424992963556
   },
   {
    "dataset": "mnist",
    "ms": 18.760704040527344,
    "parent_ms": 25.042921999997247,
    "correct": 9796,
    "total": 10000,
    "overhead_ms": 3.1189545023254936
   },
   {
    "dataset": "mnist",
    "ms": 18.63167953491211,
    "parent_ms": 24.41437400000268,
    "correct": 9797,
    "total": 10000,
    "overhead_ms": 3.040341496611461
   },
   {
    "dataset": "mnist",
    "ms": 18.746368408203125,
    "parent_ms": 25.55483000000436,
    "correct": 9777,
    "total": 10000,
    "overhead_ms": 2.883298501022523
   },
   {
    "dataset": "fashion",
    "ms": 18.61017608642578,
    "parent_ms": 25.252771999987544,
    "correct": 8825,
    "total": 10000,
    "overhead_ms": 3.193160498774546
   },
   {
    "dataset": "mnist",
    "ms": 18.696191787719727,
    "parent_ms": 25.766100999987884,
    "correct": 9788,
    "total": 10000,
    "overhead_ms": 3.1767615007605627
   },
   {
    "dataset": "mnist",
    "ms": 18.717695236206055,
    "parent_ms": 26.014860000003637,
    "correct": 9764,
    "total": 10000,
    "overhead_ms": 2.5401685003378134
   },
   {
    "dataset": "fashion",
    "ms": 18.673664093017578,
    "parent_ms": 25.422611999999845,
    "correct": 8869,
    "total": 10000,
    "overhead_ms": 2.892310000527914
   },
   {
    "dataset": "mnist",
    "ms": 18.703359603881836,
    "parent_ms": 25.162654999974166,
    "correct": 9809,
    "total": 10000,
    "overhead_ms": 3.0647044994559565
   },
   {
    "dataset": "mnist",
    "ms": 18.685951232910156,
    "parent_ms": 25.047164000000066,
    "correct": 9785,
    "total": 10000,
    "overhead_ms": 3.0483964973079765
   },
   {
    "dataset": "mnist",
    "ms": 18.63372802734375,
    "parent_ms": 25.23215999997319,
    "correct": 9802,
    "total": 10000,
    "overhead_ms": 3.0467090022314096
   },
   {
    "dataset": "fashion",
    "ms": 18.578432083129883,
    "parent_ms": 24.85083700003088,
    "correct": 8863,
    "total": 10000,
    "overhead_ms": 2.6683920018338085
   },
   {
    "dataset": "mnist",
    "ms": 18.754560470581055,
    "parent_ms": 24.752303000013853,
    "correct": 9784,
    "total": 10000,
    "overhead_ms": 2.6180304999086275
   }
  ],
  "problems": [],
  "summary": "MNIST 97.89% (107,679/110,000), 22.072 ms/call; hold-out (fashion) 88.47%, 21.282 ms/call (floored by the scorer's clock)",
  "ranked_ms": 22.07154713141936,
  "energy": {
   "mj_per_call": 2223.927397893187,
   "problems": [],
   "net_mj_before_control": 2237.0636972768148,
   "control_mj_per_call": 13.136299383627858,
   "control_calls": 2349,
   "gross_mj_per_call": 3950.677844311377,
   "idle_w": 71.50996294538885,
   "active_w": 164.86373361515976,
   "calls": 835,
   "seconds": 20.009349100999998,
   "ms_median": 15.26476764678955,
   "timed_mnist_ms_median": 18.696191787719727,
   "correct": 8172203,
   "total": 8350000,
   "reference": {
    "tflops_per_s": 18.27850017026907,
    "j_per_tflop": 7.700043717864596,
    "exact": true,
    "band": [
     [
      6.0,
      11.0
     ],
     [
      15.0,
      23.0
     ]
    ]
   },
   "device": {
    "name": "NVIDIA A100-SXM4-80GB",
    "uuid": "GPU-a1e78c17-b11f-6ffa-ed88-54920fca05c7",
    "vbios": "92.00.9E.00.01",
    "driver": "610.57.04",
    "power_limit_w": 400.0
   },
   "windows": [
    {
     "name": "idle 1",
     "seconds": 5.008811315999992,
     "joules": 356.304,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "reference",
     "seconds": 5.17318155800001,
     "joules": 1097.124,
     "matmuls": 688,
     "dim": 4096,
     "exact": true
    },
    {
     "name": "idle 2",
     "seconds": 5.00576111099997,
     "joules": 358.074,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "control",
     "seconds": 5.0050147830000355,
     "joules": 388.177,
     "calls": 2349
    },
    {
     "name": "idle 3",
     "seconds": 5.005449125000041,
     "joules": 356.65,
     "utilization_max": 0,
     "contexts": 1
    },
    {
     "name": "method",
     "seconds": 20.009349100999998,
     "joules": 3298.816,
     "calls": 835,
     "ms": [
      18.66547203063965,
      18.65216064453125,
      18.595840454101562,
      18.61734390258789,
      18.63987159729004,
      18.60198402404785,
      18.687999725341797,
      18.689023971557617,
      18.65216064453125,
      18.681856155395508,
      18.670591354370117,
      18.677759170532227,
      18.6112003326416,
      15.524864196777344,
      15.201279640197754,
      15.233023643493652,
      15.205375671386719,
      15.230976104736328,
      15.253503799438477,
      15.236096382141113,
      15.265791893005371,
      15.26476764678955,
      15.19923210144043,
      15.240192413330078,
      15.269887924194336,
      15.229951858520508,
      15.250432014465332,
      15.228927612304688,
      15.203328132629395,
      15.211520195007324,
      15.184896469116211,
      15.253503799438477,
      15.261695861816406,
      15.334400177001953,
      15.38969612121582,
      15.646719932556152,
      15.253503799438477,
      15.249407768249512,
      15.228927612304688,
      15.240192413330078,
      15.221759796142578,
      15.257599830627441,
      15.263744354248047,
      15.262720108032227,
      15.256575584411621,
      15.236096382141113,
      15.2739839553833,
      15.278079986572266,
      15.294464111328125,
      15.256575584411621,
      15.318016052246094,
      15.354880332946777,
      15.383551597595215,
      15.26476764678955,
      15.242239952087402,
      15.263744354248047,
      15.268863677978516,
      15.261695861816406,
      15.279104232788086,
      15.322112083435059,
      15.294464111328125,
      15.263744354248047,
      15.308799743652344,
      15.258624076843262,
      15.258624076843262,
      15.28012752532959,
      15.28012752532959,
      15.30675220489502,
      15.351807594299316,
      15.39583969116211,
      15.28012752532959,
      15.319040298461914,
      15.30675220489502,
      15.30777645111084,
      15.318016052246094,
      15.38969612121582,
      15.301631927490234,
      15.29036808013916,
      15.287296295166016,
      15.294464111328125,
      15.29958438873291,
      15.29856014251709,
      15.270912170410156,
      15.29651165008545,
      15.271936416625977,
      15.321087837219238,
      15.433728218078613,
      15.300607681274414,
      15.28115177154541,
      15.269887924194336,
      15.309823989868164,
      15.312895774841309,
      15.261695861816406,
      15.332351684570312,
      15.250432014465332,
      15.29856014251709,
      15.287296295166016,
      15.549440383911133,
      15.319040298461914,
      15.233023643493652,
      15.28934383392334,
      15.246335983276367,
      15.302656173706055,
      15.28934383392334,
      15.261695861816406,
      15.28012752532959,
      15.429632186889648,
      15.394816398620605,
      15.343615531921387,
      15.28012752532959,
      15.27295970916748,
      15.262720108032227,
      15.39891242980957,
      15.29856014251709,
      15.318016052246094,
      15.313920021057129,
      15.319040298461914,
      15.303680419921875,
      15.295488357543945,
      15.427583694458008,
      15.285247802734375,
      15.258624076843262,
      15.303680419921875,
      15.29139232635498,
      15.30777645111084,
      15.341567993164062,
      15.295488357543945,
      15.364095687866211,
      15.29856014251709,
      15.244288444519043,
      15.29856014251709,
      15.28831958770752,
      15.321087837219238,
      15.28320026397705,
      15.28012752532959,
      15.356927871704102,
      15.293439865112305,
      15.238143920898438,
      15.335424423217773,
      15.259648323059082,
      15.308799743652344,
      15.270912170410156,
      18.052095413208008,
      15.30675220489502,
      15.262720108032227,
      15.276032447814941,
      15.278079986572266,
      15.352831840515137,
      15.352831840515137,
      15.304703712463379,
      15.26476764678955,
      15.251456260681152,
      15.270912170410156,
      15.279104232788086,
      15.252479553222656,
      15.185919761657715,
      15.269887924194336,
      15.329279899597168,
      15.275008201599121,
      15.294464111328125,
      15.28831958770752,
      15.250432014465332,
      15.312895774841309,
      15.29036808013916,
      15.268863677978516,
      15.311871528625488,
      15.334400177001953,
      15.28115177154541,
      15.266816139221191,
      15.292415618896484,
      15.300607681274414,
      15.319040298461914,
      15.373311996459961,
      15.312895774841309,
      15.266816139221191,
      15.294464111328125,
      15.343615531921387,
      15.312895774841309,
      15.28217601776123,
      15.278079986572266,
      15.304703712463379,
      15.300607681274414,
      15.278079986572266,
      15.303680419921875,
      15.279104232788086,
      15.28320026397705,
      15.277055740356445,
      15.350784301757812,
      15.316991806030273,
      15.308799743652344,
      15.39072036743164,
      15.30675220489502,
      15.447039604187012,
      15.345664024353027,
      15.304703712463379,
      15.271936416625977,
      15.324159622192383,
      15.352831840515137,
      15.410176277160645,
      15.28115177154541,
      15.253503799438477,
      15.277055740356445,
      15.28320026397705,
      15.294464111328125,
      15.270912170410156,
      15.309823989868164,
      15.310848236083984,
      15.51257610321045,
      15.277055740356445,
      15.302656173706055,
      15.29036808013916,
      16.063488006591797,
      15.359999656677246,
      15.311871528625488,
      15.285247802734375,
      15.302656173706055,
      15.246335983276367,
      15.27295970916748,
      15.358976364135742,
      15.29856014251709,
      15.2739839553833,
      15.270912170410156,
      15.275008201599121,
      15.308799743652344,
      15.262720108032227,
      15.256575584411621,
      15.221759796142578,
      15.28831958770752,
      15.29036808013916,
      15.29139232635498,
      15.412223815917969,
      15.269887924194336,
      15.268863677978516,
      15.260671615600586,
      15.27295970916748,
      15.258624076843262,
      15.263744354248047,
      15.29036808013916,
      15.286272048950195,
      15.343615531921387,
      15.26476764678955,
      15.30675220489502,
      15.239168167114258,
      15.284223556518555,
      15.518719673156738,
      15.302656173706055,
      15.252479553222656,
      15.311871528625488,
      15.294464111328125,
      15.257599830627441,
      15.241215705871582,
      15.265791893005371,
      15.262720108032227,
      15.232000350952148,
      15.322112083435059,
      15.403008460998535,
      15.333375930786133,
      15.309823989868164,
      15.276032447814941,
      15.308799743652344,
      15.31494426727295,
      15.338496208190918,
      15.29753589630127,
      15.323136329650879,
      16.951295852661133,
      15.28320026397705,
      15.337471961975098,
      15.351807594299316,
      15.275008201599121,
      15.31494426727295,
      15.277055740356445,
      15.401984214782715,
      15.39891242980957,
      15.348735809326172,
      15.320063591003418,
      15.370240211486816,
      15.444992065429688,
      15.335424423217773,
      15.251456260681152,
      15.268863677978516,
      15.382528305053711,
      15.28115177154541,
      15.260671615600586,
      15.335424423217773,
      15.392767906188965,
      15.492095947265625,
      15.240192413330078,
      15.322112083435059,
      15.263744354248047,
      15.241215705871582,
      15.237119674682617,
      15.555583953857422,
      15.267840385437012,
      15.300607681274414,
      15.304703712463379,
      15.29036808013916,
      15.355903625488281,
      15.482879638671875,
      15.473664283752441,
      15.233023643493652,
      15.399935722351074,
      15.332351684570312,
      15.247360229492188,
      15.350784301757812,
      15.256575584411621,
      15.3057279586792,
      15.256575584411621,
      15.254528045654297,
      15.262720108032227,
      15.304703712463379,
      15.376383781433105,
      15.39891242980957,
      15.275008201599121,
      15.276032447814941,
      15.346688270568848,
      15.29651165008545,
      15.308799743652344,
      15.266816139221191,
      15.295488357543945,
      15.29139232635498,
      15.29753589630127,
      15.285247802734375,
      15.267840385437012,
      15.269887924194336,
      15.29958438873291,
      15.28217601776123,
      15.30777645111084,
      16.392192840576172,
      15.26476764678955,
      15.252479553222656,
      15.302656173706055,
      15.346688270568848,
      15.28012752532959,
      15.242239952087402,
      15.301631927490234,
      15.28115177154541,
      15.259648323059082,
      15.27295970916748,
      15.262720108032227,
      15.302656173706055,
      15.28115177154541,
      15.246335983276367,
      15.275008201599121,
      15.327232360839844,
      15.243264198303223,
      15.295488357543945,
      15.30675220489502,
      15.238143920898438,
      15.245311737060547,
      15.242239952087402,
      15.303680419921875,
      15.270912170410156,
      15.252479553222656,
      15.265791893005371,
      15.246335983276367,
      15.28217601776123,
      15.355903625488281,
      15.293439865112305,
      15.315967559814453,
      15.416319847106934,
      15.300607681274414,
      15.369215965270996,
      15.286272048950195,
      15.266816139221191,
      15.276032447814941,
      15.253503799438477,
      15.349760055541992,
      15.255552291870117,
      15.260671615600586,
      15.29958438873291,
      15.270912170410156,
      15.258624076843262,
      15.253503799438477,
      15.31494426727295,
      15.253503799438477,
      15.28217601776123,
      15.262720108032227,
      15.29753589630127,
      15.278079986572266,
      15.324159622192383,
      15.276032447814941,
      15.275008201599121,
      15.248384475708008,
      15.286272048950195,
      15.262720108032227,
      15.28217601776123,
      15.26476764678955,
      15.258624076843262,
      15.263744354248047,
      15.254528045654297,
      15.262720108032227,
      15.37228775024414,
      15.335424423217773,
      15.270912170410156,
      15.240192413330078,
      15.253503799438477,
      15.349760055541992,
      15.261695861816406,
      15.28831958770752,
      15.254528045654297,
      15.386624336242676,
      15.340543746948242,
      15.29856014251709,
      15.410176277160645,
      15.268863677978516,
      15.361023902893066,
      15.229951858520508,
      15.340543746948242,
      15.261695861816406,
      15.268863677978516,
      15.285247802734375,
      15.28012752532959,
      15.21664047241211,
      15.342592239379883,
      15.331328392028809,
      15.391743659973145,
      15.257599830627441,
      15.271936416625977,
      15.378432273864746,
      15.246335983276367,
      15.319040298461914,
      15.270912170410156,
      15.336447715759277,
      15.278079986572266,
      15.318016052246094,
      15.259648323059082,
      15.262720108032227,
      15.421440124511719,
      15.385600090026855,
      15.378432273864746,
      15.263744354248047,
      15.269887924194336,
      15.563776016235352,
      15.326208114624023,
      15.261695861816406,
      15.28320026397705,
      15.49824047088623,
      15.326208114624023,
      15.359999656677246,
      15.403008460998535,
      15.326208114624023,
      15.255552291870117,
      15.271936416625977,
      15.313920021057129,
      15.361023902893066,
      15.28934383392334,
      15.344639778137207,
      15.469568252563477,
      15.368191719055176,
      15.286272048950195,
      15.345664024353027,
      15.319040298461914,
      15.261695861816406,
      15.269887924194336,
      15.315967559814453,
      15.350784301757812,
      15.378432273864746,
      15.259648323059082,
      15.28115177154541,
      15.323136329650879,
      15.294464111328125,
      15.354880332946777,
      15.265791893005371,
      15.312895774841309,
      15.302656173706055,
      15.260671615600586,
      15.324159622192383,
      15.39788818359375,
      15.300607681274414,
      15.26476764678955,
      15.349760055541992,
      15.502335548400879,
      15.311871528625488,
      15.29958438873291,
      15.258624076843262,
      15.284223556518555,
      15.328255653381348,
      15.452159881591797,
      15.325183868408203,
      15.285247802734375,
      15.326208114624023,
      15.256575584411621,
      16.02457618713379,
      15.276032447814941,
      15.426560401916504,
      15.269887924194336,
      15.250432014465332,
      15.286272048950195,
      15.279104232788086,
      15.26476764678955,
      15.2739839553833,
      15.257599830627441,
      15.246335983276367,
      15.243264198303223,
      15.213567733764648,
      15.243264198303223,
      15.245311737060547,
      15.212544441223145,
      15.241215705871582,
      15.261695861816406,
      15.220735549926758,
      15.235072135925293,
      15.236096382141113,
      15.232000350952148,
      15.234047889709473,
      15.215616226196289,
      15.260671615600586,
      15.262720108032227,
      15.260671615600586,
      15.266816139221191,
      15.225855827331543,
      15.177727699279785,
      15.27295970916748,
      15.269887924194336,
      15.243264198303223,
      15.06713581085205,
      15.1910400390625,
      15.242239952087402,
      15.304703712463379,
      15.201279640197754,
      15.153152465820312,
      15.223808288574219,
      15.238143920898438,
      15.228927612304688,
      15.18182373046875,
      15.170559883117676,
      15.16543960571289,
      15.257599830627441,
      15.215616226196289,
      15.26476764678955,
      15.215616226196289,
      15.242239952087402,
      15.38969612121582,
      15.29753589630127,
      15.237119674682617,
      15.262720108032227,
      15.140864372253418,
      15.205375671386719,
      15.227904319763184,
      15.209471702575684,
      15.240192413330078,
      15.250432014465332,
      15.21664047241211,
      15.245311737060547,
      15.28831958770752,
      15.214591979980469,
      15.267840385437012,
      15.245311737060547,
      15.229951858520508,
      15.240192413330078,
      15.246335983276367,
      15.244288444519043,
      15.275008201599121,
      15.215616226196289,
      15.232000350952148,
      15.285247802734375,
      15.278079986572266,
      15.223808288574219,
      15.219712257385254,
      15.263744354248047,
      15.210495948791504,
      15.223808288574219,
      15.263744354248047,
      15.222784042358398,
      15.261695861816406,
      15.202303886413574,
      15.248384475708008,
      15.237119674682617,
      15.246335983276367,
      15.233023643493652,
      15.249407768249512,
      15.240192413330078,
      15.500288009643555,
      15.244288444519043,
      15.218688011169434,
      15.254528045654297,
      15.232000350952148,
      15.206399917602539,
      15.260671615600586,
      15.210495948791504,
      15.195136070251465,
      15.211520195007324,
      15.227904319763184,
      15.254528045654297,
      15.234047889709473,
      15.255552291870117,
      15.268863677978516,
      15.233023643493652,
      15.238143920898438,
      15.223808288574219,
      15.258624076843262,
      15.175680160522461,
      15.245311737060547,
      15.29753589630127,
      15.247360229492188,
      15.171584129333496,
      15.242239952087402,
      15.277055740356445,
      15.258624076843262,
      15.229951858520508,
      15.286272048950195,
      15.222784042358398,
      15.255552291870117,
      15.279104232788086,
      15.210495948791504,
      15.242239952087402,
      15.211520195007324,
      15.234047889709473,
      15.221759796142578,
      15.266816139221191,
      15.163392066955566,
      15.220735549926758,
      15.210495948791504,
      15.225855827331543,
      15.238143920898438,
      15.258624076843262,
      15.21664047241211,
      15.228927612304688,
      15.268863677978516,
      15.195136070251465,
      15.261695861816406,
      15.195136070251465,
      15.227904319763184,
      15.211520195007324,
      15.180800437927246,
      15.243264198303223,
      15.361023902893066,
      15.226880073547363,
      15.170559883117676,
      15.251456260681152,
      15.197183609008789,
      15.220735549926758,
      15.202303886413574,
      15.223808288574219,
      15.220735549926758,
      15.238143920898438,
      15.236096382141113,
      15.212544441223145,
      15.267840385437012,
      15.228927612304688,
      15.263744354248047,
      15.236096382141113,
      15.221759796142578,
      15.576064109802246,
      15.236096382141113,
      15.241215705871582,
      15.235072135925293,
      15.226880073547363,
      15.243264198303223,
      15.266816139221191,
      15.228927612304688,
      15.215616226196289,
      15.221759796142578,
      15.225855827331543,
      15.227904319763184,
      15.237119674682617,
      15.217663764953613,
      15.232000350952148,
      15.205375671386719,
      15.204352378845215,
      15.252479553222656,
      15.227904319763184,
      15.18182373046875,
      15.230976104736328,
      15.258624076843262,
      15.19820785522461,
      15.243264198303223,
      15.225855827331543,
      15.246335983276367,
      15.234047889709473,
      15.326208114624023,
      15.238143920898438,
      15.158271789550781,
      15.17363166809082,
      15.175680160522461,
      15.225855827331543,
      15.213567733764648,
      15.263744354248047,
      15.261695861816406,
      15.215616226196289,
      15.28012752532959,
      15.20742416381836,
      15.213567733764648,
      15.225855827331543,
      15.245311737060547,
      15.238143920898438,
      15.219712257385254,
      15.285247802734375,
      15.261695861816406,
      15.230976104736328,
      15.221759796142578,
      15.218688011169434,
      15.218688011169434,
      15.21664047241211,
      15.259648323059082,
      15.234047889709473,
      15.241215705871582,
      15.229951858520508,
      15.225855827331543,
      15.222784042358398,
      15.205375671386719,
      15.248384475708008,
      15.203328132629395,
      15.228927612304688,
      15.300607681274414,
      15.224831581115723,
      15.228927612304688,
      15.242239952087402,
      15.211520195007324,
      15.229951858520508,
      15.240192413330078,
      15.239168167114258,
      15.234047889709473,
      15.269887924194336,
      15.201279640197754,
      15.241215705871582,
      15.210495948791504,
      15.229951858520508,
      15.742976188659668,
      15.228927612304688,
      15.28320026397705,
      15.266816139221191,
      15.229951858520508,
      15.225855827331543,
      15.249407768249512,
      15.19923210144043,
      15.217663764953613,
      15.271936416625977,
      15.205375671386719,
      15.243264198303223,
      15.220735549926758,
      15.227904319763184,
      15.214591979980469,
      15.225855827331543,
      15.234047889709473,
      15.252479553222656,
      15.242239952087402,
      15.211520195007324,
      15.244288444519043,
      15.255552291870117,
      15.253503799438477,
      15.196160316467285,
      15.219712257385254,
      15.246335983276367,
      15.228927612304688,
      15.232000350952148,
      15.242239952087402,
      15.357952117919922,
      15.225855827331543,
      15.331328392028809,
      15.275008201599121,
      15.251456260681152,
      15.253503799438477,
      15.226880073547363,
      15.303680419921875,
      15.222784042358398,
      15.259648323059082,
      15.194111824035645,
      15.179776191711426,
      15.303680419921875,
      15.375359535217285,
      15.237119674682617,
      15.225855827331543,
      15.251456260681152,
      15.20742416381836,
      15.26476764678955,
      15.270912170410156,
      15.254528045654297,
      15.238143920898438,
      15.268863677978516,
      15.261695861816406,
      15.26476764678955,
      15.218688011169434,
      15.204352378845215,
      15.225855827331543,
      15.253503799438477,
      15.239168167114258,
      15.225855827331543,
      15.235072135925293,
      15.242239952087402,
      15.209471702575684,
      15.237119674682617,
      15.242239952087402,
      15.20025634765625,
      15.219712257385254,
      15.236096382141113,
      15.266816139221191,
      15.223808288574219,
      15.18182373046875,
      15.176704406738281,
      15.229951858520508,
      15.256575584411621,
      15.236096382141113,
      15.221759796142578,
      15.239168167114258,
      15.247360229492188,
      15.226880073547363,
      15.262720108032227,
      15.246335983276367,
      15.247360229492188,
      15.228927612304688,
      15.226880073547363,
      15.238143920898438,
      15.221759796142578,
      15.253503799438477,
      15.226880073547363,
      15.239168167114258,
      15.224831581115723,
      15.227904319763184,
      15.209471702575684,
      15.224831581115723,
      15.204352378845215,
      15.214591979980469,
      15.225855827331543,
      15.256575584411621,
      15.211520195007324,
      15.227904319763184,
      15.247360229492188,
      15.246335983276367,
      15.20742416381836,
      15.257599830627441,
      15.239168167114258,
      15.195136070251465,
      15.20844841003418,
      15.239168167114258,
      15.239168167114258,
      15.277055740356445,
      15.234047889709473,
      15.221759796142578,
      15.203328132629395,
      15.243264198303223,
      15.250432014465332,
      15.253503799438477,
      15.277055740356445,
      15.309823989868164
     ],
     "correct": [
      9799,
      9791,
      9812,
      9801,
      9774,
      9785,
      9774,
      9791,
      9805,
      9795,
      9778,
      9785,
      9782,
      9803,
      9768,
      9780,
      9815,
      9773,
      9795,
      9795,
      9784,
      9788,
      9805,
      9795,
      9777,
      9771,
      9771,
      9764,
      9780,
      9792,
      9776,
      9777,
      9800,
      9797,
      9804,
      9803,
      9782,
      9784,
      9771,
      9786,
      9800,
      9794,
      9782,
      9779,
      9773,
      9806,
      9771,
      9778,
      9818,
      9786,
      9803,
      9816,
      9783,
      9788,
      9806,
      9801,
      9774,
      9774,
      9770,
      9757,
      9779,
      9792,
      9774,
      9780,
      9806,
      9801,
      9803,
      9801,
      9778,
      9786,
      9767,
      9796,
      9803,
      9790,
      9772,
      9788,
      9778,
      9798,
      9773,
      9782,
      9821,
      9776,
      9794,
      9804,
      9782,
      9789,
      9805,
      9797,
      9777,
      9767,
      9771,
      9757,
      9775,
      9787,
      9781,
      9779,
      9797,
      9798,
      9804,
      9801,
      9778,
      9772,
      9764,
      9787,
      9802,
      9789,
      9778,
      9784,
      9775,
      9803,
      9764,
      9772,
      9816,
      9788,
      9811,
      9804,
      9782,
      9788,
      9809,
      9798,
      9770,
      9775,
      9769,
      9771,
      9779,
      9790,
      9779,
      9780,
      9802,
      9789,
      9801,
      9795,
      9782,
      9778,
      9775,
      9790,
      9794,
      9788,
      9773,
      9777,
      9783,
      9801,
      9773,
      9774,
      9812,
      9778,
      9802,
      9798,
      9787,
      9786,
      9812,
      9795,
      9770,
      9778,
      9769,
      9763,
      9774,
      9783,
      9778,
      9777,
      9798,
      9796,
      9805,
      9801,
      9771,
      9780,
      9767,
      9795,
      9807,
      9784,
      9779,
      9786,
      9774,
      9801,
      9771,
      9780,
      9814,
      9782,
      9804,
      9797,
      9781,
      9794,
      9805,
      9796,
      9778,
      9781,
      9770,
      9763,
      9791,
      9791,
      9778,
      9779,
      9798,
      9793,
      9801,
      9799,
      9777,
      9782,
      9770,
      9797,
      9801,
      9786,
      9779,
      9788,
      9788,
      9802,
      9764,
      9783,
      9820,
      9782,
      9799,
      9798,
      9779,
      9787,
      9810,
      9795,
      9776,
      9769,
      9770,
      9765,
      9781,
      9791,
      9780,
      9779,
      9804,
      9800,
      9813,
      9798,
      9779,
      9786,
      9768,
      9794,
      9798,
      9791,
      9774,
      9787,
      9775,
      9809,
      9770,
      9775,
      9810,
      9775,
      9801,
      9811,
      9783,
      9791,
      9801,
      9806,
      9777,
      9774,
      9778,
      9767,
      9787,
      9793,
      9789,
      9777,
      9800,
      9787,
      9807,
      9798,
      9777,
      9790,
      9762,
      9792,
      9799,
      9789,
      9779,
      9783,
      9787,
      9813,
      9766,
      9784,
      9813,
      9777,
      9799,
      9804,
      9784,
      9789,
      9806,
      9794,
      9773,
      9769,
      9770,
      9768,
      9780,
      9795,
      9779,
      9770,
      9807,
      9797,
      9808,
      9798,
      9782,
      9782,
      9775,
      9782,
      9798,
      9797,
      9782,
      9780,
      9781,
      9809,
      9760,
      9782,
      9812,
      9777,
      9804,
      9801,
      9777,
      9788,
      9805,
      9795,
      9792,
      9773,
      9762,
      9766,
      9774,
      9789,
      9773,
      9782,
      9796,
      9791,
      9799,
      9801,
      9784,
      9779,
      9757,
      9789,
      9805,
      9798,
      9788,
      9782,
      9780,
      9810,
      9753,
      9775,
      9812,
      9775,
      9803,
      9808,
      9777,
      9790,
      9806,
      9794,
      9786,
      9768,
      9775,
      9765,
      9771,
      9793,
      9777,
      9775,
      9801,
      9797,
      9802,
      9800,
      9781,
      9778,
      9776,
      9796,
      9803,
      9793,
      9773,
      9782,
      9784,
      9808,
      9768,
      9773,
      9818,
      9781,
      9803,
      9805,
      9775,
      9789,
      9806,
      9792,
      9777,
      9772,
      9764,
      9764,
      9777,
      9795,
      9778,
      9781,
      9800,
      9797,
      9797,
      9803,
      9777,
      9787,
      9776,
      9787,
      9805,
      9786,
      9773,
      9787,
      9779,
      9806,
      9763,
      9774,
      9807,
      9777,
      9797,
      9803,
      9781,
      9786,
      9806,
      9800,
      9780,
      9771,
      9764,
      9763,
      9776,
      9786,
      9792,
      9769,
      9798,
      9798,
      9806,
      9798,
      9777,
      9782,
      9772,
      9790,
      9802,
      9788,
      9776,
      9778,
      9781,
      9802,
      9767,
      9784,
      9813,
      9778,
      9800,
      9800,
      9779,
      9791,
      9798,
      9794,
      9781,
      9774,
      9771,
      9769,
      9778,
      9803,
      9785,
      9776,
      9799,
      9801,
      9802,
      9798,
      9775,
      9785,
      9768,
      9793,
      9810,
      9787,
      9773,
      9791,
      9781,
      9810,
      9769,
      9775,
      9817,
      9778,
      9803,
      9801,
      9778,
      9792,
      9804,
      9798,
      9783,
      9782,
      9767,
      9769,
      9780,
      9788,
      9772,
      9779,
      9799,
      9794,
      9803,
      9802,
      9779,
      9787,
      9765,
      9783,
      9803,
      9791,
      9773,
      9790,
      9785,
      9805,
      9772,
      9774,
      9818,
      9785,
      9805,
      9802,
      9783,
      9794,
      9805,
      9792,
      9771,
      9771,
      9768,
      9757,
      9772,
      9791,
      9776,
      9775,
      9800,
      9791,
      9805,
      9801,
      9773,
      9786,
      9770,
      9789,
      9805,
      9796,
      9786,
      9788,
      9778,
      9803,
      9769,
      9773,
      9809,
      9787,
      9808,
      9808,
      9776,
      9789,
      9809,
      9802,
      9781,
      9777,
      9765,
      9770,
      9778,
      9797,
      9777,
      9778,
      9799,
      9793,
      9801,
      9795,
      9772,
      9785,
      9770,
      9784,
      9802,
      9794,
      9776,
      9791,
      9788,
      9804,
      9771,
      9785,
      9811,
      9785,
      9804,
      9803,
      9773,
      9792,
      9804,
      9793,
      9771,
      9766,
      9774,
      9764,
      9771,
      9795,
      9783,
      9772,
      9799,
      9797,
      9799,
      9795,
      9776,
      9781,
      9776,
      9797,
      9799,
      9787,
      9787,
      9783,
      9780,
      9810,
      9768,
      9776,
      9810,
      9774,
      9802,
      9796,
      9780,
      9792,
      9802,
      9793,
      9779,
      9768,
      9771,
      9760,
      9777,
      9788,
      9783,
      9774,
      9798,
      9798,
      9809,
      9803,
      9780,
      9781,
      9769,
      9787,
      9797,
      9785,
      9767,
      9791,
      9780,
      9806,
      9761,
      9777,
      9814,
      9783,
      9811,
      9803,
      9780,
      9785,
      9799,
      9797,
      9778,
      9777,
      9770,
      9763,
      9782,
      9795,
      9780,
      9784,
      9801,
      9795,
      9808,
      9797,
      9771,
      9778,
      9773,
      9793,
      9794,
      9792,
      9768,
      9782,
      9786,
      9808,
      9770,
      9774,
      9820,
      9782,
      9799,
      9802,
      9780,
      9789,
      9806,
      9797,
      9777,
      9776,
      9767,
      9765,
      9776,
      9792,
      9777,
      9784,
      9798,
      9785,
      9797,
      9793,
      9782,
      9781,
      9770,
      9791,
      9803,
      9796,
      9777,
      9787,
      9782,
      9803,
      9762,
      9778,
      9808,
      9776,
      9801,
      9803,
      9779,
      9790,
      9798,
      9793,
      9772,
      9776,
      9769,
      9767,
      9779,
      9790,
      9783,
      9780,
      9796,
      9800,
      9804,
      9799,
      9778,
      9780,
      9771,
      9792,
      9796,
      9792,
      9768,
      9791,
      9783,
      9805,
      9781,
      9776,
      9815,
      9782,
      9813,
      9805,
      9776,
      9795,
      9804,
      9800,
      9771,
      9769,
      9764,
      9761,
      9780,
      9785,
      9777,
      9783,
      9805,
      9789,
      9803,
      9804,
      9781,
      9781,
      9766,
      9788,
      9802,
      9786,
      9766,
      9786,
      9781,
      9809,
      9768,
      9772,
      9820,
      9780,
      9797,
      9812,
      9787,
      9791,
      9800,
      9796,
      9782,
      9773,
      9758,
      9756,
      9781,
      9796,
      9779,
      9776,
      9802,
      9795,
      9805,
      9800,
      9774,
      9775,
      9771,
      9790,
      9798,
      9783,
      9779,
      9788,
      9781,
      9816,
      9772,
      9775,
      9814,
      9781,
      9799,
      9809,
      9782,
      9795,
      9808,
      9795,
      9779,
      9776,
      9771,
      9758,
      9778,
      9793,
      9777,
      9786,
      9802,
      9800,
      9800,
      9800,
      9772,
      9785,
      9773,
      9794,
      9802,
      9793,
      9778,
      9779,
      9787,
      9810,
      9765,
      9781,
      9810,
      9777,
      9797,
      9804,
      9775,
      9794,
      9807,
      9800,
      9781,
      9775,
      9772,
      9758,
      9777,
      9789,
      9785,
      9778,
      9800,
      9789,
      9806
     ]
    },
    {
     "name": "idle 4",
     "seconds": 5.005644715999949,
     "joules": 359.243,
     "utilization_max": 0,
     "contexts": 1
    }
   ]
  }
 }
}
