QRef/ Migration report

Recorded local execution · QAOA helpers — seeded rotation regression · Qiskit 0.46.3 to 2.6.1
Executed 2026-10-26T02:19:35.963712Z – 2026-10-26T02:19:40.011622Z · Evidence 04d4050c9a596a4d960add5c85946f19b3f077db8c8317e203ec5407dd42be17

Circuit differences.

The checker reports the actually submitted circuits as not equivalent. 3 more findings below. The reference is a preservation baseline, not proof that its behaviour is correct.

18 executions per runtime · 9 distinct submitted-circuit pairs checked
Requested shotsReference completedTarget completed
512 1,024 differs 512
17 1,024 differs 17

No bound model-proposal record for this target. Any research notes are not attributed to a model in this report.

Circuits: differences found Human decision: not recorded

Coverage: 3 graphs, 3 angle settings, 2 requested shot counts; 18 of 18 execution pairs completed. Checks cover declared inputs only.
Not checked: optimizer convergence, hardware, noise and dynamic circuits.

Run state complete · evidence summary difference · 90 difference · 0 error · 0 inconclusive · 187 pass · 0 unsupported checks

Findings

Submitted circuits differ

The checker reports the actually submitted circuits as not equivalent. Seen in 18 checks across 18 executions — one grouped change, not 18 independent bugs.

Execution evidence

18 linked observations

Model disclosure

No bound model record.

Human decision

Not recorded. Copy review-template.json, fill in a reviewer, decision and reason, then run qref report --decisions. QRef never infers acceptance from model notes.

Ideal output distribution differs

Exact output probabilities differ beyond tolerance. Seen in 18 checks across 18 executions — one grouped change, not 18 independent bugs.

Execution evidence

18 linked observations

Model disclosure

No bound model record.

Human decision

Not recorded. Copy review-template.json, fill in a reviewer, decision and reason, then run qref report --decisions. QRef never infers acceptance from model notes.

Exact objective differs

Independently computed exact objectives differ beyond tolerance. Seen in 18 checks across 18 executions — one grouped change, not 18 independent bugs.

Execution evidence

18 linked observations

Model disclosure

No bound model record.

Human decision

Not recorded. Copy review-template.json, fill in a reviewer, decision and reason, then run qref report --decisions. QRef never infers acceptance from model notes.

Shot setting changed

The reference and target complete different numbers of shots for the same request. This changes sampling uncertainty even when circuits are equivalent. Seen in 36 checks across 18 executions — one grouped change, not 36 independent bugs.

Execution evidence

36 linked observations

Model disclosure

No bound model record.

Human decision

Not recorded. Copy review-template.json, fill in a reviewer, decision and reason, then run qref report --decisions. QRef never infers acceptance from model notes.

Checks on declared inputs

GraphAngles θCircuit resultMax probability differenceExact objective differenceEvidence
textbook_cycle4
4 qubits
[0.17, 0.63] difference not_equivalent difference 0.0409 difference 0.172 shots-512, shots-17
textbook_cycle4
4 qubits
[0.81, 0.29] difference not_equivalent difference 0.132 difference 1.01 shots-512, shots-17
textbook_cycle4
4 qubits
[0.17, 0.63, 0.41, 0.92] difference not_equivalent difference 0.074 difference 0.329 shots-512, shots-17
asymmetric4
4 qubits
[0.17, 0.63] difference not_equivalent difference 0.0326 difference 0.236 shots-512, shots-17
asymmetric4
4 qubits
[0.81, 0.29] difference not_equivalent difference 0.0988 difference 0.779 shots-512, shots-17
asymmetric4
4 qubits
[0.17, 0.63, 0.41, 0.92] difference not_equivalent difference 0.0443 difference 0.179 shots-512, shots-17
cycle5
5 qubits
[0.17, 0.63] difference not_equivalent difference 0.0299 difference 0.215 shots-512, shots-17
cycle5
5 qubits
[0.81, 0.29] difference not_equivalent difference 0.112 difference 1.26 shots-512, shots-17
cycle5
5 qubits
[0.17, 0.63, 0.41, 0.92] difference not_equivalent difference 0.0276 difference 0.166 shots-512, shots-17

Circuit results compare the circuits actually submitted to Aer, after removing only terminal measurements, with MQT QCEC (mqt.qcec.verify 3.11.0; global phase ignored; relative phase is a difference). Tolerance for numerical checks: 1e-10 absolute.

All checks by kind

pairing — 1 pass
CheckStatusSummary
pairingpass equal18 expected executions per side, paired by input digest
classical-basis — 6 pass
CheckStatusSummary
classical-basis/reference/textbook_cycle4pass equalreference: 16/16 basis assignments match the independent negative-cut rule
classical-basis/reference/asymmetric4pass equalreference: 16/16 basis assignments match the independent negative-cut rule
classical-basis/reference/cycle5pass equalreference: 32/32 basis assignments match the independent negative-cut rule
classical-basis/target/textbook_cycle4pass equaltarget: 16/16 basis assignments match the independent negative-cut rule
classical-basis/target/asymmetric4pass equaltarget: 16/16 basis assignments match the independent negative-cut rule
classical-basis/target/cycle5pass equaltarget: 32/32 basis assignments match the independent negative-cut rule
shots-integrity — 36 pass
CheckStatusSummary
shots-integrity/reference/textbook_cycle4/p1-a/shots-512pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/textbook_cycle4/p1-a/shots-512pass equaltarget: completed shots 512 vs count sum 512
shots-integrity/reference/textbook_cycle4/p1-a/shots-17pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/textbook_cycle4/p1-a/shots-17pass equaltarget: completed shots 17 vs count sum 17
shots-integrity/reference/textbook_cycle4/p1-b/shots-512pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/textbook_cycle4/p1-b/shots-512pass equaltarget: completed shots 512 vs count sum 512
shots-integrity/reference/textbook_cycle4/p1-b/shots-17pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/textbook_cycle4/p1-b/shots-17pass equaltarget: completed shots 17 vs count sum 17
shots-integrity/reference/textbook_cycle4/p2/shots-512pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/textbook_cycle4/p2/shots-512pass equaltarget: completed shots 512 vs count sum 512
shots-integrity/reference/textbook_cycle4/p2/shots-17pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/textbook_cycle4/p2/shots-17pass equaltarget: completed shots 17 vs count sum 17
shots-integrity/reference/asymmetric4/p1-a/shots-512pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/asymmetric4/p1-a/shots-512pass equaltarget: completed shots 512 vs count sum 512
shots-integrity/reference/asymmetric4/p1-a/shots-17pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/asymmetric4/p1-a/shots-17pass equaltarget: completed shots 17 vs count sum 17
shots-integrity/reference/asymmetric4/p1-b/shots-512pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/asymmetric4/p1-b/shots-512pass equaltarget: completed shots 512 vs count sum 512
shots-integrity/reference/asymmetric4/p1-b/shots-17pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/asymmetric4/p1-b/shots-17pass equaltarget: completed shots 17 vs count sum 17
shots-integrity/reference/asymmetric4/p2/shots-512pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/asymmetric4/p2/shots-512pass equaltarget: completed shots 512 vs count sum 512
shots-integrity/reference/asymmetric4/p2/shots-17pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/asymmetric4/p2/shots-17pass equaltarget: completed shots 17 vs count sum 17
shots-integrity/reference/cycle5/p1-a/shots-512pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/cycle5/p1-a/shots-512pass equaltarget: completed shots 512 vs count sum 512
shots-integrity/reference/cycle5/p1-a/shots-17pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/cycle5/p1-a/shots-17pass equaltarget: completed shots 17 vs count sum 17
shots-integrity/reference/cycle5/p1-b/shots-512pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/cycle5/p1-b/shots-512pass equaltarget: completed shots 512 vs count sum 512
shots-integrity/reference/cycle5/p1-b/shots-17pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/cycle5/p1-b/shots-17pass equaltarget: completed shots 17 vs count sum 17
shots-integrity/reference/cycle5/p2/shots-512pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/cycle5/p2/shots-512pass equaltarget: completed shots 512 vs count sum 512
shots-integrity/reference/cycle5/p2/shots-17pass equalreference: completed shots 1024 vs count sum 1024
shots-integrity/target/cycle5/p2/shots-17pass equaltarget: completed shots 17 vs count sum 17
shots-request — 18 pass, 18 difference
CheckStatusSummary
shots-request/reference/textbook_cycle4/p1-a/shots-512difference shots_request_mismatchreference: requested 512, completed 1024
shots-request/target/textbook_cycle4/p1-a/shots-512pass equaltarget: requested 512, completed 512
shots-request/reference/textbook_cycle4/p1-a/shots-17difference shots_request_mismatchreference: requested 17, completed 1024
shots-request/target/textbook_cycle4/p1-a/shots-17pass equaltarget: requested 17, completed 17
shots-request/reference/textbook_cycle4/p1-b/shots-512difference shots_request_mismatchreference: requested 512, completed 1024
shots-request/target/textbook_cycle4/p1-b/shots-512pass equaltarget: requested 512, completed 512
shots-request/reference/textbook_cycle4/p1-b/shots-17difference shots_request_mismatchreference: requested 17, completed 1024
shots-request/target/textbook_cycle4/p1-b/shots-17pass equaltarget: requested 17, completed 17
shots-request/reference/textbook_cycle4/p2/shots-512difference shots_request_mismatchreference: requested 512, completed 1024
shots-request/target/textbook_cycle4/p2/shots-512pass equaltarget: requested 512, completed 512
shots-request/reference/textbook_cycle4/p2/shots-17difference shots_request_mismatchreference: requested 17, completed 1024
shots-request/target/textbook_cycle4/p2/shots-17pass equaltarget: requested 17, completed 17
shots-request/reference/asymmetric4/p1-a/shots-512difference shots_request_mismatchreference: requested 512, completed 1024
shots-request/target/asymmetric4/p1-a/shots-512pass equaltarget: requested 512, completed 512
shots-request/reference/asymmetric4/p1-a/shots-17difference shots_request_mismatchreference: requested 17, completed 1024
shots-request/target/asymmetric4/p1-a/shots-17pass equaltarget: requested 17, completed 17
shots-request/reference/asymmetric4/p1-b/shots-512difference shots_request_mismatchreference: requested 512, completed 1024
shots-request/target/asymmetric4/p1-b/shots-512pass equaltarget: requested 512, completed 512
shots-request/reference/asymmetric4/p1-b/shots-17difference shots_request_mismatchreference: requested 17, completed 1024
shots-request/target/asymmetric4/p1-b/shots-17pass equaltarget: requested 17, completed 17
shots-request/reference/asymmetric4/p2/shots-512difference shots_request_mismatchreference: requested 512, completed 1024
shots-request/target/asymmetric4/p2/shots-512pass equaltarget: requested 512, completed 512
shots-request/reference/asymmetric4/p2/shots-17difference shots_request_mismatchreference: requested 17, completed 1024
shots-request/target/asymmetric4/p2/shots-17pass equaltarget: requested 17, completed 17
shots-request/reference/cycle5/p1-a/shots-512difference shots_request_mismatchreference: requested 512, completed 1024
shots-request/target/cycle5/p1-a/shots-512pass equaltarget: requested 512, completed 512
shots-request/reference/cycle5/p1-a/shots-17difference shots_request_mismatchreference: requested 17, completed 1024
shots-request/target/cycle5/p1-a/shots-17pass equaltarget: requested 17, completed 17
shots-request/reference/cycle5/p1-b/shots-512difference shots_request_mismatchreference: requested 512, completed 1024
shots-request/target/cycle5/p1-b/shots-512pass equaltarget: requested 512, completed 512
shots-request/reference/cycle5/p1-b/shots-17difference shots_request_mismatchreference: requested 17, completed 1024
shots-request/target/cycle5/p1-b/shots-17pass equaltarget: requested 17, completed 17
shots-request/reference/cycle5/p2/shots-512difference shots_request_mismatchreference: requested 512, completed 1024
shots-request/target/cycle5/p2/shots-512pass equaltarget: requested 512, completed 512
shots-request/reference/cycle5/p2/shots-17difference shots_request_mismatchreference: requested 17, completed 1024
shots-request/target/cycle5/p2/shots-17pass equaltarget: requested 17, completed 17
returned-objective — 36 pass
CheckStatusSummary
returned-objective/reference/textbook_cycle4/p1-a/shots-512pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/textbook_cycle4/p1-a/shots-512pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/textbook_cycle4/p1-a/shots-17pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/textbook_cycle4/p1-a/shots-17pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/textbook_cycle4/p1-b/shots-512pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/textbook_cycle4/p1-b/shots-512pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/textbook_cycle4/p1-b/shots-17pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/textbook_cycle4/p1-b/shots-17pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/textbook_cycle4/p2/shots-512pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/textbook_cycle4/p2/shots-512pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/textbook_cycle4/p2/shots-17pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/textbook_cycle4/p2/shots-17pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/asymmetric4/p1-a/shots-512pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/asymmetric4/p1-a/shots-512pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/asymmetric4/p1-a/shots-17pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/asymmetric4/p1-a/shots-17pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/asymmetric4/p1-b/shots-512pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/asymmetric4/p1-b/shots-512pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/asymmetric4/p1-b/shots-17pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/asymmetric4/p1-b/shots-17pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/asymmetric4/p2/shots-512pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/asymmetric4/p2/shots-512pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/asymmetric4/p2/shots-17pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/asymmetric4/p2/shots-17pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/cycle5/p1-a/shots-512pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/cycle5/p1-a/shots-512pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/cycle5/p1-a/shots-17pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/cycle5/p1-a/shots-17pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/cycle5/p1-b/shots-512pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/cycle5/p1-b/shots-512pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/cycle5/p1-b/shots-17pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/cycle5/p1-b/shots-17pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/cycle5/p2/shots-512pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/cycle5/p2/shots-512pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/reference/cycle5/p2/shots-17pass equalreference: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
returned-objective/target/cycle5/p2/shots-17pass equaltarget: returned objective vs independent decoding of its own counts: agree (|Δ| = 0)
classical-weighting — 72 pass
CheckStatusSummary
classical-weighting/reference/textbook_cycle4/p1-a/shots-512/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/textbook_cycle4/p1-a/shots-512/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 6.66e-16)
classical-weighting/target/textbook_cycle4/p1-a/shots-512/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/textbook_cycle4/p1-a/shots-512/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 1.78e-15)
classical-weighting/reference/textbook_cycle4/p1-a/shots-17/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/textbook_cycle4/p1-a/shots-17/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 6.66e-16)
classical-weighting/target/textbook_cycle4/p1-a/shots-17/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/textbook_cycle4/p1-a/shots-17/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 1.78e-15)
classical-weighting/reference/textbook_cycle4/p1-b/shots-512/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/textbook_cycle4/p1-b/shots-512/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 1.78e-15)
classical-weighting/target/textbook_cycle4/p1-b/shots-512/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/textbook_cycle4/p1-b/shots-512/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 1.11e-15)
classical-weighting/reference/textbook_cycle4/p1-b/shots-17/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/textbook_cycle4/p1-b/shots-17/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 1.78e-15)
classical-weighting/target/textbook_cycle4/p1-b/shots-17/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/textbook_cycle4/p1-b/shots-17/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 1.11e-15)
classical-weighting/reference/textbook_cycle4/p2/shots-512/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/textbook_cycle4/p2/shots-512/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 1.78e-15)
classical-weighting/target/textbook_cycle4/p2/shots-512/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/textbook_cycle4/p2/shots-512/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 3.11e-15)
classical-weighting/reference/textbook_cycle4/p2/shots-17/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/textbook_cycle4/p2/shots-17/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 1.78e-15)
classical-weighting/target/textbook_cycle4/p2/shots-17/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/textbook_cycle4/p2/shots-17/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 3.11e-15)
classical-weighting/reference/asymmetric4/p1-a/shots-512/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/asymmetric4/p1-a/shots-512/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 4.44e-16)
classical-weighting/target/asymmetric4/p1-a/shots-512/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/asymmetric4/p1-a/shots-512/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 2e-15)
classical-weighting/reference/asymmetric4/p1-a/shots-17/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/asymmetric4/p1-a/shots-17/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 4.44e-16)
classical-weighting/target/asymmetric4/p1-a/shots-17/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/asymmetric4/p1-a/shots-17/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 2e-15)
classical-weighting/reference/asymmetric4/p1-b/shots-512/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/asymmetric4/p1-b/shots-512/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 1.33e-15)
classical-weighting/target/asymmetric4/p1-b/shots-512/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/asymmetric4/p1-b/shots-512/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 1.11e-15)
classical-weighting/reference/asymmetric4/p1-b/shots-17/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/asymmetric4/p1-b/shots-17/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 1.33e-15)
classical-weighting/target/asymmetric4/p1-b/shots-17/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/asymmetric4/p1-b/shots-17/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 1.11e-15)
classical-weighting/reference/asymmetric4/p2/shots-512/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/asymmetric4/p2/shots-512/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 1.33e-15)
classical-weighting/target/asymmetric4/p2/shots-512/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/asymmetric4/p2/shots-512/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 3.77e-15)
classical-weighting/reference/asymmetric4/p2/shots-17/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/asymmetric4/p2/shots-17/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 1.33e-15)
classical-weighting/target/asymmetric4/p2/shots-17/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/asymmetric4/p2/shots-17/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 3.77e-15)
classical-weighting/reference/cycle5/p1-a/shots-512/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/cycle5/p1-a/shots-512/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 1.78e-15)
classical-weighting/target/cycle5/p1-a/shots-512/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/cycle5/p1-a/shots-512/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 2.66e-15)
classical-weighting/reference/cycle5/p1-a/shots-17/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/cycle5/p1-a/shots-17/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 1.78e-15)
classical-weighting/target/cycle5/p1-a/shots-17/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/cycle5/p1-a/shots-17/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 2.66e-15)
classical-weighting/reference/cycle5/p1-b/shots-512/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/cycle5/p1-b/shots-512/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 2.22e-15)
classical-weighting/target/cycle5/p1-b/shots-512/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/cycle5/p1-b/shots-512/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 1.33e-15)
classical-weighting/reference/cycle5/p1-b/shots-17/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/cycle5/p1-b/shots-17/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 2.22e-15)
classical-weighting/target/cycle5/p1-b/shots-17/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/cycle5/p1-b/shots-17/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 1.33e-15)
classical-weighting/reference/cycle5/p2/shots-512/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/cycle5/p2/shots-512/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 3.11e-15)
classical-weighting/target/cycle5/p2/shots-512/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/cycle5/p2/shots-512/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 6.66e-15)
classical-weighting/reference/cycle5/p2/shots-17/countspass equalreference: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/reference/cycle5/p2/shots-17/exactpass equalreference: module weighting of exact probabilities: agree (|Δ| = 3.11e-15)
classical-weighting/target/cycle5/p2/shots-17/countspass equaltarget: module weighting of captured counts: agree (|Δ| = 0)
classical-weighting/target/cycle5/p2/shots-17/exactpass equaltarget: module weighting of exact probabilities: agree (|Δ| = 6.66e-15)
circuit — 18 difference
CheckStatusSummary
circuit/textbook_cycle4/p1-a/shots-512difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/textbook_cycle4/p1-a/shots-17difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/textbook_cycle4/p1-b/shots-512difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/textbook_cycle4/p1-b/shots-17difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/textbook_cycle4/p2/shots-512difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/textbook_cycle4/p2/shots-17difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/asymmetric4/p1-a/shots-512difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/asymmetric4/p1-a/shots-17difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/asymmetric4/p1-b/shots-512difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/asymmetric4/p1-b/shots-17difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/asymmetric4/p2/shots-512difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/asymmetric4/p2/shots-17difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/cycle5/p1-a/shots-512difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/cycle5/p1-a/shots-17difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/cycle5/p1-b/shots-512difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/cycle5/p1-b/shots-17difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/cycle5/p2/shots-512difference circuit_not_equivalentsubmitted circuits: not_equivalent
circuit/cycle5/p2/shots-17difference circuit_not_equivalentsubmitted circuits: not_equivalent
measurement — 18 pass
CheckStatusSummary
measurement/textbook_cycle4/p1-a/shots-512pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/textbook_cycle4/p1-a/shots-17pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/textbook_cycle4/p1-b/shots-512pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/textbook_cycle4/p1-b/shots-17pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/textbook_cycle4/p2/shots-512pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/textbook_cycle4/p2/shots-17pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/asymmetric4/p1-a/shots-512pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/asymmetric4/p1-a/shots-17pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/asymmetric4/p1-b/shots-512pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/asymmetric4/p1-b/shots-17pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/asymmetric4/p2/shots-512pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/asymmetric4/p2/shots-17pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/cycle5/p1-a/shots-512pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/cycle5/p1-a/shots-17pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/cycle5/p1-b/shots-512pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/cycle5/p1-b/shots-17pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/cycle5/p2/shots-512pass equalboth sides: terminal identity measurement, one classical register of width n
measurement/cycle5/p2/shots-17pass equalboth sides: terminal identity measurement, one classical register of width n
probability — 18 difference
CheckStatusSummary
probability/textbook_cycle4/p1-a/shots-512difference numeric_mismatchideal output distributions: max |Δp| = 0.0409
probability/textbook_cycle4/p1-a/shots-17difference numeric_mismatchideal output distributions: max |Δp| = 0.0409
probability/textbook_cycle4/p1-b/shots-512difference numeric_mismatchideal output distributions: max |Δp| = 0.132
probability/textbook_cycle4/p1-b/shots-17difference numeric_mismatchideal output distributions: max |Δp| = 0.132
probability/textbook_cycle4/p2/shots-512difference numeric_mismatchideal output distributions: max |Δp| = 0.074
probability/textbook_cycle4/p2/shots-17difference numeric_mismatchideal output distributions: max |Δp| = 0.074
probability/asymmetric4/p1-a/shots-512difference numeric_mismatchideal output distributions: max |Δp| = 0.0326
probability/asymmetric4/p1-a/shots-17difference numeric_mismatchideal output distributions: max |Δp| = 0.0326
probability/asymmetric4/p1-b/shots-512difference numeric_mismatchideal output distributions: max |Δp| = 0.0988
probability/asymmetric4/p1-b/shots-17difference numeric_mismatchideal output distributions: max |Δp| = 0.0988
probability/asymmetric4/p2/shots-512difference numeric_mismatchideal output distributions: max |Δp| = 0.0443
probability/asymmetric4/p2/shots-17difference numeric_mismatchideal output distributions: max |Δp| = 0.0443
probability/cycle5/p1-a/shots-512difference numeric_mismatchideal output distributions: max |Δp| = 0.0299
probability/cycle5/p1-a/shots-17difference numeric_mismatchideal output distributions: max |Δp| = 0.0299
probability/cycle5/p1-b/shots-512difference numeric_mismatchideal output distributions: max |Δp| = 0.112
probability/cycle5/p1-b/shots-17difference numeric_mismatchideal output distributions: max |Δp| = 0.112
probability/cycle5/p2/shots-512difference numeric_mismatchideal output distributions: max |Δp| = 0.0276
probability/cycle5/p2/shots-17difference numeric_mismatchideal output distributions: max |Δp| = 0.0276
exact-objective — 18 difference
CheckStatusSummary
exact-objective/textbook_cycle4/p1-a/shots-512difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.172)
exact-objective/textbook_cycle4/p1-a/shots-17difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.172)
exact-objective/textbook_cycle4/p1-b/shots-512difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 1.01)
exact-objective/textbook_cycle4/p1-b/shots-17difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 1.01)
exact-objective/textbook_cycle4/p2/shots-512difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.329)
exact-objective/textbook_cycle4/p2/shots-17difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.329)
exact-objective/asymmetric4/p1-a/shots-512difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.236)
exact-objective/asymmetric4/p1-a/shots-17difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.236)
exact-objective/asymmetric4/p1-b/shots-512difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.779)
exact-objective/asymmetric4/p1-b/shots-17difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.779)
exact-objective/asymmetric4/p2/shots-512difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.179)
exact-objective/asymmetric4/p2/shots-17difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.179)
exact-objective/cycle5/p1-a/shots-512difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.215)
exact-objective/cycle5/p1-a/shots-17difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.215)
exact-objective/cycle5/p1-b/shots-512difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 1.26)
exact-objective/cycle5/p1-b/shots-17difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 1.26)
exact-objective/cycle5/p2/shots-512difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.166)
exact-objective/cycle5/p2/shots-17difference numeric_mismatchindependent exact objective, reference vs target: differ (|Δ| = 0.166)
shots-preservation — 18 difference
CheckStatusSummary
shots-preservation/textbook_cycle4/p1-a/shots-512difference shots_preservation_mismatchcompleted shots: reference 1024, target 512
shots-preservation/textbook_cycle4/p1-a/shots-17difference shots_preservation_mismatchcompleted shots: reference 1024, target 17
shots-preservation/textbook_cycle4/p1-b/shots-512difference shots_preservation_mismatchcompleted shots: reference 1024, target 512
shots-preservation/textbook_cycle4/p1-b/shots-17difference shots_preservation_mismatchcompleted shots: reference 1024, target 17
shots-preservation/textbook_cycle4/p2/shots-512difference shots_preservation_mismatchcompleted shots: reference 1024, target 512
shots-preservation/textbook_cycle4/p2/shots-17difference shots_preservation_mismatchcompleted shots: reference 1024, target 17
shots-preservation/asymmetric4/p1-a/shots-512difference shots_preservation_mismatchcompleted shots: reference 1024, target 512
shots-preservation/asymmetric4/p1-a/shots-17difference shots_preservation_mismatchcompleted shots: reference 1024, target 17
shots-preservation/asymmetric4/p1-b/shots-512difference shots_preservation_mismatchcompleted shots: reference 1024, target 512
shots-preservation/asymmetric4/p1-b/shots-17difference shots_preservation_mismatchcompleted shots: reference 1024, target 17
shots-preservation/asymmetric4/p2/shots-512difference shots_preservation_mismatchcompleted shots: reference 1024, target 512
shots-preservation/asymmetric4/p2/shots-17difference shots_preservation_mismatchcompleted shots: reference 1024, target 17
shots-preservation/cycle5/p1-a/shots-512difference shots_preservation_mismatchcompleted shots: reference 1024, target 512
shots-preservation/cycle5/p1-a/shots-17difference shots_preservation_mismatchcompleted shots: reference 1024, target 17
shots-preservation/cycle5/p1-b/shots-512difference shots_preservation_mismatchcompleted shots: reference 1024, target 512
shots-preservation/cycle5/p1-b/shots-17difference shots_preservation_mismatchcompleted shots: reference 1024, target 17
shots-preservation/cycle5/p2/shots-512difference shots_preservation_mismatchcompleted shots: reference 1024, target 512
shots-preservation/cycle5/p2/shots-17difference shots_preservation_mismatchcompleted shots: reference 1024, target 17

Executions

Every expected execution, both sides: completed shots, the returned objective next to QRef's independent decoding of the same histogram, the most frequent outcomes, and the captured circuit files.

18 paired executions
ExecutionSideStateShots requested / completedReturned vs independentTop countsCircuit files
textbook_cycle4/p1-a/shots-512
θ [0.17, 0.63]
input bd2973bdd644
reference completed 512 / 1,024 -1.61 / -1.61 1111:150 0000:132 0011:100 1100:88 QASM · QPY · metadata
target completed 512 / 512 -1.79 / -1.79 1111:60 0000:41 0100:40 1011:36 QASM · QPY · metadata
textbook_cycle4/p1-a/shots-17
θ [0.17, 0.63]
input fa07cd28b3b8
reference completed 17 / 1,024 -1.61 / -1.61 1111:150 0000:132 0011:100 1100:88 QASM · QPY · metadata
target completed 17 / 17 -1.76 / -1.76 1001:3 1111:3 0001:2 0101:2 QASM · QPY · metadata
textbook_cycle4/p1-b/shots-512
θ [0.81, 0.29]
input 7d3afa639a73
reference completed 512 / 1,024 -2.06 / -2.06 1010:134 1111:116 0101:115 0000:102 QASM · QPY · metadata
target completed 512 / 512 -1.11 / -1.11 1111:135 0000:102 0011:40 1100:38 QASM · QPY · metadata
textbook_cycle4/p1-b/shots-17
θ [0.81, 0.29]
input 94f83f59cb93
reference completed 17 / 1,024 -2.06 / -2.06 1010:134 1111:116 0101:115 0000:102 QASM · QPY · metadata
target completed 17 / 17 -1.29 / -1.29 1111:5 0000:3 0100:2 1010:2 QASM · QPY · metadata
textbook_cycle4/p2/shots-512
θ [0.17, 0.63, 0.41, 0.92]
input 299c7512267d
reference completed 512 / 1,024 -2.19 / -2.19 1010:138 0101:119 1001:92 0110:87 QASM · QPY · metadata
target completed 512 / 512 -2.54 / -2.54 0101:70 1010:70 1100:57 0110:46 QASM · QPY · metadata
textbook_cycle4/p2/shots-17
θ [0.17, 0.63, 0.41, 0.92]
input 6f82aff743be
reference completed 17 / 1,024 -2.19 / -2.19 1010:138 0101:119 1001:92 0110:87 QASM · QPY · metadata
target completed 17 / 17 -2.35 / -2.35 1001:3 1101:3 0011:2 0101:2 QASM · QPY · metadata
asymmetric4/p1-a/shots-512
θ [0.17, 0.63]
input c034adc209e3
reference completed 512 / 1,024 -1.51 / -1.51 1111:133 0000:114 1000:89 0111:85 QASM · QPY · metadata
target completed 512 / 512 -1.78 / -1.78 1111:51 1110:46 0100:42 1000:42 QASM · QPY · metadata
asymmetric4/p1-a/shots-17
θ [0.17, 0.63]
input 1510f88f4839
reference completed 17 / 1,024 -1.51 / -1.51 1111:133 0000:114 1000:89 0111:85 QASM · QPY · metadata
target completed 17 / 17 -1.94 / -1.94 1001:3 1110:3 0001:2 0101:2 QASM · QPY · metadata
asymmetric4/p1-b/shots-512
θ [0.81, 0.29]
input c473a1c2746c
reference completed 512 / 1,024 -1.68 / -1.68 1111:145 0000:131 1011:102 0100:98 QASM · QPY · metadata
target completed 512 / 512 -0.902 / -0.902 1111:135 0000:101 1000:57 0111:53 QASM · QPY · metadata
asymmetric4/p1-b/shots-17
θ [0.81, 0.29]
input 44c7b709acc9
reference completed 17 / 1,024 -1.68 / -1.68 1111:145 0000:131 1011:102 0100:98 QASM · QPY · metadata
target completed 17 / 17 -0.941 / -0.941 1111:5 0000:3 1000:3 0001:1 QASM · QPY · metadata
asymmetric4/p2/shots-512
θ [0.17, 0.63, 0.41, 0.92]
input 8c06c7c002ad
reference completed 512 / 1,024 -2.08 / -2.08 0011:123 1100:114 1110:95 0001:79 QASM · QPY · metadata
target completed 512 / 512 -1.86 / -1.86 1110:77 1101:61 0010:57 0001:49 QASM · QPY · metadata
asymmetric4/p2/shots-17
θ [0.17, 0.63, 0.41, 0.92]
input 50d20a5f68c1
reference completed 17 / 1,024 -2.08 / -2.08 0011:123 1100:114 1110:95 0001:79 QASM · QPY · metadata
target completed 17 / 17 -2.12 / -2.12 1110:5 1010:3 0001:2 0100:2 QASM · QPY · metadata
cycle5/p1-a/shots-512
θ [0.17, 0.63]
input f97f1cbaab27
reference completed 512 / 1,024 -2.02 / -2.02 11111:94 00000:81 00111:50 00110:47 QASM · QPY · metadata
target completed 512 / 512 -2.23 / -2.23 11111:31 00000:28 11101:26 10111:22 QASM · QPY · metadata
cycle5/p1-a/shots-17
θ [0.17, 0.63]
input 82bd560dc776
reference completed 17 / 1,024 -2.02 / -2.02 11111:94 00000:81 00111:50 00110:47 QASM · QPY · metadata
target completed 17 / 17 -2.12 / -2.12 10011:3 11101:3 00011:2 11110:2 QASM · QPY · metadata
cycle5/p1-b/shots-512
θ [0.81, 0.29]
input c3f73a72ca79
reference completed 512 / 1,024 -2.62 / -2.62 00000:54 11111:54 10110:53 11110:52 QASM · QPY · metadata
target completed 512 / 512 -1.33 / -1.33 11111:102 00000:73 00110:32 11001:30 QASM · QPY · metadata
cycle5/p1-b/shots-17
θ [0.81, 0.29]
input 02f3163452f8
reference completed 17 / 1,024 -2.62 / -2.62 00000:54 11111:54 10110:53 11110:52 QASM · QPY · metadata
target completed 17 / 17 -1.06 / -1.06 11111:5 00000:3 10011:3 01000:2 QASM · QPY · metadata
cycle5/p2/shots-512
θ [0.17, 0.63, 0.41, 0.92]
input a8085140a5ff
reference completed 512 / 1,024 -3.05 / -3.05 10101:72 01010:69 01001:66 10100:64 QASM · QPY · metadata
target completed 512 / 512 -3.23 / -3.23 11010:44 01010:37 01011:36 10101:35 QASM · QPY · metadata
cycle5/p2/shots-17
θ [0.17, 0.63, 0.41, 0.92]
input 0518eefd1561
reference completed 17 / 1,024 -3.05 / -3.05 10101:72 01010:69 01001:66 10100:64 QASM · QPY · metadata
target completed 17 / 17 -3.18 / -3.18 11010:5 10011:3 00110:2 01011:2 QASM · QPY · metadata

Coverage and limits

Checked

Actually submitted circuits (equivalence), measurement map and dimensions, exact output probabilities, independent exact objective, module helpers on every basis assignment, module weighting of captured counts and exact probabilities, returned values against their own histograms, and requested versus completed shots.

Not checked

Limits

Source changes

Unified diff from reference.py to target.py. Hunks that mention shots come first. + lines were added, - lines removed.

@@ -88,32 +89,33 @@
# mixer unitary
for i in range(0, nqubits):
Removed- qc.rx(2 * beta[irep], i)
Removed-
Added+ qc.rx(beta[irep], i)
Added+
qc.measure_all()
Removed-
Added+
return qc
# Finally we write a function that executes the circuit on the chosen backend
def get_expectation(G, shots=512):
Removed-
Added+
"""
Runs parametrized circuit
Removed-
Added+
Args:
G: networkx graph
Removed- p: int,
Removed- Number of repetitions of unitaries
Added+ shots: int,
Added+ Number of measurement shots per circuit execution
"""
Removed-
Removed- backend = Aer.get_backend('qasm_simulator')
Removed- backend.shots = shots
Removed-
Added+
Added+ backend = AerSimulator()
Added+
def execute_circ(theta):
Removed-
Added+
qc = create_qaoa_circ(G, theta)
Removed- counts = backend.run(qc, seed_simulator=10,
Removed- nshots=512).result().get_counts()
Removed-
Added+ # Qiskit 2.x backends no longer transpile implicitly in run()
Added+ tqc = transpile(qc, backend, optimization_level=0)
Added+ counts = backend.run(tqc, shots=shots, seed_simulator=10
Added+ ).result().get_counts()
Added+
return compute_expectation(counts, G)
Removed-
Added+
return execute_circ
@@ -1,3 +1,4 @@
Removed-from qiskit import QuantumCircuit, Aer
Added+from qiskit import QuantumCircuit, transpile
Added+from qiskit_aer import AerSimulator
import networkx as nx
@@ -7,11 +8,11 @@
the number of edges shared between the two partitions
of the graph.
Removed-
Added+
Args:
x: str
solution bitstring
Removed-
Added+
G: networkx graph
Removed-
Added+
Returns:
obj: float
@@ -22,32 +23,32 @@
if x[i] != x[j]:
obj -= 1
Removed-
Added+
return obj
def compute_expectation(counts, G):
Removed-
Added+
"""
Computes expectation value based on measurement results
Removed-
Added+
Args:
counts: dict
key as bitstring, val as count
Removed-
Added+
G: networkx graph
Removed-
Added+
Returns:
avg: float
expectation value
"""
Removed-
Added+
avg = 0
sum_count = 0
for bitstring, count in counts.items():
Removed-
Added+
obj = maxcut_obj(bitstring[::-1], G)
avg += obj * count
sum_count += count
Removed-
Added+
return avg/sum_count
@@ -56,30 +57,30 @@
# build the qaoa circuit under a single function
def create_qaoa_circ(G, theta):
Removed-
Added+
"""
Creates a parametrized qaoa circuit
Removed-
Removed- Args:
Added+
Added+ Args:
G: networkx graph
theta: list
unitary parameters
Removed-
Added+
Returns:
qc: qiskit circuit
"""
Removed-
Added+
nqubits = len(G.nodes())
p = len(theta)//2 # number of alternating unitaries
qc = QuantumCircuit(nqubits)
Removed-
Added+
beta = theta[:p]
gamma = theta[p:]
Removed-
Added+
# initial_state
for i in range(0, nqubits):
qc.h(i)
Removed-
Added+
for irep in range(0, p):
Removed-
Added+
# problem unitary
for pair in list(G.edges()):
Full reference source
from qiskit import QuantumCircuit, Aer
import networkx as nx

def maxcut_obj(x, G):
    """
    Given a bitstring as a solution, this function returns
    the number of edges shared between the two partitions
    of the graph.
    
    Args:
        x: str
           solution bitstring
           
        G: networkx graph
        
    Returns:
        obj: float
             Objective
    """
    obj = 0
    for i, j in G.edges():
        if x[i] != x[j]:
            obj -= 1
            
    return obj


def compute_expectation(counts, G):
    
    """
    Computes expectation value based on measurement results
    
    Args:
        counts: dict
                key as bitstring, val as count
           
        G: networkx graph
        
    Returns:
        avg: float
             expectation value
    """
    
    avg = 0
    sum_count = 0
    for bitstring, count in counts.items():
        
        obj = maxcut_obj(bitstring[::-1], G)
        avg += obj * count
        sum_count += count
        
    return avg/sum_count


# We will also bring the different circuit components that
# build the qaoa circuit under a single function
def create_qaoa_circ(G, theta):
    
    """
    Creates a parametrized qaoa circuit
    
    Args:  
        G: networkx graph
        theta: list
               unitary parameters
                     
    Returns:
        qc: qiskit circuit
    """
    
    nqubits = len(G.nodes())
    p = len(theta)//2  # number of alternating unitaries
    qc = QuantumCircuit(nqubits)
    
    beta = theta[:p]
    gamma = theta[p:]
    
    # initial_state
    for i in range(0, nqubits):
        qc.h(i)
    
    for irep in range(0, p):
        
        # problem unitary
        for pair in list(G.edges()):
            qc.rzz(2 * gamma[irep], pair[0], pair[1])

        # mixer unitary
        for i in range(0, nqubits):
            qc.rx(2 * beta[irep], i)
            
    qc.measure_all()
        
    return qc

# Finally we write a function that executes the circuit on the chosen backend
def get_expectation(G, shots=512):
    
    """
    Runs parametrized circuit
    
    Args:
        G: networkx graph
        p: int,
           Number of repetitions of unitaries
    """
    
    backend = Aer.get_backend('qasm_simulator')
    backend.shots = shots
    
    def execute_circ(theta):
        
        qc = create_qaoa_circ(G, theta)
        counts = backend.run(qc, seed_simulator=10, 
                             nshots=512).result().get_counts()
        
        return compute_expectation(counts, G)
    
    return execute_circ
Full target source
from qiskit import QuantumCircuit, transpile
from qiskit_aer import AerSimulator
import networkx as nx

def maxcut_obj(x, G):
    """
    Given a bitstring as a solution, this function returns
    the number of edges shared between the two partitions
    of the graph.

    Args:
        x: str
           solution bitstring

        G: networkx graph

    Returns:
        obj: float
             Objective
    """
    obj = 0
    for i, j in G.edges():
        if x[i] != x[j]:
            obj -= 1

    return obj


def compute_expectation(counts, G):

    """
    Computes expectation value based on measurement results

    Args:
        counts: dict
                key as bitstring, val as count

        G: networkx graph

    Returns:
        avg: float
             expectation value
    """

    avg = 0
    sum_count = 0
    for bitstring, count in counts.items():

        obj = maxcut_obj(bitstring[::-1], G)
        avg += obj * count
        sum_count += count

    return avg/sum_count


# We will also bring the different circuit components that
# build the qaoa circuit under a single function
def create_qaoa_circ(G, theta):

    """
    Creates a parametrized qaoa circuit

    Args:
        G: networkx graph
        theta: list
               unitary parameters

    Returns:
        qc: qiskit circuit
    """

    nqubits = len(G.nodes())
    p = len(theta)//2  # number of alternating unitaries
    qc = QuantumCircuit(nqubits)

    beta = theta[:p]
    gamma = theta[p:]

    # initial_state
    for i in range(0, nqubits):
        qc.h(i)

    for irep in range(0, p):

        # problem unitary
        for pair in list(G.edges()):
            qc.rzz(2 * gamma[irep], pair[0], pair[1])

        # mixer unitary
        for i in range(0, nqubits):
            qc.rx(beta[irep], i)

    qc.measure_all()

    return qc

# Finally we write a function that executes the circuit on the chosen backend
def get_expectation(G, shots=512):

    """
    Runs parametrized circuit

    Args:
        G: networkx graph
        shots: int,
           Number of measurement shots per circuit execution
    """

    backend = AerSimulator()

    def execute_circ(theta):

        qc = create_qaoa_circ(G, theta)
        # Qiskit 2.x backends no longer transpile implicitly in run()
        tqc = transpile(qc, backend, optimization_level=0)
        counts = backend.run(tqc, shots=shots, seed_simulator=10
                             ).result().get_counts()

        return compute_expectation(counts, G)

    return execute_circ

Evidence and reproduction

Reference source

Kind
upstream_extract
Upstream
https://github.com/qiskit-community/qiskit-textbook/blob/0ae905083ec3872d7ddc6bb4001d5468f476d93f/content/ch-applications/qaoa.ipynb
Revision
0ae905083ec3872d7ddc6bb4001d5468f476d93f · content/ch-applications/qaoa.ipynb
Extraction scope
Helper cell (maxcut_obj, compute_expectation, create_qaoa_circ, get_expectation) with its required imports added; not the whole notebook.
Attribution
Qiskit textbook contributors
Licence
Apache-2.0 · licence text
Module SHA-256
d4a99e4ae5ccb086181f1e0e20f686ccb0b52b32697d6ca4778632f9380c9e30

Target source

Kind
local_code
Extraction scope
Research port with one deliberate edit: rx(2*beta) became rx(beta).
Attribution
Qiskit textbook contributors (derived work); seeded edit by the QRef author
Licence
Apache-2.0 · licence text
Module SHA-256
8eb5c9a7a6ee67a3eecbd4001980019787f4fed53acb9cdcd8151b46ee30b63e

Runtimes

Reference
Python 3.11.12 · Darwin arm64 · networkx 2.8.8, numpy 1.26.4, qiskit 0.46.3, qiskit-aer 0.14.2
Target
Python 3.11.12 · Darwin arm64 · mqt-qcec 3.11.0, networkx 2.8.8, numpy 2.4.6, qiskit 2.6.1, qiskit-aer 0.18.0
QRef
0.1.0 · observer f58c147ce935 · comparison 22d9f25fd9d4

Reproduce

uv sync --frozen
uv venv --python 3.11.12 .qref/envs/reference
uv pip install --python .qref/envs/reference/bin/python -r evidence/qaoa/legacy-requirements.txt
uv venv --python 3.11.12 .qref/envs/target
uv pip install --python .qref/envs/target/bin/python -r evidence/qaoa/modern-requirements.txt
uv run qref run --case case.json \
  --reference-python .qref/envs/reference/bin/python \
  --target-python .qref/envs/target/bin/python \
  --out runs/my-run --trust-local-code
uv run qref verify-bundle --run runs/my-run

Re-running produces a new evidence record. Sampled counts can differ; checks compare each returned value with its own histogram, never random streams across versions.

141 recorded artifacts
PathBytesSHA-256
artifacts/checks/pair-00.json88628b1f02e01b
artifacts/checks/pair-00.stderr.txt0e3b0c44298fc
artifacts/checks/pair-01.json88628b1f02e01b
artifacts/checks/pair-01.stderr.txt0e3b0c44298fc
artifacts/checks/pair-02.json88628b1f02e01b
artifacts/checks/pair-02.stderr.txt0e3b0c44298fc
artifacts/checks/pair-03.json88628b1f02e01b
artifacts/checks/pair-03.stderr.txt0e3b0c44298fc
artifacts/checks/pair-04.json88628b1f02e01b
artifacts/checks/pair-04.stderr.txt0e3b0c44298fc
artifacts/checks/pair-05.json88628b1f02e01b
artifacts/checks/pair-05.stderr.txt0e3b0c44298fc
artifacts/checks/pair-06.json88628b1f02e01b
artifacts/checks/pair-06.stderr.txt0e3b0c44298fc
artifacts/checks/pair-07.json88628b1f02e01b
artifacts/checks/pair-07.stderr.txt0e3b0c44298fc
artifacts/checks/pair-08.json88628b1f02e01b
artifacts/checks/pair-08.stderr.txt0e3b0c44298fc
artifacts/inputs/case.original.json3265ac0f158eaa85
artifacts/inputs/reference-LICENSE.txt11416902d75776b0e
artifacts/inputs/reference-pins.txt266520e22a90983
artifacts/inputs/reference.py2594d4a99e4ae5cc
artifacts/inputs/target-LICENSE.txt11416902d75776b0e
artifacts/inputs/target-pins.txt271c33387f0724c
artifacts/inputs/target.py25458eb5c9a7a6ee
artifacts/reference/asymmetric4__p1-a__shots-17.circuit.json318096e49b5e94e
artifacts/reference/asymmetric4__p1-a__shots-17.qasm2228639d034fc5a
artifacts/reference/asymmetric4__p1-a__shots-17.qpy11364f08bd3df478
artifacts/reference/asymmetric4__p1-a__shots-512.circuit.json318096e49b5e94e
artifacts/reference/asymmetric4__p1-a__shots-512.qasm2228639d034fc5a
artifacts/reference/asymmetric4__p1-a__shots-512.qpy1136dbc98f016abc
artifacts/reference/asymmetric4__p1-b__shots-17.circuit.json318096e49b5e94e
artifacts/reference/asymmetric4__p1-b__shots-17.qasm222fc787d670aac
artifacts/reference/asymmetric4__p1-b__shots-17.qpy11369208bc20a496
artifacts/reference/asymmetric4__p1-b__shots-512.circuit.json318096e49b5e94e
artifacts/reference/asymmetric4__p1-b__shots-512.qasm222fc787d670aac
artifacts/reference/asymmetric4__p1-b__shots-512.qpy1136c04df61227b0
artifacts/reference/asymmetric4__p2__shots-17.circuit.json318096e49b5e94e
artifacts/reference/asymmetric4__p2__shots-17.qasm366fb7a2dbffad5
artifacts/reference/asymmetric4__p2__shots-17.qpy16482db9bc5d396e
artifacts/reference/asymmetric4__p2__shots-512.circuit.json318096e49b5e94e
artifacts/reference/asymmetric4__p2__shots-512.qasm366fb7a2dbffad5
artifacts/reference/asymmetric4__p2__shots-512.qpy1648f511d14b8163
artifacts/reference/cycle5__p1-a__shots-17.circuit.json348c87f9e912722
artifacts/reference/cycle5__p1-a__shots-17.qasm266276f3cc18c91
artifacts/reference/cycle5__p1-a__shots-17.qpy13781d600ee98e0f
artifacts/reference/cycle5__p1-a__shots-512.circuit.json348c87f9e912722
artifacts/reference/cycle5__p1-a__shots-512.qasm266276f3cc18c91
artifacts/reference/cycle5__p1-a__shots-512.qpy137849c625c77849
artifacts/reference/cycle5__p1-b__shots-17.circuit.json348c87f9e912722
artifacts/reference/cycle5__p1-b__shots-17.qasm2668bde8e9b7e24
artifacts/reference/cycle5__p1-b__shots-17.qpy1378209ef5d8214f
artifacts/reference/cycle5__p1-b__shots-512.circuit.json348c87f9e912722
artifacts/reference/cycle5__p1-b__shots-512.qasm2668bde8e9b7e24
artifacts/reference/cycle5__p1-b__shots-512.qpy137825366aac81a8
artifacts/reference/cycle5__p2__shots-17.circuit.json348c87f9e912722
artifacts/reference/cycle5__p2__shots-17.qasm446ebb60263036f
artifacts/reference/cycle5__p2__shots-17.qpy2018e9566bee0bb3
artifacts/reference/cycle5__p2__shots-512.circuit.json348c87f9e912722
artifacts/reference/cycle5__p2__shots-512.qasm446ebb60263036f
artifacts/reference/cycle5__p2__shots-512.qpy20185db0eef2c4e4
artifacts/reference/observations.json57216b2e1616bb218
artifacts/reference/runtime.json11811389d83288f3c
artifacts/reference/stderr.txt0e3b0c44298fc
artifacts/reference/stdout.txt0e3b0c44298fc
artifacts/reference/textbook_cycle4__p1-a__shots-17.circuit.json318096e49b5e94e
artifacts/reference/textbook_cycle4__p1-a__shots-17.qasm22205ffb5237902
artifacts/reference/textbook_cycle4__p1-a__shots-17.qpy1136d60d6bce42f8
artifacts/reference/textbook_cycle4__p1-a__shots-512.circuit.json318096e49b5e94e
artifacts/reference/textbook_cycle4__p1-a__shots-512.qasm22205ffb5237902
artifacts/reference/textbook_cycle4__p1-a__shots-512.qpy113643072b8b89b4
artifacts/reference/textbook_cycle4__p1-b__shots-17.circuit.json318096e49b5e94e
artifacts/reference/textbook_cycle4__p1-b__shots-17.qasm2224fef82407e0a
artifacts/reference/textbook_cycle4__p1-b__shots-17.qpy1136968739dedc67
artifacts/reference/textbook_cycle4__p1-b__shots-512.circuit.json318096e49b5e94e
artifacts/reference/textbook_cycle4__p1-b__shots-512.qasm2224fef82407e0a
artifacts/reference/textbook_cycle4__p1-b__shots-512.qpy1136bf1441522079
artifacts/reference/textbook_cycle4__p2__shots-17.circuit.json318096e49b5e94e
artifacts/reference/textbook_cycle4__p2__shots-17.qasm36661736110b245
artifacts/reference/textbook_cycle4__p2__shots-17.qpy1648d1f3586b8625
artifacts/reference/textbook_cycle4__p2__shots-512.circuit.json318096e49b5e94e
artifacts/reference/textbook_cycle4__p2__shots-512.qasm36661736110b245
artifacts/reference/textbook_cycle4__p2__shots-512.qpy1648df202d07b7ec
artifacts/target/asymmetric4__p1-a__shots-17.circuit.json318096e49b5e94e
artifacts/target/asymmetric4__p1-a__shots-17.qasm222149a393284c8
artifacts/target/asymmetric4__p1-a__shots-17.qpy109776357fd8634c
artifacts/target/asymmetric4__p1-a__shots-512.circuit.json318096e49b5e94e
artifacts/target/asymmetric4__p1-a__shots-512.qasm222149a393284c8
artifacts/target/asymmetric4__p1-a__shots-512.qpy1097d84d814a765d
artifacts/target/asymmetric4__p1-b__shots-17.circuit.json318096e49b5e94e
artifacts/target/asymmetric4__p1-b__shots-17.qasm222c9bc20b8a3f0
artifacts/target/asymmetric4__p1-b__shots-17.qpy109718151e1726fd
artifacts/target/asymmetric4__p1-b__shots-512.circuit.json318096e49b5e94e
artifacts/target/asymmetric4__p1-b__shots-512.qasm222c9bc20b8a3f0
artifacts/target/asymmetric4__p1-b__shots-512.qpy10977865e15a0bcd
artifacts/target/asymmetric4__p2__shots-17.circuit.json318096e49b5e94e
artifacts/target/asymmetric4__p2__shots-17.qasm366cef8dd9eda7b
artifacts/target/asymmetric4__p2__shots-17.qpy16095433d61497cf
artifacts/target/asymmetric4__p2__shots-512.circuit.json318096e49b5e94e
artifacts/target/asymmetric4__p2__shots-512.qasm366cef8dd9eda7b
artifacts/target/asymmetric4__p2__shots-512.qpy16097350bc9a35fd
artifacts/target/cycle5__p1-a__shots-17.circuit.json348c87f9e912722
artifacts/target/cycle5__p1-a__shots-17.qasm2663c68239578de
artifacts/target/cycle5__p1-a__shots-17.qpy132372856fd2b4f8
artifacts/target/cycle5__p1-a__shots-512.circuit.json348c87f9e912722
artifacts/target/cycle5__p1-a__shots-512.qasm2663c68239578de
artifacts/target/cycle5__p1-a__shots-512.qpy13235b86303149ec
artifacts/target/cycle5__p1-b__shots-17.circuit.json348c87f9e912722
artifacts/target/cycle5__p1-b__shots-17.qasm26653b610ee88fa
artifacts/target/cycle5__p1-b__shots-17.qpy1324be379079a4de
artifacts/target/cycle5__p1-b__shots-512.circuit.json348c87f9e912722
artifacts/target/cycle5__p1-b__shots-512.qasm26653b610ee88fa
artifacts/target/cycle5__p1-b__shots-512.qpy1324f36adbc4645a
artifacts/target/cycle5__p2__shots-17.circuit.json348c87f9e912722
artifacts/target/cycle5__p2__shots-17.qasm446d102fc8780b1
artifacts/target/cycle5__p2__shots-17.qpy19641ee86bdeaa4d
artifacts/target/cycle5__p2__shots-512.circuit.json348c87f9e912722
artifacts/target/cycle5__p2__shots-512.qasm446d102fc8780b1
artifacts/target/cycle5__p2__shots-512.qpy1964882154c8c906
artifacts/target/observations.json54421eb95f39b2c5f
artifacts/target/runtime.json118050fa274a5bf81
artifacts/target/stderr.txt0e3b0c44298fc
artifacts/target/stdout.txt0e3b0c44298fc
artifacts/target/textbook_cycle4__p1-a__shots-17.circuit.json318096e49b5e94e
artifacts/target/textbook_cycle4__p1-a__shots-17.qasm22251900b6a4e63
artifacts/target/textbook_cycle4__p1-a__shots-17.qpy109728c129c748ca
artifacts/target/textbook_cycle4__p1-a__shots-512.circuit.json318096e49b5e94e
artifacts/target/textbook_cycle4__p1-a__shots-512.qasm22251900b6a4e63
artifacts/target/textbook_cycle4__p1-a__shots-512.qpy1097ac0b24ba9666
artifacts/target/textbook_cycle4__p1-b__shots-17.circuit.json318096e49b5e94e
artifacts/target/textbook_cycle4__p1-b__shots-17.qasm222044f322be9b9
artifacts/target/textbook_cycle4__p1-b__shots-17.qpy1097440b26c18662
artifacts/target/textbook_cycle4__p1-b__shots-512.circuit.json318096e49b5e94e
artifacts/target/textbook_cycle4__p1-b__shots-512.qasm222044f322be9b9
artifacts/target/textbook_cycle4__p1-b__shots-512.qpy109773c95a536177
artifacts/target/textbook_cycle4__p2__shots-17.circuit.json318096e49b5e94e
artifacts/target/textbook_cycle4__p2__shots-17.qasm366c209abc21e71
artifacts/target/textbook_cycle4__p2__shots-17.qpy160936d9895bbbfe
artifacts/target/textbook_cycle4__p2__shots-512.circuit.json318096e49b5e94e
artifacts/target/textbook_cycle4__p2__shots-512.qasm366c209abc21e71
artifacts/target/textbook_cycle4__p2__shots-512.qpy160928218d5839a9
Reference licence text
                    Copyright 2019 IBM and its contributors

                                 Apache License
                           Version 2.0, January 2004
                        http://www.apache.org/licenses/

   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION

   1. Definitions.

      "License" shall mean the terms and conditions for use, reproduction,
      and distribution as defined by Sections 1 through 9 of this document.

      "Licensor" shall mean the copyright owner or entity authorized by
      the copyright owner that is granting the License.

      "Legal Entity" shall mean the union of the acting entity and all
      other entities that control, are controlled by, or are under common
      control with that entity. For the purposes of this definition,
      "control" means (i) the power, direct or indirect, to cause the
      direction or management of such entity, whether by contract or
      otherwise, or (ii) ownership of fifty percent (50%) or more of the
      outstanding shares, or (iii) beneficial ownership of such entity.

      "You" (or "Your") shall mean an individual or Legal Entity
      exercising permissions granted by this License.

      "Source" form shall mean the preferred form for making modifications,
      including but not limited to software source code, documentation
      source, and configuration files.

      "Object" form shall mean any form resulting from mechanical
      transformation or translation of a Source form, including but
      not limited to compiled object code, generated documentation,
      and conversions to other media types.

      "Work" shall mean the work of authorship, whether in Source or
      Object form, made available under the License, as indicated by a
      copyright notice that is included in or attached to the work
      (an example is provided in the Appendix below).

      "Derivative Works" shall mean any work, whether in Source or Object
      form, that is based on (or derived from) the Work and for which the
      editorial revisions, annotations, elaborations, or other modifications
      represent, as a whole, an original work of authorship. For the purposes
      of this License, Derivative Works shall not include works that remain
      separable from, or merely link (or bind by name) to the interfaces of,
      the Work and Derivative Works thereof.

      "Contribution" shall mean any work of authorship, including
      the original version of the Work and any modifications or additions
      to that Work or Derivative Works thereof, that is intentionally
      submitted to Licensor for inclusion in the Work by the copyright owner
      or by an individual or Legal Entity authorized to submit on behalf of
      the copyright owner. For the purposes of this definition, "submitted"
      means any form of electronic, verbal, or written communication sent
      to the Licensor or its representatives, including but not limited to
      communication on electronic mailing lists, source code control systems,
      and issue tracking systems that are managed by, or on behalf of, the
      Licensor for the purpose of discussing and improving the Work, but
      excluding communication that is conspicuously marked or otherwise
      designated in writing by the copyright owner as "Not a Contribution."

      "Contributor" shall mean Licensor and any individual or Legal Entity
      on behalf of whom a Contribution has been received by Licensor and
      subsequently incorporated within the Work.

   2. Grant of Copyright License. Subject to the terms and conditions of
      this License, each Contributor hereby grants to You a perpetual,
      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
      copyright license to reproduce, prepare Derivative Works of,
      publicly display, publicly perform, sublicense, and distribute the
      Work and such Derivative Works in Source or Object form.

   3. Grant of Patent License. Subject to the terms and conditions of
      this License, each Contributor hereby grants to You a perpetual,
      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
      (except as stated in this section) patent license to make, have made,
      use, offer to sell, sell, import, and otherwise transfer the Work,
      where such license applies only to those patent claims licensable
      by such Contributor that are necessarily infringed by their
      Contribution(s) alone or by combination of their Contribution(s)
      with the Work to which such Contribution(s) was submitted. If You
      institute patent litigation against any entity (including a
      cross-claim or counterclaim in a lawsuit) alleging that the Work
      or a Contribution incorporated within the Work constitutes direct
      or contributory patent infringement, then any patent licenses
      granted to You under this License for that Work shall terminate
      as of the date such litigation is filed.

   4. Redistribution. You may reproduce and distribute copies of the
      Work or Derivative Works thereof in any medium, with or without
      modifications, and in Source or Object form, provided that You
      meet the following conditions:

      (a) You must give any other recipients of the Work or
          Derivative Works a copy of this License; and

      (b) You must cause any modified files to carry prominent notices
          stating that You changed the files; and

      (c) You must retain, in the Source form of any Derivative Works
          that You distribute, all copyright, patent, trademark, and
          attribution notices from the Source form of the Work,
          excluding those notices that do not pertain to any part of
          the Derivative Works; and

      (d) If the Work includes a "NOTICE" text file as part of its
          distribution, then any Derivative Works that You distribute must
          include a readable copy of the attribution notices contained
          within such NOTICE file, excluding those notices that do not
          pertain to any part of the Derivative Works, in at least one
          of the following places: within a NOTICE text file distributed
          as part of the Derivative Works; within the Source form or
          documentation, if provided along with the Derivative Works; or,
          within a display generated by the Derivative Works, if and
          wherever such third-party notices normally appear. The contents
          of the NOTICE file are for informational purposes only and
          do not modify the License. You may add Your own attribution
          notices within Derivative Works that You distribute, alongside
          or as an addendum to the NOTICE text from the Work, provided
          that such additional attribution notices cannot be construed
          as modifying the License.

      You may add Your own copyright statement to Your modifications and
      may provide additional or different license terms and conditions
      for use, reproduction, or distribution of Your modifications, or
      for any such Derivative Works as a whole, provided Your use,
      reproduction, and distribution of the Work otherwise complies with
      the conditions stated in this License.

   5. Submission of Contributions. Unless You explicitly state otherwise,
      any Contribution intentionally submitted for inclusion in the Work
      by You to the Licensor shall be under the terms and conditions of
      this License, without any additional terms or conditions.
      Notwithstanding the above, nothing herein shall supersede or modify
      the terms of any separate license agreement you may have executed
      with Licensor regarding such Contributions.

   6. Trademarks. This License does not grant permission to use the trade
      names, trademarks, service marks, or product names of the Licensor,
      except as required for reasonable and customary use in describing the
      origin of the Work and reproducing the content of the NOTICE file.

   7. Disclaimer of Warranty. Unless required by applicable law or
      agreed to in writing, Licensor provides the Work (and each
      Contributor provides its Contributions) on an "AS IS" BASIS,
      WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
      implied, including, without limitation, any warranties or conditions
      of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
      PARTICULAR PURPOSE. You are solely responsible for determining the
      appropriateness of using or redistributing the Work and assume any
      risks associated with Your exercise of permissions under this License.

   8. Limitation of Liability. In no event and under no legal theory,
      whether in tort (including negligence), contract, or otherwise,
      unless required by applicable law (such as deliberate and grossly
      negligent acts) or agreed to in writing, shall any Contributor be
      liable to You for damages, including any direct, indirect, special,
      incidental, or consequential damages of any character arising as a
      result of this License or out of the use or inability to use the
      Work (including but not limited to damages for loss of goodwill,
      work stoppage, computer failure or malfunction, or any and all
      other commercial damages or losses), even if such Contributor
      has been advised of the possibility of such damages.

   9. Accepting Warranty or Additional Liability. While redistributing
      the Work or Derivative Works thereof, You may choose to offer,
      and charge a fee for, acceptance of support, warranty, indemnity,
      or other liability obligations and/or rights consistent with this
      License. However, in accepting such obligations, You may act only
      on Your own behalf and on Your sole responsibility, not on behalf
      of any other Contributor, and only if You agree to indemnify,
      defend, and hold each Contributor harmless for any liability
      incurred by, or claims asserted against, such Contributor by reason
      of your accepting any such warranty or additional liability.

   END OF TERMS AND CONDITIONS

   APPENDIX: How to apply the Apache License to your work.

      To apply the Apache License to your work, attach the following
      boilerplate notice, with the fields enclosed by brackets "[]"
      replaced with your own identifying information. (Don't include
      the brackets!)  The text should be enclosed in the appropriate
      comment syntax for the file format. We also recommend that a
      file or class name and description of purpose be included on the
      same "printed page" as the copyright notice for easier
      identification within third-party archives.

   Copyright 2019 IBM and its contributors.

   Licensed under the Apache License, Version 2.0 (the "License");
   you may not use this file except in compliance with the License.
   You may obtain a copy of the License at

       http://www.apache.org/licenses/LICENSE-2.0

   Unless required by applicable law or agreed to in writing, software
   distributed under the License is distributed on an "AS IS" BASIS,
   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
   See the License for the specific language governing permissions and
   limitations under the License.

Evidence embedded in this page

This page carries the exact evidence record (SHA-256 04d4050c9a596a4d960add5c85946f19b3f077db8c8317e203ec5407dd42be17), so a saved copy of this one HTML file still holds the full record. Bundle verification still needs the original export or the ZIP.

Raw evidence record
{
  "artifacts": [
    {
      "media_type": "application/json",
      "path": "artifacts/checks/pair-00.json",
      "sha256": "628b1f02e01b04cf5767c541313dd2cdda239604e58b234ce1a2d21a1f073f16",
      "size": 88
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/checks/pair-00.stderr.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "application/json",
      "path": "artifacts/checks/pair-01.json",
      "sha256": "628b1f02e01b04cf5767c541313dd2cdda239604e58b234ce1a2d21a1f073f16",
      "size": 88
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/checks/pair-01.stderr.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "application/json",
      "path": "artifacts/checks/pair-02.json",
      "sha256": "628b1f02e01b04cf5767c541313dd2cdda239604e58b234ce1a2d21a1f073f16",
      "size": 88
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/checks/pair-02.stderr.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "application/json",
      "path": "artifacts/checks/pair-03.json",
      "sha256": "628b1f02e01b04cf5767c541313dd2cdda239604e58b234ce1a2d21a1f073f16",
      "size": 88
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/checks/pair-03.stderr.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "application/json",
      "path": "artifacts/checks/pair-04.json",
      "sha256": "628b1f02e01b04cf5767c541313dd2cdda239604e58b234ce1a2d21a1f073f16",
      "size": 88
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/checks/pair-04.stderr.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "application/json",
      "path": "artifacts/checks/pair-05.json",
      "sha256": "628b1f02e01b04cf5767c541313dd2cdda239604e58b234ce1a2d21a1f073f16",
      "size": 88
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/checks/pair-05.stderr.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "application/json",
      "path": "artifacts/checks/pair-06.json",
      "sha256": "628b1f02e01b04cf5767c541313dd2cdda239604e58b234ce1a2d21a1f073f16",
      "size": 88
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/checks/pair-06.stderr.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "application/json",
      "path": "artifacts/checks/pair-07.json",
      "sha256": "628b1f02e01b04cf5767c541313dd2cdda239604e58b234ce1a2d21a1f073f16",
      "size": 88
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/checks/pair-07.stderr.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "application/json",
      "path": "artifacts/checks/pair-08.json",
      "sha256": "628b1f02e01b04cf5767c541313dd2cdda239604e58b234ce1a2d21a1f073f16",
      "size": 88
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/checks/pair-08.stderr.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "application/json",
      "path": "artifacts/inputs/case.original.json",
      "sha256": "ac0f158eaa85d5846bd61f5868961ce6d09e2e19c537fdd809e8d39d6c27ed5c",
      "size": 3265
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/inputs/reference-LICENSE.txt",
      "sha256": "902d75776b0e95451cfffcea5eb12653b9de1f72ba91476bafdd393ac007e478",
      "size": 11416
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/inputs/reference-pins.txt",
      "sha256": "520e22a9098309d71a06fdac615b81befa491b44dd5c3deaf5f0257671546733",
      "size": 266
    },
    {
      "media_type": "text/x-python",
      "path": "artifacts/inputs/reference.py",
      "sha256": "d4a99e4ae5ccb086181f1e0e20f686ccb0b52b32697d6ca4778632f9380c9e30",
      "size": 2594
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/inputs/target-LICENSE.txt",
      "sha256": "902d75776b0e95451cfffcea5eb12653b9de1f72ba91476bafdd393ac007e478",
      "size": 11416
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/inputs/target-pins.txt",
      "sha256": "c33387f0724cf518098c8966863e9df03bf32ad73cdfc8693f41836ca401be16",
      "size": 271
    },
    {
      "media_type": "text/x-python",
      "path": "artifacts/inputs/target.py",
      "sha256": "8eb5c9a7a6ee67a3eecbd4001980019787f4fed53acb9cdcd8151b46ee30b63e",
      "size": 2545
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/asymmetric4__p1-a__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/asymmetric4__p1-a__shots-17.qasm",
      "sha256": "8639d034fc5a3efc6c081ccf95347277db42bba5bc1940620c1ca097074680f9",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/asymmetric4__p1-a__shots-17.qpy",
      "sha256": "4f08bd3df4781747922594fc095ba479e2f1b3eadc382e3a99136d4c55a05bbb",
      "size": 1136
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/asymmetric4__p1-a__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/asymmetric4__p1-a__shots-512.qasm",
      "sha256": "8639d034fc5a3efc6c081ccf95347277db42bba5bc1940620c1ca097074680f9",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/asymmetric4__p1-a__shots-512.qpy",
      "sha256": "dbc98f016abc72964279e82a84ed432969b80030c14e1c4d4dcfb3c50d14db7c",
      "size": 1136
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/asymmetric4__p1-b__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/asymmetric4__p1-b__shots-17.qasm",
      "sha256": "fc787d670aac63e65bcd84c5e843becec9e158f81d8ace6858a36e416ebd06f6",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/asymmetric4__p1-b__shots-17.qpy",
      "sha256": "9208bc20a49630f2a74a1487d2c25182e55a4aca8748f408a07130c4049a4733",
      "size": 1136
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/asymmetric4__p1-b__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/asymmetric4__p1-b__shots-512.qasm",
      "sha256": "fc787d670aac63e65bcd84c5e843becec9e158f81d8ace6858a36e416ebd06f6",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/asymmetric4__p1-b__shots-512.qpy",
      "sha256": "c04df61227b07a440bf80e5180b4e3e69e145db19386095b9a5897f0be074793",
      "size": 1136
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/asymmetric4__p2__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/asymmetric4__p2__shots-17.qasm",
      "sha256": "fb7a2dbffad5255626be301e5799cec8ebe58904a9784aad2c64286099b93fe8",
      "size": 366
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/asymmetric4__p2__shots-17.qpy",
      "sha256": "2db9bc5d396ed12d1cabd7e1d6a16fd383945b9ebad2ad14b5e38694f1708a85",
      "size": 1648
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/asymmetric4__p2__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/asymmetric4__p2__shots-512.qasm",
      "sha256": "fb7a2dbffad5255626be301e5799cec8ebe58904a9784aad2c64286099b93fe8",
      "size": 366
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/asymmetric4__p2__shots-512.qpy",
      "sha256": "f511d14b816312c2b5935775719ee1ceb8a504bd7a130db622ac94fda5199e93",
      "size": 1648
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/cycle5__p1-a__shots-17.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/cycle5__p1-a__shots-17.qasm",
      "sha256": "276f3cc18c91d888ef3686903b7189c8a18439eaa168d484c3e5412d0d0e0028",
      "size": 266
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/cycle5__p1-a__shots-17.qpy",
      "sha256": "1d600ee98e0fe34e1ba9938bac298376c41364e097a0db405f3a73b62428c46f",
      "size": 1378
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/cycle5__p1-a__shots-512.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/cycle5__p1-a__shots-512.qasm",
      "sha256": "276f3cc18c91d888ef3686903b7189c8a18439eaa168d484c3e5412d0d0e0028",
      "size": 266
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/cycle5__p1-a__shots-512.qpy",
      "sha256": "49c625c778495d9595fc8b55924e509ce02063baca555f7487242fbb01877829",
      "size": 1378
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/cycle5__p1-b__shots-17.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/cycle5__p1-b__shots-17.qasm",
      "sha256": "8bde8e9b7e2495820f71b77c10fb2eca58505a134b2926ec6889c1a00f5050f1",
      "size": 266
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/cycle5__p1-b__shots-17.qpy",
      "sha256": "209ef5d8214f969647cd6a7832c9ed4979c1be1900a44b557acfdd9745faa3ed",
      "size": 1378
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/cycle5__p1-b__shots-512.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/cycle5__p1-b__shots-512.qasm",
      "sha256": "8bde8e9b7e2495820f71b77c10fb2eca58505a134b2926ec6889c1a00f5050f1",
      "size": 266
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/cycle5__p1-b__shots-512.qpy",
      "sha256": "25366aac81a8c7d4618ad42ebc2c8ef9b2544dd374bfb6dc14d317acf8c73db7",
      "size": 1378
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/cycle5__p2__shots-17.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/cycle5__p2__shots-17.qasm",
      "sha256": "ebb60263036fafde6135b239628eef14d7e7a250189d10e17ff658a2eb5dd49f",
      "size": 446
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/cycle5__p2__shots-17.qpy",
      "sha256": "e9566bee0bb3265e5d7637fc80142901e0476834cfd6914c9ecaa68bd0b4d5d1",
      "size": 2018
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/cycle5__p2__shots-512.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/cycle5__p2__shots-512.qasm",
      "sha256": "ebb60263036fafde6135b239628eef14d7e7a250189d10e17ff658a2eb5dd49f",
      "size": 446
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/cycle5__p2__shots-512.qpy",
      "sha256": "5db0eef2c4e40a031390c6c58b0d950160b15fa5836f31ac21b34ea5a18c1826",
      "size": 2018
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/observations.json",
      "sha256": "b2e1616bb218e3ed14b3bf28347dc02c127a9a5600db128ba58b07ded0afa966",
      "size": 57216
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/runtime.json",
      "sha256": "389d83288f3c311718a32bb99b85434cb12417d34f57ea1dccc4d013c1c09cee",
      "size": 11811
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/stderr.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/stdout.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/textbook_cycle4__p1-a__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/textbook_cycle4__p1-a__shots-17.qasm",
      "sha256": "05ffb5237902e17adf6b79feeb3504de74436ac95b53393ae8f4fa807f508d19",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/textbook_cycle4__p1-a__shots-17.qpy",
      "sha256": "d60d6bce42f8e5baa21334ceb41dbd614118f1ad9d277e4f53728aab65ef0d8a",
      "size": 1136
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/textbook_cycle4__p1-a__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/textbook_cycle4__p1-a__shots-512.qasm",
      "sha256": "05ffb5237902e17adf6b79feeb3504de74436ac95b53393ae8f4fa807f508d19",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/textbook_cycle4__p1-a__shots-512.qpy",
      "sha256": "43072b8b89b4b5304bc7c584564c9ed22d2c0873d1de2f983b79a0faeff0d202",
      "size": 1136
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/textbook_cycle4__p1-b__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/textbook_cycle4__p1-b__shots-17.qasm",
      "sha256": "4fef82407e0a074cc6bf8a42e007c5c0d9aa398397349beabaeb63647fcbf1df",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/textbook_cycle4__p1-b__shots-17.qpy",
      "sha256": "968739dedc67b33c85a8781a1634412500868c3b4fb03d1be0643a33cdd93588",
      "size": 1136
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/textbook_cycle4__p1-b__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/textbook_cycle4__p1-b__shots-512.qasm",
      "sha256": "4fef82407e0a074cc6bf8a42e007c5c0d9aa398397349beabaeb63647fcbf1df",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/textbook_cycle4__p1-b__shots-512.qpy",
      "sha256": "bf1441522079cd5fc56a4150321e18afaf3f9cf75598207d42b42ccf6ec35a24",
      "size": 1136
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/textbook_cycle4__p2__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/textbook_cycle4__p2__shots-17.qasm",
      "sha256": "61736110b245f364d34ca22086175643ff9cf36007fa5ad6103244426d9e4992",
      "size": 366
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/textbook_cycle4__p2__shots-17.qpy",
      "sha256": "d1f3586b8625200500982af28580662d35fe23aabc4caf008a8153acd8c78830",
      "size": 1648
    },
    {
      "media_type": "application/json",
      "path": "artifacts/reference/textbook_cycle4__p2__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/reference/textbook_cycle4__p2__shots-512.qasm",
      "sha256": "61736110b245f364d34ca22086175643ff9cf36007fa5ad6103244426d9e4992",
      "size": 366
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/reference/textbook_cycle4__p2__shots-512.qpy",
      "sha256": "df202d07b7ec4f6e76f1a44d48eb6bd939995873912297d0362d7a8f27839a35",
      "size": 1648
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/asymmetric4__p1-a__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/asymmetric4__p1-a__shots-17.qasm",
      "sha256": "149a393284c8540e62e85a9c5c0cdc0daa5231b72685b0ee32666cf7c79469c2",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/asymmetric4__p1-a__shots-17.qpy",
      "sha256": "76357fd8634c60da7f05e4f392ffa2a65ecff6ffe0fd6caaecb8dff90a79b3e9",
      "size": 1097
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/asymmetric4__p1-a__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/asymmetric4__p1-a__shots-512.qasm",
      "sha256": "149a393284c8540e62e85a9c5c0cdc0daa5231b72685b0ee32666cf7c79469c2",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/asymmetric4__p1-a__shots-512.qpy",
      "sha256": "d84d814a765d8339ea77ab87d23c0416a1f66cb5b44862f811859bcedec4e41d",
      "size": 1097
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/asymmetric4__p1-b__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/asymmetric4__p1-b__shots-17.qasm",
      "sha256": "c9bc20b8a3f0359f8616f3db5243cd65e4728d3e8465a58d4a573a5a9e0d0e62",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/asymmetric4__p1-b__shots-17.qpy",
      "sha256": "18151e1726fdf1971b5b0c73430b58eaf4684dbc6e320fea889c40c0c6a767d4",
      "size": 1097
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/asymmetric4__p1-b__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/asymmetric4__p1-b__shots-512.qasm",
      "sha256": "c9bc20b8a3f0359f8616f3db5243cd65e4728d3e8465a58d4a573a5a9e0d0e62",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/asymmetric4__p1-b__shots-512.qpy",
      "sha256": "7865e15a0bcd33fd24d68d7889c91725d6354c53d0a5821823b03be612781b20",
      "size": 1097
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/asymmetric4__p2__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/asymmetric4__p2__shots-17.qasm",
      "sha256": "cef8dd9eda7b72333775d1b0556260a1bc13242b0c07690d0b2ee8847474581b",
      "size": 366
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/asymmetric4__p2__shots-17.qpy",
      "sha256": "5433d61497cf1aac382d596d93f767def1f1cc346947ea4550c55bf5cd014482",
      "size": 1609
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/asymmetric4__p2__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/asymmetric4__p2__shots-512.qasm",
      "sha256": "cef8dd9eda7b72333775d1b0556260a1bc13242b0c07690d0b2ee8847474581b",
      "size": 366
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/asymmetric4__p2__shots-512.qpy",
      "sha256": "7350bc9a35fdd08e7fa3da8487579190765141a0a158e5d0a165211de5ef3b67",
      "size": 1609
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/cycle5__p1-a__shots-17.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/cycle5__p1-a__shots-17.qasm",
      "sha256": "3c68239578de5cf6a1cfe5dda0fb65a2c4af86dcd9b5de90668a5d6eb637fe94",
      "size": 266
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/cycle5__p1-a__shots-17.qpy",
      "sha256": "72856fd2b4f808add93c49b0db6eb5e6ed17ce6fd75d1dd9396a5d349629bcc8",
      "size": 1323
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/cycle5__p1-a__shots-512.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/cycle5__p1-a__shots-512.qasm",
      "sha256": "3c68239578de5cf6a1cfe5dda0fb65a2c4af86dcd9b5de90668a5d6eb637fe94",
      "size": 266
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/cycle5__p1-a__shots-512.qpy",
      "sha256": "5b86303149ec768d8406a5e74440789c0510c102151c50071ae04618886e2538",
      "size": 1323
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/cycle5__p1-b__shots-17.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/cycle5__p1-b__shots-17.qasm",
      "sha256": "53b610ee88fa8fda2fc193a1761b179df87e1ffa27b67edf85a76baf46d65966",
      "size": 266
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/cycle5__p1-b__shots-17.qpy",
      "sha256": "be379079a4de768e2411f7d3722662a62ef17a1c233649addd47e69d50fe4f71",
      "size": 1324
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/cycle5__p1-b__shots-512.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/cycle5__p1-b__shots-512.qasm",
      "sha256": "53b610ee88fa8fda2fc193a1761b179df87e1ffa27b67edf85a76baf46d65966",
      "size": 266
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/cycle5__p1-b__shots-512.qpy",
      "sha256": "f36adbc4645a84122179c97a69c09713d7eff95c11812c2d1b06e766380427ac",
      "size": 1324
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/cycle5__p2__shots-17.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/cycle5__p2__shots-17.qasm",
      "sha256": "d102fc8780b1b2d6c2e3edaedb524f718a5a288f2ff0582d5db3ef3e6ad36d65",
      "size": 446
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/cycle5__p2__shots-17.qpy",
      "sha256": "1ee86bdeaa4d60d4bb2042a0abe0d041bc3b770c9ae1932b057d4ef90c804f2e",
      "size": 1964
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/cycle5__p2__shots-512.circuit.json",
      "sha256": "c87f9e9127222a7f680e644e31ce6fca847e19a428dedb7d4c9a3a573a621b58",
      "size": 348
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/cycle5__p2__shots-512.qasm",
      "sha256": "d102fc8780b1b2d6c2e3edaedb524f718a5a288f2ff0582d5db3ef3e6ad36d65",
      "size": 446
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/cycle5__p2__shots-512.qpy",
      "sha256": "882154c8c9060227d76ae559799d9021d06bb59e3411dde53b163266cc9fada1",
      "size": 1964
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/observations.json",
      "sha256": "eb95f39b2c5fd1e1c8ed487fe8a85222037f07892c639a72d608598902275839",
      "size": 54421
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/runtime.json",
      "sha256": "0fa274a5bf81fae7f38eefc4b3bd24d07c3c41f364e9e34fca81608df328343d",
      "size": 11805
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/stderr.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/stdout.txt",
      "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
      "size": 0
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/textbook_cycle4__p1-a__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/textbook_cycle4__p1-a__shots-17.qasm",
      "sha256": "51900b6a4e63b5f6c76aaba34b0ef50f1e3515c98042f819638ca49c02a1f7b8",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/textbook_cycle4__p1-a__shots-17.qpy",
      "sha256": "28c129c748ca1d1372590a7a8fd2bc6f4833af6e5bdf2f85bbbd5a328ecb37a1",
      "size": 1097
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/textbook_cycle4__p1-a__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/textbook_cycle4__p1-a__shots-512.qasm",
      "sha256": "51900b6a4e63b5f6c76aaba34b0ef50f1e3515c98042f819638ca49c02a1f7b8",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/textbook_cycle4__p1-a__shots-512.qpy",
      "sha256": "ac0b24ba96664b422018f2468cff7e23c7efd441e09eabc4330399e0d7b27b53",
      "size": 1097
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/textbook_cycle4__p1-b__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/textbook_cycle4__p1-b__shots-17.qasm",
      "sha256": "044f322be9b9da4628ba71183a4692d6c50821b962fd7754a4d0ae1d9bf94d1f",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/textbook_cycle4__p1-b__shots-17.qpy",
      "sha256": "440b26c18662d3f14f606257dd4782ece208c56da3afc1765b159dac25d76210",
      "size": 1097
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/textbook_cycle4__p1-b__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/textbook_cycle4__p1-b__shots-512.qasm",
      "sha256": "044f322be9b9da4628ba71183a4692d6c50821b962fd7754a4d0ae1d9bf94d1f",
      "size": 222
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/textbook_cycle4__p1-b__shots-512.qpy",
      "sha256": "73c95a5361778210f563e054eb73a4d3df110e92be6519a54f5a9fd1e6db4ca4",
      "size": 1097
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/textbook_cycle4__p2__shots-17.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/textbook_cycle4__p2__shots-17.qasm",
      "sha256": "c209abc21e712519308067385434006b75edae1845fe14496e7817ce54fa1044",
      "size": 366
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/textbook_cycle4__p2__shots-17.qpy",
      "sha256": "36d9895bbbfee70108fc7ce1777e843af31f4fe532b5c5bd657a242fba436e86",
      "size": 1609
    },
    {
      "media_type": "application/json",
      "path": "artifacts/target/textbook_cycle4__p2__shots-512.circuit.json",
      "sha256": "096e49b5e94e56389c06081c03d8c9133cd267a0261e0d9299ed485c73158129",
      "size": 318
    },
    {
      "media_type": "text/plain",
      "path": "artifacts/target/textbook_cycle4__p2__shots-512.qasm",
      "sha256": "c209abc21e712519308067385434006b75edae1845fe14496e7817ce54fa1044",
      "size": 366
    },
    {
      "media_type": "application/octet-stream",
      "path": "artifacts/target/textbook_cycle4__p2__shots-512.qpy",
      "sha256": "28218d5839a9c9be2a6a2d7d2eed44255d8a503102136764339f31e1eca6aee1",
      "size": 1609
    }
  ],
  "case": {
    "case_sha256": "ac0f158eaa85d5846bd61f5868961ce6d09e2e19c537fdd809e8d39d6c27ed5c",
    "definition": {
      "angles": [
        {
          "id": "p1-a",
          "theta": [
            0.17,
            0.63
          ]
        },
        {
          "id": "p1-b",
          "theta": [
            0.81,
            0.29
          ]
        },
        {
          "id": "p2",
          "theta": [
            0.17,
            0.63,
            0.41,
            0.92
          ]
        }
      ],
      "case_id": "qaoa-seeded-rotation",
      "description": "Labelled synthetic regression: the mixer rotation angle is halved. The circuit checker should catch this one.",
      "graphs": [
        {
          "edges": [
            [
              0,
              1
            ],
            [
              1,
              2
            ],
            [
              2,
              3
            ],
            [
              3,
              0
            ]
          ],
          "id": "textbook_cycle4",
          "nodes": [
            0,
            1,
            2,
            3
          ]
        },
        {
          "edges": [
            [
              0,
              1
            ],
            [
              1,
              2
            ],
            [
              2,
              3
            ],
            [
              0,
              2
            ]
          ],
          "id": "asymmetric4",
          "nodes": [
            0,
            1,
            2,
            3
          ]
        },
        {
          "edges": [
            [
              0,
              1
            ],
            [
              1,
              2
            ],
            [
              2,
              3
            ],
            [
              3,
              4
            ],
            [
              4,
              0
            ]
          ],
          "id": "cycle5",
          "nodes": [
            0,
            1,
            2,
            3,
            4
          ]
        }
      ],
      "interpretation": {
        "count_order": "qiskit_count_msb_left",
        "measurement": "terminal_identity",
        "node_mapping": "node_i_is_qubit_i",
        "objective": "negative_maxcut"
      },
      "origin": "seeded_regression",
      "proposal": null,
      "reference": {
        "module": "../evidence/qaoa/legacy_functions.py",
        "pins": "../evidence/qaoa/legacy-requirements.txt",
        "receipt": {
          "attribution": "Qiskit textbook contributors",
          "derived_from_sha256": null,
          "extraction_scope": "Helper cell (maxcut_obj, compute_expectation, create_qaoa_circ, get_expectation) with its required imports added; not the whole notebook.",
          "kind": "upstream_extract",
          "license_file": "../evidence/qaoa/LICENSE.txt",
          "license_spdx": "Apache-2.0",
          "upstream_path": "content/ch-applications/qaoa.ipynb",
          "upstream_revision": "0ae905083ec3872d7ddc6bb4001d5468f476d93f",
          "upstream_url": "https://github.com/qiskit-community/qiskit-textbook/blob/0ae905083ec3872d7ddc6bb4001d5468f476d93f/content/ch-applications/qaoa.ipynb"
        }
      },
      "schema": "qref.qaoa-case/v1",
      "shots": [
        512,
        17
      ],
      "target": {
        "module": "seeded/rotation_halved.py",
        "pins": "../evidence/qaoa/modern-requirements.txt",
        "receipt": {
          "attribution": "Qiskit textbook contributors (derived work); seeded edit by the QRef author",
          "derived_from_sha256": null,
          "extraction_scope": "Research port with one deliberate edit: rx(2*beta) became rx(beta).",
          "kind": "local_code",
          "license_file": "../evidence/qaoa/LICENSE.txt",
          "license_spdx": "Apache-2.0",
          "upstream_path": null,
          "upstream_revision": null,
          "upstream_url": null
        }
      },
      "title": "QAOA helpers \u2014 seeded rotation regression"
    },
    "executions": [
      {
        "angle_id": "p1-a",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            0
          ]
        ],
        "graph_id": "textbook_cycle4",
        "id": "textbook_cycle4/p1-a/shots-512",
        "input_sha256": "bd2973bdd6445b5044d51ceb29adb39c59711345bc804854c53d2f5a3ea64383",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 512,
        "theta": [
          0.17,
          0.63
        ]
      },
      {
        "angle_id": "p1-a",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            0
          ]
        ],
        "graph_id": "textbook_cycle4",
        "id": "textbook_cycle4/p1-a/shots-17",
        "input_sha256": "fa07cd28b3b8891420b58ab0cf642e02a0b39068f47667ee27b215036ac8405d",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 17,
        "theta": [
          0.17,
          0.63
        ]
      },
      {
        "angle_id": "p1-b",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            0
          ]
        ],
        "graph_id": "textbook_cycle4",
        "id": "textbook_cycle4/p1-b/shots-512",
        "input_sha256": "7d3afa639a7301fd3a9b0fd953d29ce0326e271fea7966fcea861974a2fe10eb",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 512,
        "theta": [
          0.81,
          0.29
        ]
      },
      {
        "angle_id": "p1-b",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            0
          ]
        ],
        "graph_id": "textbook_cycle4",
        "id": "textbook_cycle4/p1-b/shots-17",
        "input_sha256": "94f83f59cb93d790a583f7c8012d538506f96d661700aaeb37168ea8a123355e",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 17,
        "theta": [
          0.81,
          0.29
        ]
      },
      {
        "angle_id": "p2",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            0
          ]
        ],
        "graph_id": "textbook_cycle4",
        "id": "textbook_cycle4/p2/shots-512",
        "input_sha256": "299c7512267d8b1ba78ffe2a027638ca10c6120ea22b6cc365a99f7704106e4b",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 512,
        "theta": [
          0.17,
          0.63,
          0.41,
          0.92
        ]
      },
      {
        "angle_id": "p2",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            0
          ]
        ],
        "graph_id": "textbook_cycle4",
        "id": "textbook_cycle4/p2/shots-17",
        "input_sha256": "6f82aff743be8d084ef54905861ff4e3bc64e43cc1f6948cc945898b2d7f1348",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 17,
        "theta": [
          0.17,
          0.63,
          0.41,
          0.92
        ]
      },
      {
        "angle_id": "p1-a",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            0,
            2
          ]
        ],
        "graph_id": "asymmetric4",
        "id": "asymmetric4/p1-a/shots-512",
        "input_sha256": "c034adc209e349ea974c7a895cb3cf09077dd1bd25d0be14b82726be6e8bb072",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 512,
        "theta": [
          0.17,
          0.63
        ]
      },
      {
        "angle_id": "p1-a",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            0,
            2
          ]
        ],
        "graph_id": "asymmetric4",
        "id": "asymmetric4/p1-a/shots-17",
        "input_sha256": "1510f88f4839aceb42d92237aea2c1d58556669eb1a2a8f5c7ed5f2b43369268",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 17,
        "theta": [
          0.17,
          0.63
        ]
      },
      {
        "angle_id": "p1-b",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            0,
            2
          ]
        ],
        "graph_id": "asymmetric4",
        "id": "asymmetric4/p1-b/shots-512",
        "input_sha256": "c473a1c2746c91dd29bd70e18dce8db8dbb4f2281b3c032bac27168ee28a22a8",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 512,
        "theta": [
          0.81,
          0.29
        ]
      },
      {
        "angle_id": "p1-b",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            0,
            2
          ]
        ],
        "graph_id": "asymmetric4",
        "id": "asymmetric4/p1-b/shots-17",
        "input_sha256": "44c7b709acc93eeefa1bfe1cc9dccdcd5b2bbb7da3923ed587695cd59eecc71b",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 17,
        "theta": [
          0.81,
          0.29
        ]
      },
      {
        "angle_id": "p2",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            0,
            2
          ]
        ],
        "graph_id": "asymmetric4",
        "id": "asymmetric4/p2/shots-512",
        "input_sha256": "8c06c7c002ada04d2131a4caf2816446e875e7b39dc77e62c475b49004938147",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 512,
        "theta": [
          0.17,
          0.63,
          0.41,
          0.92
        ]
      },
      {
        "angle_id": "p2",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            0,
            2
          ]
        ],
        "graph_id": "asymmetric4",
        "id": "asymmetric4/p2/shots-17",
        "input_sha256": "50d20a5f68c1e06d4d947c142f1ff96f0d6b9f772c0df0257850e0022587ac67",
        "nodes": [
          0,
          1,
          2,
          3
        ],
        "requested_shots": 17,
        "theta": [
          0.17,
          0.63,
          0.41,
          0.92
        ]
      },
      {
        "angle_id": "p1-a",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            4
          ],
          [
            4,
            0
          ]
        ],
        "graph_id": "cycle5",
        "id": "cycle5/p1-a/shots-512",
        "input_sha256": "f97f1cbaab27825e6250187b3b1d1c6805f704ccd1f0c4f0885eb3b2516c816b",
        "nodes": [
          0,
          1,
          2,
          3,
          4
        ],
        "requested_shots": 512,
        "theta": [
          0.17,
          0.63
        ]
      },
      {
        "angle_id": "p1-a",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            4
          ],
          [
            4,
            0
          ]
        ],
        "graph_id": "cycle5",
        "id": "cycle5/p1-a/shots-17",
        "input_sha256": "82bd560dc7768e2d844bb0e6d03d95df65fe12e6feb77d44ab4446f3e50c976f",
        "nodes": [
          0,
          1,
          2,
          3,
          4
        ],
        "requested_shots": 17,
        "theta": [
          0.17,
          0.63
        ]
      },
      {
        "angle_id": "p1-b",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            4
          ],
          [
            4,
            0
          ]
        ],
        "graph_id": "cycle5",
        "id": "cycle5/p1-b/shots-512",
        "input_sha256": "c3f73a72ca79ed97502a85430c27be8abc06c90841254deae282a5650b73b80b",
        "nodes": [
          0,
          1,
          2,
          3,
          4
        ],
        "requested_shots": 512,
        "theta": [
          0.81,
          0.29
        ]
      },
      {
        "angle_id": "p1-b",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            4
          ],
          [
            4,
            0
          ]
        ],
        "graph_id": "cycle5",
        "id": "cycle5/p1-b/shots-17",
        "input_sha256": "02f3163452f862163df14f4e60bf05ef1b8054ba2e5a050239e9627275656895",
        "nodes": [
          0,
          1,
          2,
          3,
          4
        ],
        "requested_shots": 17,
        "theta": [
          0.81,
          0.29
        ]
      },
      {
        "angle_id": "p2",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            4
          ],
          [
            4,
            0
          ]
        ],
        "graph_id": "cycle5",
        "id": "cycle5/p2/shots-512",
        "input_sha256": "a8085140a5ff07050f7aee8ab10981b351b825cd6a4049701473b22c6385abb7",
        "nodes": [
          0,
          1,
          2,
          3,
          4
        ],
        "requested_shots": 512,
        "theta": [
          0.17,
          0.63,
          0.41,
          0.92
        ]
      },
      {
        "angle_id": "p2",
        "edges": [
          [
            0,
            1
          ],
          [
            1,
            2
          ],
          [
            2,
            3
          ],
          [
            3,
            4
          ],
          [
            4,
            0
          ]
        ],
        "graph_id": "cycle5",
        "id": "cycle5/p2/shots-17",
        "input_sha256": "0518eefd156133a6f84afa770855228a0d182b04e4b5d53c1d2d3dcaf8da6c4a",
        "nodes": [
          0,
          1,
          2,
          3,
          4
        ],
        "requested_shots": 17,
        "theta": [
          0.17,
          0.63,
          0.41,
          0.92
        ]
      }
    ],
    "portable_case_artifact": "case.json",
    "portable_case_sha256": "ed7ee41c74ff597c442970129d6ce5d4a74bfe36165490f335d0442c146e956e",
    "source_artifact": "artifacts/inputs/case.original.json"
  },
  "checks": [
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "pairing",
      "kind": "pairing",
      "metric": null,
      "observed": null,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "all"
      ],
      "status": "pass",
      "summary": "18 expected executions per side, paired by input digest",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": "negative_maxcut",
      "id": "classical-basis/reference/textbook_cycle4",
      "kind": "classical-basis",
      "metric": 0,
      "observed": {
        "mismatched_k": []
      },
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4"
      ],
      "status": "pass",
      "summary": "reference: 16/16 basis assignments match the independent negative-cut rule",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": "negative_maxcut",
      "id": "classical-basis/reference/asymmetric4",
      "kind": "classical-basis",
      "metric": 0,
      "observed": {
        "mismatched_k": []
      },
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4"
      ],
      "status": "pass",
      "summary": "reference: 16/16 basis assignments match the independent negative-cut rule",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": "negative_maxcut",
      "id": "classical-basis/reference/cycle5",
      "kind": "classical-basis",
      "metric": 0,
      "observed": {
        "mismatched_k": []
      },
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5"
      ],
      "status": "pass",
      "summary": "reference: 32/32 basis assignments match the independent negative-cut rule",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": "negative_maxcut",
      "id": "classical-basis/target/textbook_cycle4",
      "kind": "classical-basis",
      "metric": 0,
      "observed": {
        "mismatched_k": []
      },
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4"
      ],
      "status": "pass",
      "summary": "target: 16/16 basis assignments match the independent negative-cut rule",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": "negative_maxcut",
      "id": "classical-basis/target/asymmetric4",
      "kind": "classical-basis",
      "metric": 0,
      "observed": {
        "mismatched_k": []
      },
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4"
      ],
      "status": "pass",
      "summary": "target: 16/16 basis assignments match the independent negative-cut rule",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": "negative_maxcut",
      "id": "classical-basis/target/cycle5",
      "kind": "classical-basis",
      "metric": 0,
      "observed": {
        "mismatched_k": []
      },
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5"
      ],
      "status": "pass",
      "summary": "target: 32/32 basis assignments match the independent negative-cut rule",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/textbook_cycle4/p1-a/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/reference/textbook_cycle4/p1-a/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "reference: requested 512, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.61328125,
      "id": "returned-objective/reference/textbook_cycle4/p1-a/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.61328125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.61328125,
      "id": "classical-weighting/reference/textbook_cycle4/p1-a/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.61328125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.6338345499071132,
      "id": "classical-weighting/reference/textbook_cycle4/p1-a/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 6.661338147750939e-16,
      "observed": -1.6338345499071139,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 6.66e-16)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-integrity/target/textbook_cycle4/p1-a/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: completed shots 512 vs count sum 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/target/textbook_cycle4/p1-a/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: requested 512, completed 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.78515625,
      "id": "returned-objective/target/textbook_cycle4/p1-a/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.78515625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.78515625,
      "id": "classical-weighting/target/textbook_cycle4/p1-a/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.78515625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.8058002450257404,
      "id": "classical-weighting/target/textbook_cycle4/p1-a/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 1.7763568394002505e-15,
      "observed": -1.8058002450257422,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 1.78e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-8700bcf5cababb823f46d4ffd9d8362ebabb8f7acf92f57260fd55edc7804d56",
      "expected": "equivalent",
      "id": "circuit/textbook_cycle4/p1-a/shots-512",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/textbook_cycle4/p1-a/shots-512",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/textbook_cycle4/p1-a/shots-512",
      "kind": "probability",
      "metric": 0.04085126400924283,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0409",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.6338345499071132,
      "id": "exact-objective/textbook_cycle4/p1-a/shots-512",
      "kind": "exact-objective",
      "metric": 0.17196569511862725,
      "observed": -1.8058002450257404,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.172)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/textbook_cycle4/p1-a/shots-512",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 512,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/textbook_cycle4/p1-a/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/reference/textbook_cycle4/p1-a/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "reference: requested 17, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.61328125,
      "id": "returned-objective/reference/textbook_cycle4/p1-a/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.61328125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.61328125,
      "id": "classical-weighting/reference/textbook_cycle4/p1-a/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.61328125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.6338345499071132,
      "id": "classical-weighting/reference/textbook_cycle4/p1-a/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 6.661338147750939e-16,
      "observed": -1.6338345499071139,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 6.66e-16)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-integrity/target/textbook_cycle4/p1-a/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: completed shots 17 vs count sum 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/target/textbook_cycle4/p1-a/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: requested 17, completed 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.7647058823529411,
      "id": "returned-objective/target/textbook_cycle4/p1-a/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.7647058823529411,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.7647058823529411,
      "id": "classical-weighting/target/textbook_cycle4/p1-a/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.7647058823529411,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.8058002450257404,
      "id": "classical-weighting/target/textbook_cycle4/p1-a/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 1.7763568394002505e-15,
      "observed": -1.8058002450257422,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 1.78e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-8700bcf5cababb823f46d4ffd9d8362ebabb8f7acf92f57260fd55edc7804d56",
      "expected": "equivalent",
      "id": "circuit/textbook_cycle4/p1-a/shots-17",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/textbook_cycle4/p1-a/shots-17",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/textbook_cycle4/p1-a/shots-17",
      "kind": "probability",
      "metric": 0.04085126400924283,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0409",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.6338345499071132,
      "id": "exact-objective/textbook_cycle4/p1-a/shots-17",
      "kind": "exact-objective",
      "metric": 0.17196569511862725,
      "observed": -1.8058002450257404,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.172)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/textbook_cycle4/p1-a/shots-17",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 17,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/textbook_cycle4/p1-b/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/reference/textbook_cycle4/p1-b/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "reference: requested 512, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.060546875,
      "id": "returned-objective/reference/textbook_cycle4/p1-b/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.060546875,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.060546875,
      "id": "classical-weighting/reference/textbook_cycle4/p1-b/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.060546875,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0900746161779686,
      "id": "classical-weighting/reference/textbook_cycle4/p1-b/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 1.7763568394002505e-15,
      "observed": -2.0900746161779704,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 1.78e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-integrity/target/textbook_cycle4/p1-b/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: completed shots 512 vs count sum 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/target/textbook_cycle4/p1-b/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: requested 512, completed 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.10546875,
      "id": "returned-objective/target/textbook_cycle4/p1-b/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.10546875,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.10546875,
      "id": "classical-weighting/target/textbook_cycle4/p1-b/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.10546875,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.0843064581768664,
      "id": "classical-weighting/target/textbook_cycle4/p1-b/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 1.1102230246251565e-15,
      "observed": -1.0843064581768675,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 1.11e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-a58e12b903d29c7fbc4f249484197613629e6f7a036dc32953e2091060ca766c",
      "expected": "equivalent",
      "id": "circuit/textbook_cycle4/p1-b/shots-512",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/textbook_cycle4/p1-b/shots-512",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/textbook_cycle4/p1-b/shots-512",
      "kind": "probability",
      "metric": 0.13239223854800125,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.132",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0900746161779686,
      "id": "exact-objective/textbook_cycle4/p1-b/shots-512",
      "kind": "exact-objective",
      "metric": 1.0057681580011022,
      "observed": -1.0843064581768664,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 1.01)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/textbook_cycle4/p1-b/shots-512",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 512,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/textbook_cycle4/p1-b/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/reference/textbook_cycle4/p1-b/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "reference: requested 17, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.060546875,
      "id": "returned-objective/reference/textbook_cycle4/p1-b/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.060546875,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.060546875,
      "id": "classical-weighting/reference/textbook_cycle4/p1-b/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.060546875,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0900746161779686,
      "id": "classical-weighting/reference/textbook_cycle4/p1-b/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 1.7763568394002505e-15,
      "observed": -2.0900746161779704,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 1.78e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-integrity/target/textbook_cycle4/p1-b/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: completed shots 17 vs count sum 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/target/textbook_cycle4/p1-b/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: requested 17, completed 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.2941176470588236,
      "id": "returned-objective/target/textbook_cycle4/p1-b/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.2941176470588236,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.2941176470588236,
      "id": "classical-weighting/target/textbook_cycle4/p1-b/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.2941176470588236,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.0843064581768664,
      "id": "classical-weighting/target/textbook_cycle4/p1-b/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 1.1102230246251565e-15,
      "observed": -1.0843064581768675,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 1.11e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-a58e12b903d29c7fbc4f249484197613629e6f7a036dc32953e2091060ca766c",
      "expected": "equivalent",
      "id": "circuit/textbook_cycle4/p1-b/shots-17",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/textbook_cycle4/p1-b/shots-17",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/textbook_cycle4/p1-b/shots-17",
      "kind": "probability",
      "metric": 0.13239223854800125,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.132",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0900746161779686,
      "id": "exact-objective/textbook_cycle4/p1-b/shots-17",
      "kind": "exact-objective",
      "metric": 1.0057681580011022,
      "observed": -1.0843064581768664,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 1.01)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/textbook_cycle4/p1-b/shots-17",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 17,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/textbook_cycle4/p2/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/reference/textbook_cycle4/p2/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "difference",
      "summary": "reference: requested 512, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.19140625,
      "id": "returned-objective/reference/textbook_cycle4/p2/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.19140625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.19140625,
      "id": "classical-weighting/reference/textbook_cycle4/p2/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.19140625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.1683093997105636,
      "id": "classical-weighting/reference/textbook_cycle4/p2/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 1.7763568394002505e-15,
      "observed": -2.1683093997105654,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 1.78e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-integrity/target/textbook_cycle4/p2/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: completed shots 512 vs count sum 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/target/textbook_cycle4/p2/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: requested 512, completed 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.53515625,
      "id": "returned-objective/target/textbook_cycle4/p2/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.53515625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.53515625,
      "id": "classical-weighting/target/textbook_cycle4/p2/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.53515625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.497044738224786,
      "id": "classical-weighting/target/textbook_cycle4/p2/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 3.1086244689504383e-15,
      "observed": -2.497044738224789,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 3.11e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-331b768b6f7e1fbd9141d6e27c579b3276a8cd4bad68fc1cd7b1d749f50f10d4",
      "expected": "equivalent",
      "id": "circuit/textbook_cycle4/p2/shots-512",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/textbook_cycle4/p2/shots-512",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/textbook_cycle4/p2/shots-512",
      "kind": "probability",
      "metric": 0.07397412653911507,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.074",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.1683093997105636,
      "id": "exact-objective/textbook_cycle4/p2/shots-512",
      "kind": "exact-objective",
      "metric": 0.32873533851422243,
      "observed": -2.497044738224786,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.329)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/textbook_cycle4/p2/shots-512",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 512,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p2/shots-512"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/textbook_cycle4/p2/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/reference/textbook_cycle4/p2/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "difference",
      "summary": "reference: requested 17, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.19140625,
      "id": "returned-objective/reference/textbook_cycle4/p2/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.19140625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.19140625,
      "id": "classical-weighting/reference/textbook_cycle4/p2/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.19140625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.1683093997105636,
      "id": "classical-weighting/reference/textbook_cycle4/p2/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 1.7763568394002505e-15,
      "observed": -2.1683093997105654,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 1.78e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-integrity/target/textbook_cycle4/p2/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: completed shots 17 vs count sum 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/target/textbook_cycle4/p2/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: requested 17, completed 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.3529411764705883,
      "id": "returned-objective/target/textbook_cycle4/p2/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.3529411764705883,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.3529411764705883,
      "id": "classical-weighting/target/textbook_cycle4/p2/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.3529411764705883,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.497044738224786,
      "id": "classical-weighting/target/textbook_cycle4/p2/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 3.1086244689504383e-15,
      "observed": -2.497044738224789,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 3.11e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-331b768b6f7e1fbd9141d6e27c579b3276a8cd4bad68fc1cd7b1d749f50f10d4",
      "expected": "equivalent",
      "id": "circuit/textbook_cycle4/p2/shots-17",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/textbook_cycle4/p2/shots-17",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/textbook_cycle4/p2/shots-17",
      "kind": "probability",
      "metric": 0.07397412653911507,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.074",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.1683093997105636,
      "id": "exact-objective/textbook_cycle4/p2/shots-17",
      "kind": "exact-objective",
      "metric": 0.32873533851422243,
      "observed": -2.497044738224786,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.329)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/textbook_cycle4/p2/shots-17",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 17,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "textbook_cycle4/p2/shots-17"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/asymmetric4/p1-a/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/reference/asymmetric4/p1-a/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "reference: requested 512, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.509765625,
      "id": "returned-objective/reference/asymmetric4/p1-a/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.509765625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.509765625,
      "id": "classical-weighting/reference/asymmetric4/p1-a/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.509765625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.5440215733886924,
      "id": "classical-weighting/reference/asymmetric4/p1-a/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 4.440892098500626e-16,
      "observed": -1.5440215733886928,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 4.44e-16)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-integrity/target/asymmetric4/p1-a/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: completed shots 512 vs count sum 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/target/asymmetric4/p1-a/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: requested 512, completed 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.775390625,
      "id": "returned-objective/target/asymmetric4/p1-a/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.775390625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.775390625,
      "id": "classical-weighting/target/asymmetric4/p1-a/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.775390625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.7803440411259577,
      "id": "classical-weighting/target/asymmetric4/p1-a/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 1.9984014443252818e-15,
      "observed": -1.7803440411259597,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 2e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-3c6a4df9ad50ebfa3d028c73a0ce4aa97bd80e3443798c78580ad996c4ba1113",
      "expected": "equivalent",
      "id": "circuit/asymmetric4/p1-a/shots-512",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/asymmetric4/p1-a/shots-512",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/asymmetric4/p1-a/shots-512",
      "kind": "probability",
      "metric": 0.032618451415833666,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0326",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.5440215733886924,
      "id": "exact-objective/asymmetric4/p1-a/shots-512",
      "kind": "exact-objective",
      "metric": 0.23632246773726528,
      "observed": -1.7803440411259577,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.236)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/asymmetric4/p1-a/shots-512",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 512,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/asymmetric4/p1-a/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/reference/asymmetric4/p1-a/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "reference: requested 17, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.509765625,
      "id": "returned-objective/reference/asymmetric4/p1-a/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.509765625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.509765625,
      "id": "classical-weighting/reference/asymmetric4/p1-a/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.509765625,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.5440215733886924,
      "id": "classical-weighting/reference/asymmetric4/p1-a/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 4.440892098500626e-16,
      "observed": -1.5440215733886928,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 4.44e-16)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-integrity/target/asymmetric4/p1-a/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: completed shots 17 vs count sum 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/target/asymmetric4/p1-a/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: requested 17, completed 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.9411764705882353,
      "id": "returned-objective/target/asymmetric4/p1-a/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.9411764705882353,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.9411764705882353,
      "id": "classical-weighting/target/asymmetric4/p1-a/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.9411764705882353,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.7803440411259577,
      "id": "classical-weighting/target/asymmetric4/p1-a/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 1.9984014443252818e-15,
      "observed": -1.7803440411259597,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 2e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-3c6a4df9ad50ebfa3d028c73a0ce4aa97bd80e3443798c78580ad996c4ba1113",
      "expected": "equivalent",
      "id": "circuit/asymmetric4/p1-a/shots-17",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/asymmetric4/p1-a/shots-17",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/asymmetric4/p1-a/shots-17",
      "kind": "probability",
      "metric": 0.032618451415833666,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0326",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.5440215733886924,
      "id": "exact-objective/asymmetric4/p1-a/shots-17",
      "kind": "exact-objective",
      "metric": 0.23632246773726528,
      "observed": -1.7803440411259577,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.236)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/asymmetric4/p1-a/shots-17",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 17,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/asymmetric4/p1-b/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/reference/asymmetric4/p1-b/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "reference: requested 512, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.677734375,
      "id": "returned-objective/reference/asymmetric4/p1-b/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.677734375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.677734375,
      "id": "classical-weighting/reference/asymmetric4/p1-b/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.677734375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.686342788774193,
      "id": "classical-weighting/reference/asymmetric4/p1-b/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 1.3322676295501878e-15,
      "observed": -1.6863427887741944,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 1.33e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-integrity/target/asymmetric4/p1-b/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: completed shots 512 vs count sum 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/target/asymmetric4/p1-b/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: requested 512, completed 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -0.90234375,
      "id": "returned-objective/target/asymmetric4/p1-b/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -0.90234375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -0.90234375,
      "id": "classical-weighting/target/asymmetric4/p1-b/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -0.90234375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -0.9075234890664967,
      "id": "classical-weighting/target/asymmetric4/p1-b/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 1.1102230246251565e-15,
      "observed": -0.9075234890664978,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 1.11e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-d64c5d8c2f56f0a22406bfb45772c02b063d6f8f5c807ea75eef012b54995dbb",
      "expected": "equivalent",
      "id": "circuit/asymmetric4/p1-b/shots-512",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/asymmetric4/p1-b/shots-512",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/asymmetric4/p1-b/shots-512",
      "kind": "probability",
      "metric": 0.0987666181096172,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0988",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.686342788774193,
      "id": "exact-objective/asymmetric4/p1-b/shots-512",
      "kind": "exact-objective",
      "metric": 0.7788192997076964,
      "observed": -0.9075234890664967,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.779)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/asymmetric4/p1-b/shots-512",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 512,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/asymmetric4/p1-b/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/reference/asymmetric4/p1-b/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "reference: requested 17, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.677734375,
      "id": "returned-objective/reference/asymmetric4/p1-b/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.677734375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.677734375,
      "id": "classical-weighting/reference/asymmetric4/p1-b/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.677734375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.686342788774193,
      "id": "classical-weighting/reference/asymmetric4/p1-b/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 1.3322676295501878e-15,
      "observed": -1.6863427887741944,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 1.33e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-integrity/target/asymmetric4/p1-b/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: completed shots 17 vs count sum 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/target/asymmetric4/p1-b/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: requested 17, completed 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -0.9411764705882353,
      "id": "returned-objective/target/asymmetric4/p1-b/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -0.9411764705882353,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -0.9411764705882353,
      "id": "classical-weighting/target/asymmetric4/p1-b/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -0.9411764705882353,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -0.9075234890664967,
      "id": "classical-weighting/target/asymmetric4/p1-b/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 1.1102230246251565e-15,
      "observed": -0.9075234890664978,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 1.11e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-d64c5d8c2f56f0a22406bfb45772c02b063d6f8f5c807ea75eef012b54995dbb",
      "expected": "equivalent",
      "id": "circuit/asymmetric4/p1-b/shots-17",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/asymmetric4/p1-b/shots-17",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/asymmetric4/p1-b/shots-17",
      "kind": "probability",
      "metric": 0.0987666181096172,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0988",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.686342788774193,
      "id": "exact-objective/asymmetric4/p1-b/shots-17",
      "kind": "exact-objective",
      "metric": 0.7788192997076964,
      "observed": -0.9075234890664967,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.779)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/asymmetric4/p1-b/shots-17",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 17,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/asymmetric4/p2/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/reference/asymmetric4/p2/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p2/shots-512"
      ],
      "status": "difference",
      "summary": "reference: requested 512, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0751953125,
      "id": "returned-objective/reference/asymmetric4/p2/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.0751953125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0751953125,
      "id": "classical-weighting/reference/asymmetric4/p2/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.0751953125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.070008921354286,
      "id": "classical-weighting/reference/asymmetric4/p2/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 1.3322676295501878e-15,
      "observed": -2.070008921354287,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 1.33e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-integrity/target/asymmetric4/p2/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: completed shots 512 vs count sum 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/target/asymmetric4/p2/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: requested 512, completed 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.85546875,
      "id": "returned-objective/target/asymmetric4/p2/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.85546875,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.85546875,
      "id": "classical-weighting/target/asymmetric4/p2/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.85546875,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.8910395471016326,
      "id": "classical-weighting/target/asymmetric4/p2/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 3.774758283725532e-15,
      "observed": -1.8910395471016364,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 3.77e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-865aad3f650499f681f1f7a7954887a6b6ac2e52f4fe1d62e0542c28f08c17ad",
      "expected": "equivalent",
      "id": "circuit/asymmetric4/p2/shots-512",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "asymmetric4/p2/shots-512"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/asymmetric4/p2/shots-512",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "asymmetric4/p2/shots-512"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/asymmetric4/p2/shots-512",
      "kind": "probability",
      "metric": 0.04427611219527085,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p2/shots-512"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0443",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.070008921354286,
      "id": "exact-objective/asymmetric4/p2/shots-512",
      "kind": "exact-objective",
      "metric": 0.17896937425265325,
      "observed": -1.8910395471016326,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p2/shots-512"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.179)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/asymmetric4/p2/shots-512",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 512,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p2/shots-512"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/asymmetric4/p2/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/reference/asymmetric4/p2/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p2/shots-17"
      ],
      "status": "difference",
      "summary": "reference: requested 17, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0751953125,
      "id": "returned-objective/reference/asymmetric4/p2/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.0751953125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0751953125,
      "id": "classical-weighting/reference/asymmetric4/p2/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.0751953125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.070008921354286,
      "id": "classical-weighting/reference/asymmetric4/p2/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 1.3322676295501878e-15,
      "observed": -2.070008921354287,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "asymmetric4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 1.33e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-integrity/target/asymmetric4/p2/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: completed shots 17 vs count sum 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/target/asymmetric4/p2/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: requested 17, completed 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.1176470588235294,
      "id": "returned-objective/target/asymmetric4/p2/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.1176470588235294,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.1176470588235294,
      "id": "classical-weighting/target/asymmetric4/p2/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.1176470588235294,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.8910395471016326,
      "id": "classical-weighting/target/asymmetric4/p2/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 3.774758283725532e-15,
      "observed": -1.8910395471016364,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "asymmetric4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 3.77e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-865aad3f650499f681f1f7a7954887a6b6ac2e52f4fe1d62e0542c28f08c17ad",
      "expected": "equivalent",
      "id": "circuit/asymmetric4/p2/shots-17",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "asymmetric4/p2/shots-17"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "id": "measurement/asymmetric4/p2/shots-17",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "asymmetric4/p2/shots-17"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/asymmetric4/p2/shots-17",
      "kind": "probability",
      "metric": 0.04427611219527085,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p2/shots-17"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0443",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.070008921354286,
      "id": "exact-objective/asymmetric4/p2/shots-17",
      "kind": "exact-objective",
      "metric": 0.17896937425265325,
      "observed": -1.8910395471016326,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p2/shots-17"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.179)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/asymmetric4/p2/shots-17",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 17,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "asymmetric4/p2/shots-17"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/cycle5/p1-a/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/reference/cycle5/p1-a/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "reference: requested 512, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0234375,
      "id": "returned-objective/reference/cycle5/p1-a/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.0234375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0234375,
      "id": "classical-weighting/reference/cycle5/p1-a/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.0234375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.042293187383891,
      "id": "classical-weighting/reference/cycle5/p1-a/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 1.7763568394002505e-15,
      "observed": -2.0422931873838928,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 1.78e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-integrity/target/cycle5/p1-a/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: completed shots 512 vs count sum 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/target/cycle5/p1-a/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: requested 512, completed 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.234375,
      "id": "returned-objective/target/cycle5/p1-a/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.234375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.234375,
      "id": "classical-weighting/target/cycle5/p1-a/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.234375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.257250306282174,
      "id": "classical-weighting/target/cycle5/p1-a/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 2.6645352591003757e-15,
      "observed": -2.2572503062821765,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 2.66e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-4e2427aae66badc43f9da130d448ba293554b1ff22345a6796694589844c1030",
      "expected": "equivalent",
      "id": "circuit/cycle5/p1-a/shots-512",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "cycle5/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "id": "measurement/cycle5/p1-a/shots-512",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "cycle5/p1-a/shots-512"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/cycle5/p1-a/shots-512",
      "kind": "probability",
      "metric": 0.02990440650993905,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0299",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.042293187383891,
      "id": "exact-objective/cycle5/p1-a/shots-512",
      "kind": "exact-objective",
      "metric": 0.21495711889828284,
      "observed": -2.257250306282174,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.215)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/cycle5/p1-a/shots-512",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 512,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-a/shots-512"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/cycle5/p1-a/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/reference/cycle5/p1-a/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "reference: requested 17, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0234375,
      "id": "returned-objective/reference/cycle5/p1-a/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.0234375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.0234375,
      "id": "classical-weighting/reference/cycle5/p1-a/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.0234375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.042293187383891,
      "id": "classical-weighting/reference/cycle5/p1-a/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 1.7763568394002505e-15,
      "observed": -2.0422931873838928,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 1.78e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-integrity/target/cycle5/p1-a/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: completed shots 17 vs count sum 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/target/cycle5/p1-a/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: requested 17, completed 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.1176470588235294,
      "id": "returned-objective/target/cycle5/p1-a/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.1176470588235294,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.1176470588235294,
      "id": "classical-weighting/target/cycle5/p1-a/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.1176470588235294,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.257250306282174,
      "id": "classical-weighting/target/cycle5/p1-a/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 2.6645352591003757e-15,
      "observed": -2.2572503062821765,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 2.66e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-4e2427aae66badc43f9da130d448ba293554b1ff22345a6796694589844c1030",
      "expected": "equivalent",
      "id": "circuit/cycle5/p1-a/shots-17",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "cycle5/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "id": "measurement/cycle5/p1-a/shots-17",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "cycle5/p1-a/shots-17"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/cycle5/p1-a/shots-17",
      "kind": "probability",
      "metric": 0.02990440650993905,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0299",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.042293187383891,
      "id": "exact-objective/cycle5/p1-a/shots-17",
      "kind": "exact-objective",
      "metric": 0.21495711889828284,
      "observed": -2.257250306282174,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.215)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/cycle5/p1-a/shots-17",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 17,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-a/shots-17"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/cycle5/p1-b/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/reference/cycle5/p1-b/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "reference: requested 512, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.62109375,
      "id": "returned-objective/reference/cycle5/p1-b/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.62109375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.62109375,
      "id": "classical-weighting/reference/cycle5/p1-b/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.62109375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.61259327022246,
      "id": "classical-weighting/reference/cycle5/p1-b/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 2.220446049250313e-15,
      "observed": -2.612593270222462,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 2.22e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-integrity/target/cycle5/p1-b/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: completed shots 512 vs count sum 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/target/cycle5/p1-b/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: requested 512, completed 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.33203125,
      "id": "returned-objective/target/cycle5/p1-b/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.33203125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.33203125,
      "id": "classical-weighting/target/cycle5/p1-b/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.33203125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.3553830727210836,
      "id": "classical-weighting/target/cycle5/p1-b/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 1.3322676295501878e-15,
      "observed": -1.355383072721085,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 1.33e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-9c01a550993142303f71617bf8973957cb18fd10e03268378c1ca0ac2f127d77",
      "expected": "equivalent",
      "id": "circuit/cycle5/p1-b/shots-512",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "cycle5/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "id": "measurement/cycle5/p1-b/shots-512",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "cycle5/p1-b/shots-512"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/cycle5/p1-b/shots-512",
      "kind": "probability",
      "metric": 0.11234282548930066,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.112",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.61259327022246,
      "id": "exact-objective/cycle5/p1-b/shots-512",
      "kind": "exact-objective",
      "metric": 1.2572101975013763,
      "observed": -1.3553830727210836,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 1.26)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/cycle5/p1-b/shots-512",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 512,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-b/shots-512"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/cycle5/p1-b/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/reference/cycle5/p1-b/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "reference: requested 17, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.62109375,
      "id": "returned-objective/reference/cycle5/p1-b/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -2.62109375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.62109375,
      "id": "classical-weighting/reference/cycle5/p1-b/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -2.62109375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.61259327022246,
      "id": "classical-weighting/reference/cycle5/p1-b/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 2.220446049250313e-15,
      "observed": -2.612593270222462,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 2.22e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-integrity/target/cycle5/p1-b/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: completed shots 17 vs count sum 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/target/cycle5/p1-b/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: requested 17, completed 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.0588235294117647,
      "id": "returned-objective/target/cycle5/p1-b/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -1.0588235294117647,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.0588235294117647,
      "id": "classical-weighting/target/cycle5/p1-b/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -1.0588235294117647,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -1.3553830727210836,
      "id": "classical-weighting/target/cycle5/p1-b/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 1.3322676295501878e-15,
      "observed": -1.355383072721085,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 1.33e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-9c01a550993142303f71617bf8973957cb18fd10e03268378c1ca0ac2f127d77",
      "expected": "equivalent",
      "id": "circuit/cycle5/p1-b/shots-17",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "cycle5/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "id": "measurement/cycle5/p1-b/shots-17",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "cycle5/p1-b/shots-17"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/cycle5/p1-b/shots-17",
      "kind": "probability",
      "metric": 0.11234282548930066,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.112",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -2.61259327022246,
      "id": "exact-objective/cycle5/p1-b/shots-17",
      "kind": "exact-objective",
      "metric": 1.2572101975013763,
      "observed": -1.3553830727210836,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 1.26)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/cycle5/p1-b/shots-17",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 17,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p1-b/shots-17"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/cycle5/p2/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/reference/cycle5/p2/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p2/shots-512"
      ],
      "status": "difference",
      "summary": "reference: requested 512, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.05078125,
      "id": "returned-objective/reference/cycle5/p2/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -3.05078125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.05078125,
      "id": "classical-weighting/reference/cycle5/p2/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -3.05078125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.0281950739059216,
      "id": "classical-weighting/reference/cycle5/p2/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 3.1086244689504383e-15,
      "observed": -3.0281950739059247,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p2/shots-512"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 3.11e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-integrity/target/cycle5/p2/shots-512",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: completed shots 512 vs count sum 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 512,
      "id": "shots-request/target/cycle5/p2/shots-512",
      "kind": "shots-request",
      "metric": null,
      "observed": 512,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: requested 512, completed 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.234375,
      "id": "returned-objective/target/cycle5/p2/shots-512",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -3.234375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.234375,
      "id": "classical-weighting/target/cycle5/p2/shots-512/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -3.234375,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.1941012125815607,
      "id": "classical-weighting/target/cycle5/p2/shots-512/exact",
      "kind": "classical-weighting",
      "metric": 6.661338147750939e-15,
      "observed": -3.1941012125815673,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p2/shots-512"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 6.66e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-788900cc52cbfea75a764015d452429210e77239dac86f3332811dc97703ac09",
      "expected": "equivalent",
      "id": "circuit/cycle5/p2/shots-512",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "cycle5/p2/shots-512"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "id": "measurement/cycle5/p2/shots-512",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "cycle5/p2/shots-512"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/cycle5/p2/shots-512",
      "kind": "probability",
      "metric": 0.02758285724841416,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p2/shots-512"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0276",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.0281950739059216,
      "id": "exact-objective/cycle5/p2/shots-512",
      "kind": "exact-objective",
      "metric": 0.16590613867563908,
      "observed": -3.1941012125815607,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p2/shots-512"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.166)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/cycle5/p2/shots-512",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 512,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p2/shots-512"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 512",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-integrity/reference/cycle5/p2/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 1024,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: completed shots 1024 vs count sum 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/reference/cycle5/p2/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 1024,
      "reason_code": "shots_request_mismatch",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p2/shots-17"
      ],
      "status": "difference",
      "summary": "reference: requested 17, completed 1024",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.05078125,
      "id": "returned-objective/reference/cycle5/p2/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -3.05078125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.05078125,
      "id": "classical-weighting/reference/cycle5/p2/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -3.05078125,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.0281950739059216,
      "id": "classical-weighting/reference/cycle5/p2/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 3.1086244689504383e-15,
      "observed": -3.0281950739059247,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "reference",
        "cycle5/p2/shots-17"
      ],
      "status": "pass",
      "summary": "reference: module weighting of exact probabilities: agree (|\u0394| = 3.11e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-integrity/target/cycle5/p2/shots-17",
      "kind": "shots-integrity",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: completed shots 17 vs count sum 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 17,
      "id": "shots-request/target/cycle5/p2/shots-17",
      "kind": "shots-request",
      "metric": null,
      "observed": 17,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: requested 17, completed 17",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.176470588235294,
      "id": "returned-objective/target/cycle5/p2/shots-17",
      "kind": "returned-objective",
      "metric": 0.0,
      "observed": -3.176470588235294,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: returned objective vs independent decoding of its own counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.176470588235294,
      "id": "classical-weighting/target/cycle5/p2/shots-17/counts",
      "kind": "classical-weighting",
      "metric": 0.0,
      "observed": -3.176470588235294,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of captured counts: agree (|\u0394| = 0)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.1941012125815607,
      "id": "classical-weighting/target/cycle5/p2/shots-17/exact",
      "kind": "classical-weighting",
      "metric": 6.661338147750939e-15,
      "observed": -3.1941012125815673,
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "target",
        "cycle5/p2/shots-17"
      ],
      "status": "pass",
      "summary": "target: module weighting of exact probabilities: agree (|\u0394| = 6.66e-15)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": "circuit-result-788900cc52cbfea75a764015d452429210e77239dac86f3332811dc97703ac09",
      "expected": "equivalent",
      "id": "circuit/cycle5/p2/shots-17",
      "kind": "circuit",
      "metric": null,
      "observed": "not_equivalent",
      "reason_code": "circuit_not_equivalent",
      "required": true,
      "scope_ids": [
        "cycle5/p2/shots-17"
      ],
      "status": "difference",
      "summary": "submitted circuits: not_equivalent",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "id": "measurement/cycle5/p2/shots-17",
      "kind": "measurement",
      "metric": null,
      "observed": [
        [
          0,
          0
        ],
        [
          1,
          1
        ],
        [
          2,
          2
        ],
        [
          3,
          3
        ],
        [
          4,
          4
        ]
      ],
      "reason_code": "equal",
      "required": true,
      "scope_ids": [
        "cycle5/p2/shots-17"
      ],
      "status": "pass",
      "summary": "both sides: terminal identity measurement, one classical register of width n",
      "tolerance": null
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": null,
      "id": "probability/cycle5/p2/shots-17",
      "kind": "probability",
      "metric": 0.02758285724841416,
      "observed": null,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p2/shots-17"
      ],
      "status": "difference",
      "summary": "ideal output distributions: max |\u0394p| = 0.0276",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": -3.0281950739059216,
      "id": "exact-objective/cycle5/p2/shots-17",
      "kind": "exact-objective",
      "metric": 0.16590613867563908,
      "observed": -3.1941012125815607,
      "reason_code": "numeric_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p2/shots-17"
      ],
      "status": "difference",
      "summary": "independent exact objective, reference vs target: differ (|\u0394| = 0.166)",
      "tolerance": 1e-10
    },
    {
      "artifact_refs": [],
      "circuit_result_id": null,
      "expected": 1024,
      "id": "shots-preservation/cycle5/p2/shots-17",
      "kind": "shots-preservation",
      "metric": null,
      "observed": 17,
      "reason_code": "shots_preservation_mismatch",
      "required": true,
      "scope_ids": [
        "cycle5/p2/shots-17"
      ],
      "status": "difference",
      "summary": "completed shots: reference 1024, target 17",
      "tolerance": null
    }
  ],
  "circuit_results": [
    {
      "checker_config_sha256": "0d27336eaff61752cc2bd2435fb14d61789562404427f1f3f3c9245e7d30cec8",
      "criterion": "not_equivalent",
      "execution_ids": [
        "textbook_cycle4/p1-a/shots-512",
        "textbook_cycle4/p1-a/shots-17"
      ],
      "id": "circuit-result-8700bcf5cababb823f46d4ffd9d8362ebabb8f7acf92f57260fd55edc7804d56",
      "reason_code": "circuit_not_equivalent",
      "reference_qasm_sha256": "05ffb5237902e17adf6b79feeb3504de74436ac95b53393ae8f4fa807f508d19",
      "status": "difference",
      "target_qasm_sha256": "51900b6a4e63b5f6c76aaba34b0ef50f1e3515c98042f819638ca49c02a1f7b8"
    },
    {
      "checker_config_sha256": "0d27336eaff61752cc2bd2435fb14d61789562404427f1f3f3c9245e7d30cec8",
      "criterion": "not_equivalent",
      "execution_ids": [
        "textbook_cycle4/p1-b/shots-512",
        "textbook_cycle4/p1-b/shots-17"
      ],
      "id": "circuit-result-a58e12b903d29c7fbc4f249484197613629e6f7a036dc32953e2091060ca766c",
      "reason_code": "circuit_not_equivalent",
      "reference_qasm_sha256": "4fef82407e0a074cc6bf8a42e007c5c0d9aa398397349beabaeb63647fcbf1df",
      "status": "difference",
      "target_qasm_sha256": "044f322be9b9da4628ba71183a4692d6c50821b962fd7754a4d0ae1d9bf94d1f"
    },
    {
      "checker_config_sha256": "0d27336eaff61752cc2bd2435fb14d61789562404427f1f3f3c9245e7d30cec8",
      "criterion": "not_equivalent",
      "execution_ids": [
        "textbook_cycle4/p2/shots-512",
        "textbook_cycle4/p2/shots-17"
      ],
      "id": "circuit-result-331b768b6f7e1fbd9141d6e27c579b3276a8cd4bad68fc1cd7b1d749f50f10d4",
      "reason_code": "circuit_not_equivalent",
      "reference_qasm_sha256": "61736110b245f364d34ca22086175643ff9cf36007fa5ad6103244426d9e4992",
      "status": "difference",
      "target_qasm_sha256": "c209abc21e712519308067385434006b75edae1845fe14496e7817ce54fa1044"
    },
    {
      "checker_config_sha256": "0d27336eaff61752cc2bd2435fb14d61789562404427f1f3f3c9245e7d30cec8",
      "criterion": "not_equivalent",
      "execution_ids": [
        "asymmetric4/p1-a/shots-512",
        "asymmetric4/p1-a/shots-17"
      ],
      "id": "circuit-result-3c6a4df9ad50ebfa3d028c73a0ce4aa97bd80e3443798c78580ad996c4ba1113",
      "reason_code": "circuit_not_equivalent",
      "reference_qasm_sha256": "8639d034fc5a3efc6c081ccf95347277db42bba5bc1940620c1ca097074680f9",
      "status": "difference",
      "target_qasm_sha256": "149a393284c8540e62e85a9c5c0cdc0daa5231b72685b0ee32666cf7c79469c2"
    },
    {
      "checker_config_sha256": "0d27336eaff61752cc2bd2435fb14d61789562404427f1f3f3c9245e7d30cec8",
      "criterion": "not_equivalent",
      "execution_ids": [
        "asymmetric4/p1-b/shots-512",
        "asymmetric4/p1-b/shots-17"
      ],
      "id": "circuit-result-d64c5d8c2f56f0a22406bfb45772c02b063d6f8f5c807ea75eef012b54995dbb",
      "reason_code": "circuit_not_equivalent",
      "reference_qasm_sha256": "fc787d670aac63e65bcd84c5e843becec9e158f81d8ace6858a36e416ebd06f6",
      "status": "difference",
      "target_qasm_sha256": "c9bc20b8a3f0359f8616f3db5243cd65e4728d3e8465a58d4a573a5a9e0d0e62"
    },
    {
      "checker_config_sha256": "0d27336eaff61752cc2bd2435fb14d61789562404427f1f3f3c9245e7d30cec8",
      "criterion": "not_equivalent",
      "execution_ids": [
        "asymmetric4/p2/shots-512",
        "asymmetric4/p2/shots-17"
      ],
      "id": "circuit-result-865aad3f650499f681f1f7a7954887a6b6ac2e52f4fe1d62e0542c28f08c17ad",
      "reason_code": "circuit_not_equivalent",
      "reference_qasm_sha256": "fb7a2dbffad5255626be301e5799cec8ebe58904a9784aad2c64286099b93fe8",
      "status": "difference",
      "target_qasm_sha256": "cef8dd9eda7b72333775d1b0556260a1bc13242b0c07690d0b2ee8847474581b"
    },
    {
      "checker_config_sha256": "0d27336eaff61752cc2bd2435fb14d61789562404427f1f3f3c9245e7d30cec8",
      "criterion": "not_equivalent",
      "execution_ids": [
        "cycle5/p1-a/shots-512",
        "cycle5/p1-a/shots-17"
      ],
      "id": "circuit-result-4e2427aae66badc43f9da130d448ba293554b1ff22345a6796694589844c1030",
      "reason_code": "circuit_not_equivalent",
      "reference_qasm_sha256": "276f3cc18c91d888ef3686903b7189c8a18439eaa168d484c3e5412d0d0e0028",
      "status": "difference",
      "target_qasm_sha256": "3c68239578de5cf6a1cfe5dda0fb65a2c4af86dcd9b5de90668a5d6eb637fe94"
    },
    {
      "checker_config_sha256": "0d27336eaff61752cc2bd2435fb14d61789562404427f1f3f3c9245e7d30cec8",
      "criterion": "not_equivalent",
      "execution_ids": [
        "cycle5/p1-b/shots-512",
        "cycle5/p1-b/shots-17"
      ],
      "id": "circuit-result-9c01a550993142303f71617bf8973957cb18fd10e03268378c1ca0ac2f127d77",
      "reason_code": "circuit_not_equivalent",
      "reference_qasm_sha256": "8bde8e9b7e2495820f71b77c10fb2eca58505a134b2926ec6889c1a00f5050f1",
      "status": "difference",
      "target_qasm_sha256": "53b610ee88fa8fda2fc193a1761b179df87e1ffa27b67edf85a76baf46d65966"
    },
    {
      "checker_config_sha256": "0d27336eaff61752cc2bd2435fb14d61789562404427f1f3f3c9245e7d30cec8",
      "criterion": "not_equivalent",
      "execution_ids": [
        "cycle5/p2/shots-512",
        "cycle5/p2/shots-17"
      ],
      "id": "circuit-result-788900cc52cbfea75a764015d452429210e77239dac86f3332811dc97703ac09",
      "reason_code": "circuit_not_equivalent",
      "reference_qasm_sha256": "ebb60263036fafde6135b239628eef14d7e7a250189d10e17ff658a2eb5dd49f",
      "status": "difference",
      "target_qasm_sha256": "d102fc8780b1b2d6c2e3edaedb524f718a5a288f2ff0582d5db3ef3e6ad36d65"
    }
  ],
  "coverage": {
    "angle_settings": 3,
    "completed_pairs": 18,
    "expected_executions": [
      "textbook_cycle4/p1-a/shots-512",
      "textbook_cycle4/p1-a/shots-17",
      "textbook_cycle4/p1-b/shots-512",
      "textbook_cycle4/p1-b/shots-17",
      "textbook_cycle4/p2/shots-512",
      "textbook_cycle4/p2/shots-17",
      "asymmetric4/p1-a/shots-512",
      "asymmetric4/p1-a/shots-17",
      "asymmetric4/p1-b/shots-512",
      "asymmetric4/p1-b/shots-17",
      "asymmetric4/p2/shots-512",
      "asymmetric4/p2/shots-17",
      "cycle5/p1-a/shots-512",
      "cycle5/p1-a/shots-17",
      "cycle5/p1-b/shots-512",
      "cycle5/p1-b/shots-17",
      "cycle5/p2/shots-512",
      "cycle5/p2/shots-17"
    ],
    "graphs": 3,
    "missing": {
      "reference": [],
      "target": []
    },
    "not_checked": [
      "optimizer convergence",
      "hardware execution",
      "noise models",
      "dynamic circuits",
      "inputs outside the declared graphs and angles",
      "whole-program equivalence"
    ],
    "observed": {
      "reference": [
        "asymmetric4/p1-a/shots-17",
        "asymmetric4/p1-a/shots-512",
        "asymmetric4/p1-b/shots-17",
        "asymmetric4/p1-b/shots-512",
        "asymmetric4/p2/shots-17",
        "asymmetric4/p2/shots-512",
        "cycle5/p1-a/shots-17",
        "cycle5/p1-a/shots-512",
        "cycle5/p1-b/shots-17",
        "cycle5/p1-b/shots-512",
        "cycle5/p2/shots-17",
        "cycle5/p2/shots-512",
        "textbook_cycle4/p1-a/shots-17",
        "textbook_cycle4/p1-a/shots-512",
        "textbook_cycle4/p1-b/shots-17",
        "textbook_cycle4/p1-b/shots-512",
        "textbook_cycle4/p2/shots-17",
        "textbook_cycle4/p2/shots-512"
      ],
      "target": [
        "asymmetric4/p1-a/shots-17",
        "asymmetric4/p1-a/shots-512",
        "asymmetric4/p1-b/shots-17",
        "asymmetric4/p1-b/shots-512",
        "asymmetric4/p2/shots-17",
        "asymmetric4/p2/shots-512",
        "cycle5/p1-a/shots-17",
        "cycle5/p1-a/shots-512",
        "cycle5/p1-b/shots-17",
        "cycle5/p1-b/shots-512",
        "cycle5/p2/shots-17",
        "cycle5/p2/shots-512",
        "textbook_cycle4/p1-a/shots-17",
        "textbook_cycle4/p1-a/shots-512",
        "textbook_cycle4/p1-b/shots-17",
        "textbook_cycle4/p1-b/shots-512",
        "textbook_cycle4/p2/shots-17",
        "textbook_cycle4/p2/shots-512"
      ]
    },
    "shot_requests": [
      512,
      17
    ]
  },
  "evidence_summary": "difference",
  "findings": [
    {
      "check_ids": [
        "circuit/textbook_cycle4/p1-a/shots-512",
        "circuit/textbook_cycle4/p1-a/shots-17",
        "circuit/textbook_cycle4/p1-b/shots-512",
        "circuit/textbook_cycle4/p1-b/shots-17",
        "circuit/textbook_cycle4/p2/shots-512",
        "circuit/textbook_cycle4/p2/shots-17",
        "circuit/asymmetric4/p1-a/shots-512",
        "circuit/asymmetric4/p1-a/shots-17",
        "circuit/asymmetric4/p1-b/shots-512",
        "circuit/asymmetric4/p1-b/shots-17",
        "circuit/asymmetric4/p2/shots-512",
        "circuit/asymmetric4/p2/shots-17",
        "circuit/cycle5/p1-a/shots-512",
        "circuit/cycle5/p1-a/shots-17",
        "circuit/cycle5/p1-b/shots-512",
        "circuit/cycle5/p1-b/shots-17",
        "circuit/cycle5/p2/shots-512",
        "circuit/cycle5/p2/shots-17"
      ],
      "explanation": "The checker reports the actually submitted circuits as not equivalent.",
      "id": "circuit",
      "kind": "circuit",
      "proposal_claim_refs": [],
      "scope_ids": [
        "asymmetric4/p1-a/shots-17",
        "asymmetric4/p1-a/shots-512",
        "asymmetric4/p1-b/shots-17",
        "asymmetric4/p1-b/shots-512",
        "asymmetric4/p2/shots-17",
        "asymmetric4/p2/shots-512",
        "cycle5/p1-a/shots-17",
        "cycle5/p1-a/shots-512",
        "cycle5/p1-b/shots-17",
        "cycle5/p1-b/shots-512",
        "cycle5/p2/shots-17",
        "cycle5/p2/shots-512",
        "textbook_cycle4/p1-a/shots-17",
        "textbook_cycle4/p1-a/shots-512",
        "textbook_cycle4/p1-b/shots-17",
        "textbook_cycle4/p1-b/shots-512",
        "textbook_cycle4/p2/shots-17",
        "textbook_cycle4/p2/shots-512"
      ],
      "title": "Submitted circuits differ"
    },
    {
      "check_ids": [
        "probability/textbook_cycle4/p1-a/shots-512",
        "probability/textbook_cycle4/p1-a/shots-17",
        "probability/textbook_cycle4/p1-b/shots-512",
        "probability/textbook_cycle4/p1-b/shots-17",
        "probability/textbook_cycle4/p2/shots-512",
        "probability/textbook_cycle4/p2/shots-17",
        "probability/asymmetric4/p1-a/shots-512",
        "probability/asymmetric4/p1-a/shots-17",
        "probability/asymmetric4/p1-b/shots-512",
        "probability/asymmetric4/p1-b/shots-17",
        "probability/asymmetric4/p2/shots-512",
        "probability/asymmetric4/p2/shots-17",
        "probability/cycle5/p1-a/shots-512",
        "probability/cycle5/p1-a/shots-17",
        "probability/cycle5/p1-b/shots-512",
        "probability/cycle5/p1-b/shots-17",
        "probability/cycle5/p2/shots-512",
        "probability/cycle5/p2/shots-17"
      ],
      "explanation": "Exact output probabilities differ beyond tolerance.",
      "id": "probability",
      "kind": "probability",
      "proposal_claim_refs": [],
      "scope_ids": [
        "asymmetric4/p1-a/shots-17",
        "asymmetric4/p1-a/shots-512",
        "asymmetric4/p1-b/shots-17",
        "asymmetric4/p1-b/shots-512",
        "asymmetric4/p2/shots-17",
        "asymmetric4/p2/shots-512",
        "cycle5/p1-a/shots-17",
        "cycle5/p1-a/shots-512",
        "cycle5/p1-b/shots-17",
        "cycle5/p1-b/shots-512",
        "cycle5/p2/shots-17",
        "cycle5/p2/shots-512",
        "textbook_cycle4/p1-a/shots-17",
        "textbook_cycle4/p1-a/shots-512",
        "textbook_cycle4/p1-b/shots-17",
        "textbook_cycle4/p1-b/shots-512",
        "textbook_cycle4/p2/shots-17",
        "textbook_cycle4/p2/shots-512"
      ],
      "title": "Ideal output distribution differs"
    },
    {
      "check_ids": [
        "exact-objective/textbook_cycle4/p1-a/shots-512",
        "exact-objective/textbook_cycle4/p1-a/shots-17",
        "exact-objective/textbook_cycle4/p1-b/shots-512",
        "exact-objective/textbook_cycle4/p1-b/shots-17",
        "exact-objective/textbook_cycle4/p2/shots-512",
        "exact-objective/textbook_cycle4/p2/shots-17",
        "exact-objective/asymmetric4/p1-a/shots-512",
        "exact-objective/asymmetric4/p1-a/shots-17",
        "exact-objective/asymmetric4/p1-b/shots-512",
        "exact-objective/asymmetric4/p1-b/shots-17",
        "exact-objective/asymmetric4/p2/shots-512",
        "exact-objective/asymmetric4/p2/shots-17",
        "exact-objective/cycle5/p1-a/shots-512",
        "exact-objective/cycle5/p1-a/shots-17",
        "exact-objective/cycle5/p1-b/shots-512",
        "exact-objective/cycle5/p1-b/shots-17",
        "exact-objective/cycle5/p2/shots-512",
        "exact-objective/cycle5/p2/shots-17"
      ],
      "explanation": "Independently computed exact objectives differ beyond tolerance.",
      "id": "exact-objective",
      "kind": "exact-objective",
      "proposal_claim_refs": [],
      "scope_ids": [
        "asymmetric4/p1-a/shots-17",
        "asymmetric4/p1-a/shots-512",
        "asymmetric4/p1-b/shots-17",
        "asymmetric4/p1-b/shots-512",
        "asymmetric4/p2/shots-17",
        "asymmetric4/p2/shots-512",
        "cycle5/p1-a/shots-17",
        "cycle5/p1-a/shots-512",
        "cycle5/p1-b/shots-17",
        "cycle5/p1-b/shots-512",
        "cycle5/p2/shots-17",
        "cycle5/p2/shots-512",
        "textbook_cycle4/p1-a/shots-17",
        "textbook_cycle4/p1-a/shots-512",
        "textbook_cycle4/p1-b/shots-17",
        "textbook_cycle4/p1-b/shots-512",
        "textbook_cycle4/p2/shots-17",
        "textbook_cycle4/p2/shots-512"
      ],
      "title": "Exact objective differs"
    },
    {
      "check_ids": [
        "shots-request/reference/textbook_cycle4/p1-a/shots-512",
        "shots-preservation/textbook_cycle4/p1-a/shots-512",
        "shots-request/reference/textbook_cycle4/p1-a/shots-17",
        "shots-preservation/textbook_cycle4/p1-a/shots-17",
        "shots-request/reference/textbook_cycle4/p1-b/shots-512",
        "shots-preservation/textbook_cycle4/p1-b/shots-512",
        "shots-request/reference/textbook_cycle4/p1-b/shots-17",
        "shots-preservation/textbook_cycle4/p1-b/shots-17",
        "shots-request/reference/textbook_cycle4/p2/shots-512",
        "shots-preservation/textbook_cycle4/p2/shots-512",
        "shots-request/reference/textbook_cycle4/p2/shots-17",
        "shots-preservation/textbook_cycle4/p2/shots-17",
        "shots-request/reference/asymmetric4/p1-a/shots-512",
        "shots-preservation/asymmetric4/p1-a/shots-512",
        "shots-request/reference/asymmetric4/p1-a/shots-17",
        "shots-preservation/asymmetric4/p1-a/shots-17",
        "shots-request/reference/asymmetric4/p1-b/shots-512",
        "shots-preservation/asymmetric4/p1-b/shots-512",
        "shots-request/reference/asymmetric4/p1-b/shots-17",
        "shots-preservation/asymmetric4/p1-b/shots-17",
        "shots-request/reference/asymmetric4/p2/shots-512",
        "shots-preservation/asymmetric4/p2/shots-512",
        "shots-request/reference/asymmetric4/p2/shots-17",
        "shots-preservation/asymmetric4/p2/shots-17",
        "shots-request/reference/cycle5/p1-a/shots-512",
        "shots-preservation/cycle5/p1-a/shots-512",
        "shots-request/reference/cycle5/p1-a/shots-17",
        "shots-preservation/cycle5/p1-a/shots-17",
        "shots-request/reference/cycle5/p1-b/shots-512",
        "shots-preservation/cycle5/p1-b/shots-512",
        "shots-request/reference/cycle5/p1-b/shots-17",
        "shots-preservation/cycle5/p1-b/shots-17",
        "shots-request/reference/cycle5/p2/shots-512",
        "shots-preservation/cycle5/p2/shots-512",
        "shots-request/reference/cycle5/p2/shots-17",
        "shots-preservation/cycle5/p2/shots-17"
      ],
      "explanation": "The reference and target complete different numbers of shots for the same request. This changes sampling uncertainty even when circuits are equivalent.",
      "id": "shot_policy",
      "kind": "shot_policy",
      "proposal_claim_refs": [],
      "scope_ids": [
        "asymmetric4/p1-a/shots-17",
        "asymmetric4/p1-a/shots-512",
        "asymmetric4/p1-b/shots-17",
        "asymmetric4/p1-b/shots-512",
        "asymmetric4/p2/shots-17",
        "asymmetric4/p2/shots-512",
        "cycle5/p1-a/shots-17",
        "cycle5/p1-a/shots-512",
        "cycle5/p1-b/shots-17",
        "cycle5/p1-b/shots-512",
        "cycle5/p2/shots-17",
        "cycle5/p2/shots-512",
        "textbook_cycle4/p1-a/shots-17",
        "textbook_cycle4/p1-a/shots-512",
        "textbook_cycle4/p1-b/shots-17",
        "textbook_cycle4/p1-b/shots-512",
        "textbook_cycle4/p2/shots-17",
        "textbook_cycle4/p2/shots-512"
      ],
      "title": "Shot setting changed"
    }
  ],
  "limitations": [
    "Checks cover only the declared graphs, angles and shot requests.",
    "Numerical agreement uses floating-point arithmetic with absolute tolerance 1e-10.",
    "No optimizer convergence, hardware, noise, dynamic-circuit or whole-program claim.",
    "The reference is a preservation baseline, not scientific truth.",
    "Candidate code ran locally as trusted, inspected code; virtual environments isolate versions, not hostile code.",
    "Hashes show internal consistency; they are not a signature or an independent attestation."
  ],
  "provenance": {
    "checker_config": {
      "checker_version": "3.11.0",
      "effective_defaults": null,
      "entrypoint": "mqt.qcec.verify",
      "global_phase_policy": "global phase ignored; relative phase is a difference",
      "importer_policy": "qiskit.qasm2.loads with LEGACY_CUSTOM_INSTRUCTIONS",
      "kwargs": {},
      "qiskit_version": "2.6.1",
      "unknown_reasons": [
        "effective_defaults: the pinned default call does not export its configuration"
      ]
    },
    "checker_worker_sha256": "fb0596f14b681d0e15c4dc8cfca742b0d7900349b8e441169cfbd065e69ec605",
    "comparison_sha256": "22d9f25fd9d4fa479c40a4c9c15eb47679c52f6aa8c3d5eff46e92d591052e60",
    "finished_at": "2026-10-26T02:19:40.011622Z",
    "observer_sha256": "f58c147ce935ed4348f9a9175795969e595c4e41f539667d527523d13b8b243b",
    "proposal": null,
    "reference_environment": {
      "architecture": "arm64",
      "distributions": [
        {
          "name": "dill",
          "version": "0.4.1"
        },
        {
          "name": "mpmath",
          "version": "1.3.0"
        },
        {
          "name": "networkx",
          "version": "2.8.8"
        },
        {
          "name": "numpy",
          "version": "1.26.4"
        },
        {
          "name": "ply",
          "version": "3.11"
        },
        {
          "name": "psutil",
          "version": "7.2.2"
        },
        {
          "name": "python-dateutil",
          "version": "3.0.0"
        },
        {
          "name": "qiskit",
          "version": "0.46.3"
        },
        {
          "name": "qiskit-aer",
          "version": "0.14.2"
        },
        {
          "name": "qiskit-terra",
          "version": "0.46.3"
        },
        {
          "name": "rustworkx",
          "version": "0.18.1"
        },
        {
          "name": "scipy",
          "version": "1.17.1"
        },
        {
          "name": "six",
          "version": "1.17.0"
        },
        {
          "name": "stevedore",
          "version": "5.9.1"
        },
        {
          "name": "symengine",
          "version": "0.14.1"
        },
        {
          "name": "sympy",
          "version": "1.14.0"
        },
        {
          "name": "tzdata",
          "version": "2026.5"
        }
      ],
      "os": "Darwin",
      "python_version": "3.11.12"
    },
    "reference_pins_sha256": "520e22a9098309d71a06fdac615b81befa491b44dd5c3deaf5f0257671546733",
    "reference_sha256": "d4a99e4ae5ccb086181f1e0e20f686ccb0b52b32697d6ca4778632f9380c9e30",
    "side_failures": {
      "reference": null,
      "target": null
    },
    "source_receipts": {
      "reference": {
        "attribution": "Qiskit textbook contributors",
        "derived_from_sha256": null,
        "extraction_scope": "Helper cell (maxcut_obj, compute_expectation, create_qaoa_circ, get_expectation) with its required imports added; not the whole notebook.",
        "kind": "upstream_extract",
        "license_artifact": "artifacts/inputs/reference-LICENSE.txt",
        "license_file": "../evidence/qaoa/LICENSE.txt",
        "license_sha256": "902d75776b0e95451cfffcea5eb12653b9de1f72ba91476bafdd393ac007e478",
        "license_spdx": "Apache-2.0",
        "module_sha256": "d4a99e4ae5ccb086181f1e0e20f686ccb0b52b32697d6ca4778632f9380c9e30",
        "upstream_path": "content/ch-applications/qaoa.ipynb",
        "upstream_revision": "0ae905083ec3872d7ddc6bb4001d5468f476d93f",
        "upstream_url": "https://github.com/qiskit-community/qiskit-textbook/blob/0ae905083ec3872d7ddc6bb4001d5468f476d93f/content/ch-applications/qaoa.ipynb"
      },
      "target": {
        "attribution": "Qiskit textbook contributors (derived work); seeded edit by the QRef author",
        "derived_from_sha256": null,
        "extraction_scope": "Research port with one deliberate edit: rx(2*beta) became rx(beta).",
        "kind": "local_code",
        "license_artifact": "artifacts/inputs/target-LICENSE.txt",
        "license_file": "../evidence/qaoa/LICENSE.txt",
        "license_sha256": "902d75776b0e95451cfffcea5eb12653b9de1f72ba91476bafdd393ac007e478",
        "license_spdx": "Apache-2.0",
        "module_sha256": "8eb5c9a7a6ee67a3eecbd4001980019787f4fed53acb9cdcd8151b46ee30b63e",
        "upstream_path": null,
        "upstream_revision": null,
        "upstream_url": null
      }
    },
    "started_at": "2026-10-26T02:19:35.963712Z",
    "target_environment": {
      "architecture": "arm64",
      "distributions": [
        {
          "name": "dill",
          "version": "0.4.1"
        },
        {
          "name": "mqt-core",
          "version": "3.11.0"
        },
        {
          "name": "mqt-qcec",
          "version": "3.11.0"
        },
        {
          "name": "nanobind-backend",
          "version": "1.0.0"
        },
        {
          "name": "networkx",
          "version": "2.8.8"
        },
        {
          "name": "numpy",
          "version": "2.4.6"
        },
        {
          "name": "psutil",
          "version": "7.2.2"
        },
        {
          "name": "python-dateutil",
          "version": "3.0.0"
        },
        {
          "name": "qiskit",
          "version": "2.6.1"
        },
        {
          "name": "qiskit-aer",
          "version": "0.18.0"
        },
        {
          "name": "rustworkx",
          "version": "0.18.1"
        },
        {
          "name": "scipy",
          "version": "1.17.1"
        },
        {
          "name": "six",
          "version": "1.17.0"
        },
        {
          "name": "stevedore",
          "version": "5.9.1"
        },
        {
          "name": "typing-extensions",
          "version": "4.16.0"
        },
        {
          "name": "tzdata",
          "version": "2026.5"
        }
      ],
      "os": "Darwin",
      "python_version": "3.11.12"
    },
    "target_pins_sha256": "c33387f0724cf518098c8966863e9df03bf32ad73cdfc8693f41836ca401be16",
    "target_sha256": "8eb5c9a7a6ee67a3eecbd4001980019787f4fed53acb9cdcd8151b46ee30b63e",
    "tool_version": "0.1.0",
    "trusted_local_code": true,
    "unknown_reasons": []
  },
  "run_state": "complete",
  "schema": "qref.evidence/v1",
  "status_counts": {
    "difference": 90,
    "error": 0,
    "inconclusive": 0,
    "pass": 187,
    "unsupported": 0
  }
}