<p>Quantum error correction (QEC) is the primary strategy for protecting a quantum computer from the environment<sup><CitationRef CitationID="CR1">1</CitationRef>,<CitationRef CitationID="CR2">2</CitationRef></sup>. The prerequisite of QEC is that errors must remain sufficiently rare, which requires perpetually adapting the control parameters of the computer to the drifting environmental conditions. The current solution to this problem is to terminate the entire quantum computation for recalibration, but it is incompatible with the long runtimes of future quantum algorithms<sup><CitationRef CitationID="CR3">3</CitationRef>,<CitationRef CitationID="CR4">4</CitationRef></sup>. Here we address this challenge by unifying calibration with computation. We grant the QEC process<sup><CitationRef AdditionalCitationIDS="CR6 CR7 CR8 CR9 CR10" CitationID="CR5">5</CitationRef>–<CitationRef CitationID="CR11">11</CitationRef></sup> a dual role: its error-detection events are not only used to correct the logical quantum state but are&#xa0;also repurposed as a learning signal, teaching a reinforcement learning agent<sup><CitationRef AdditionalCitationIDS="CR13 CR14 CR15" CitationID="CR12">12</CitationRef>–<CitationRef CitationID="CR16">16</CitationRef></sup> to continuously steer the control parameters and stabilize the quantum system during computation. We experimentally demonstrate this framework on a Willow superconducting processor, improving the logical stability of the surface code 3.5-fold against injected drift. By synthesizing our full suite of technological advances, we achieve record performance of the surface and colour codes, with average logical error per cycle of 7.72(9)&#xa0;×&#xa0;10<sup>−4</sup> and 8.19(14)&#xa0;×&#xa0;10<sup>−3</sup>, respectively. Numerical simulations of large codes with tens of thousands of control parameters confirm the scalability of our RL framework, revealing an optimization speed that is independent of system size. This work thus enables a new paradigm: a quantum computer that learns from its errors and never stops computing.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Reinforcement learning control of quantum error correction

  • Volodymyr Sivak,
  • Alexis Morvan,
  • Michael Broughton,
  • Rodrigo G. Cortiñas,
  • Johannes Bausch,
  • Andrew W. Senior,
  • Matthew Neeley,
  • Alec Eickbusch,
  • Noah Shutty,
  • Laleh Aghababaie Beni,
  • James S. Spencer,
  • Francisco J. Heras,
  • Thomas Edlich,
  • Dmitry Abanin,
  • Amira Abbas,
  • Rajeev Acharya,
  • Georg Aigeldinger,
  • Ross Alcaraz,
  • Sayra Alcaraz,
  • Trond I. Andersen,
  • Markus Ansmann,
  • Frank Arute,
  • Kunal Arya,
  • Walt Askew,
  • Nikita Astrakhantsev,
  • Juan Atalaya,
  • Brian Ballard,
  • Joseph C. Bardin,
  • Hector Bates,
  • Andreas Bengtsson,
  • Majid Bigdeli Karimi,
  • Alexander Bilmes,
  • Simon Bilodeau,
  • Felix Borjans,
  • Alexandre Bourassa,
  • Jenna Bovaird,
  • Dylan Bowers,
  • Leon Brill,
  • Peter Brooks,
  • David A. Browne,
  • Brett Buchea,
  • Bob B. Buckley,
  • Tim Burger,
  • Brian Burkett,
  • Nicholas Bushnell,
  • Jamal Busnaina,
  • Anthony Cabrera,
  • Juan Campero,
  • Hung-Shen Chang,
  • Silas Chen,
  • Ben Chiaro,
  • Liang-Ying Chih,
  • Agnetta Y. Cleland,
  • Bryan Cochrane,
  • Matt Cockrell,
  • Josh Cogan,
  • Roberto Collins,
  • Paul Conner,
  • Harold Cook,
  • William Courtney,
  • Alexander L. Crook,
  • Ben Curtin,
  • Martin Damyanov,
  • Sayan Das,
  • Dripto M. Debroy,
  • Sean Demura,
  • Paul Donohoe,
  • Ilya Drozdov,
  • Andrew Dunsworth,
  • Valerie Ehimhen,
  • Aviv Moshe Elbag,
  • Lior Ella,
  • Mahmoud Elzouka,
  • David Enriquez,
  • Catherine Erickson,
  • Vinicius S. Ferreira,
  • Marcos Flores,
  • Leslie Flores Burgos,
  • Ebrahim Forati,
  • Jeremiah Ford,
  • Austin G. Fowler,
  • Brooks Foxen,
  • Masaya Fukami,
  • Alan Wing Lun Fung,
  • Lenny Fuste,
  • Suhas Ganjam,
  • Gonzalo Garcia,
  • Christopher Garrick,
  • Robert Gasca,
  • Helge Gehring,
  • Robert Geiger,
  • Élie Genois,
  • William Giang,
  • Dar Gilboa,
  • James E. Goeders,
  • Edward C. Gonzales,
  • Raja Gosula,
  • Stijn J. de Graaf,
  • Alejandro Grajales Dau,
  • Dietrich Graumann,
  • Joel Grebel,
  • Alex Greene,
  • Jonathan A. Gross,
  • Jose Guerrero,
  • Loïck Le Guevel,
  • Tan Ha,
  • Steve Habegger,
  • Tanner Hadick,
  • Ali Hadjikhani,
  • Michael C. Hamilton,
  • Matthew P. Harrigan,
  • Sean D. Harrington,
  • Jeanne Hartshorn,
  • Stephen Heslin,
  • Paula Heu,
  • Oscar Higgott,
  • Reno Hiltermann,
  • Hsin-Yuan Huang,
  • Mike Hucka,
  • Christopher Hudspeth,
  • Ashley Huff,
  • William J. Huggins,
  • Evan Jeffrey,
  • Shaun Jevons,
  • Zhang Jiang,
  • Xiaoxuan Jin,
  • Chaitali Joshi,
  • Pavol Juhas,
  • Andreas Kabel,
  • Dvir Kafri,
  • Hui Kang,
  • Kiseo Kang,
  • Amir H. Karamlou,
  • Ryan Kaufman,
  • Kostyantyn Kechedzhi,
  • Tanuj Khattar,
  • Mostafa Khezri,
  • Seon Kim,
  • Can M. Knaut,
  • Bryce Kobrin,
  • Fedor Kostritsa,
  • John Mark Kreikebaum,
  • Ryuho Kudo,
  • Ben Kueffler,
  • Arun Kumar,
  • Vladislav D. Kurilovich,
  • Vitali Kutsko,
  • Nathan Lacroix,
  • David Landhuis,
  • Tiano Lange-Dei,
  • Brandon W. Langley,
  • Pavel Laptev,
  • Kim-Ming Lau,
  • Justin Ledford,
  • Joy Lee,
  • Kenny Lee,
  • Brian J. Lester,
  • Wendy Leung,
  • Lily Li,
  • Wing Yan Li,
  • Ming Li,
  • Alexander T. Lill,
  • William P. Livingston,
  • Matthew T. Lloyd,
  • Aditya Locharla,
  • Laura De Lorenzo,
  • Daniel Lundahl,
  • Aaron Lunt,
  • Sid Madhuk,
  • Aniket Maiti,
  • Ashley Maloney,
  • Salvatore Mandrá,
  • Leigh S. Martin,
  • Orion Martin,
  • Eric Mascot,
  • Paul Masih Das,
  • Dmitri Maslov,
  • Melvin Mathews,
  • Cameron Maxfield,
  • Jarrod R. McClean,
  • Matt McEwen,
  • Seneca Meeks,
  • Kevin C. Miao,
  • Zlatko K. Minev,
  • Reza Molavi,
  • Sebastian Molina,
  • Shirin Montazeri,
  • Charles Neill,
  • Michael Newman,
  • Anthony Nguyen,
  • Murray Nguyen,
  • Chia-Hung Ni,
  • Murphy Yuezhen Niu,
  • Logan Oas,
  • Raymond Orosco,
  • Kristoffer Ottosson,
  • Alice Pagano,
  • Agustin Di Paolo,
  • Sherman Peek,
  • David Peterson,
  • Alex Pizzuto,
  • Elias Portoles,
  • Rebecca Potter,
  • Orion Pritchard,
  • Michael Qian,
  • Chris Quintana,
  • Arpit Ranadive,
  • Matthew J. Reagor,
  • Rachel Resnick,
  • David M. Rhodes,
  • Daniel Riley,
  • Gabrielle Roberts,
  • Roberto Rodriguez,
  • Emma Ropes,
  • Lucia B. De Rose,
  • Eliott Rosenberg,
  • Emma Rosenfeld,
  • Dario Rosenstock,
  • Elizabeth Rossi,
  • Pedram Roushan,
  • David A. Rower,
  • Robert Salazar,
  • Kannan Sankaragomathi,
  • Murat Can Sarihan,
  • Kevin J. Satzinger,
  • Max Schaefer,
  • Sebastian Schroeder,
  • Henry F. Schurkus,
  • Aria Shahingohar,
  • Michael J. Shearn,
  • Aaron Shorter,
  • Vladimir Shvarts,
  • Spencer Small,
  • W. Clarke Smith,
  • David A. Sobel,
  • Barrett Spells,
  • Sofia Springer,
  • George Sterling,
  • Jordan Suchard,
  • Aaron Szasz,
  • Alexander Sztein,
  • Madeline Taylor,
  • Jothi Priyanka Thiruraman,
  • Douglas Thor,
  • Dogan Timucin,
  • Eifu Tomita,
  • Alfredo Torres,
  • M. Mert Torunbalci,
  • Hao Tran,
  • Abeer Vaishnav,
  • Justin Vargas,
  • Sergey Vdovichev,
  • Guifre Vidal,
  • Catherine Vollgraff Heidweiller,
  • Meghan Voorhees,
  • Steven Waltman,
  • Jonathan Waltz,
  • Shannon X. Wang,
  • Brayden Ware,
  • James D. Watson,
  • Yonghua Wei,
  • Travis Weidel,
  • Theodore White,
  • Kristi Wong,
  • Bryan W. K. Woo,
  • Christopher J. Wood,
  • Maddy Woodson,
  • Cheng Xing,
  • Z. Jamie Yao,
  • Ping Yeh,
  • Bicheng Ying,
  • Juhwan Yoo,
  • Noureldin Yosri,
  • Elliot Young,
  • Grayson Young,
  • Adam Zalcman,
  • Ran Zhang,
  • Yaxing Zhang,
  • Ningfeng Zhu,
  • Nicholas Zobrist,
  • Zhenjie Zou,
  • Ryan Babbush,
  • Dave Bacon,
  • Sergio Boixo,
  • Yu Chen,
  • Zijun Chen,
  • Michel Devoret,
  • Monica Hansen,
  • Jeremy Hilton,
  • Cody Jones,
  • Julian Kelly,
  • Alexander N. Korotkov,
  • Erik Lucero,
  • Anthony Megrant,
  • Hartmut Neven,
  • William D. Oliver,
  • Ganesh Ramachandran,
  • Vadim Smelyanskiy,
  • Paul V. Klimov

摘要

Quantum error correction (QEC) is the primary strategy for protecting a quantum computer from the environment1,2. The prerequisite of QEC is that errors must remain sufficiently rare, which requires perpetually adapting the control parameters of the computer to the drifting environmental conditions. The current solution to this problem is to terminate the entire quantum computation for recalibration, but it is incompatible with the long runtimes of future quantum algorithms3,4. Here we address this challenge by unifying calibration with computation. We grant the QEC process511 a dual role: its error-detection events are not only used to correct the logical quantum state but are also repurposed as a learning signal, teaching a reinforcement learning agent1216 to continuously steer the control parameters and stabilize the quantum system during computation. We experimentally demonstrate this framework on a Willow superconducting processor, improving the logical stability of the surface code 3.5-fold against injected drift. By synthesizing our full suite of technological advances, we achieve record performance of the surface and colour codes, with average logical error per cycle of 7.72(9) × 10−4 and 8.19(14) × 10−3, respectively. Numerical simulations of large codes with tens of thousands of control parameters confirm the scalability of our RL framework, revealing an optimization speed that is independent of system size. This work thus enables a new paradigm: a quantum computer that learns from its errors and never stops computing.