Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

QASMBench: A Low-Level Quantum Benchmark Suite for NISQ Evaluation and Simulation

QASMBench: A Low-Level Quantum Benchmark Suite for NISQ Evaluation and Simulation The rapid development of quantum computing (QC) in the NISQ era urgently demands a low-level benchmark suite and insightful evaluation metrics for characterizing the properties of prototype NISQ devices, the efficiency of QC programming compilers, schedulers and assemblers, and the capability of quantum system simulators in a classical computer. In this work, we fill this gap by proposing a low-level, easy-to-use benchmark suite called QASMBench based on the OpenQASM assembly representation. It consolidates commonly used quantum routines and kernels from a variety of domains including chemistry, simulation, linear algebra, searching, optimization, arithmetic, machine learning, fault tolerance, cryptography, and so on, trading-off between generality and usability. To analyze these kernels in terms of NISQ device execution, in addition to circuit width and depth, we propose four circuit metrics including gate density, retention lifespan, measurement density, and entanglement variance, to extract more insights about the execution efficiency, the susceptibility to NISQ error, and the potential gain from machine-specific optimizations. Applications in QASMBench can be launched and verified on several NISQ platforms, including IBM-Q, Rigetti, IonQ and Quantinuum. For evaluation, we measure the execution fidelity of a subset of QASMBench applications on 12 IBM-Q machines through density matrix state tomography, comprising 25K circuit evaluations. We also compare the fidelity of executions among the IBM-Q machines, the IonQ QPU and the Rigetti Aspen M-1 system. QASMBench is released at: http://github.com/pnnl/QASMBench. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM Transactions on Quantum Computing Association for Computing Machinery

QASMBench: A Low-Level Quantum Benchmark Suite for NISQ Evaluation and Simulation

Download PDF
26 pages

Loading next page...
 
/lp/association-for-computing-machinery/qasmbench-a-low-level-quantum-benchmark-suite-for-nisq-evaluation-and-J0we71OEea
Publisher
Association for Computing Machinery
Copyright
Copyright © 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM.
ISSN
2643-6809
eISSN
2643-6817
DOI
10.1145/3550488
Publisher site
See Article on Publisher Site

Abstract

The rapid development of quantum computing (QC) in the NISQ era urgently demands a low-level benchmark suite and insightful evaluation metrics for characterizing the properties of prototype NISQ devices, the efficiency of QC programming compilers, schedulers and assemblers, and the capability of quantum system simulators in a classical computer. In this work, we fill this gap by proposing a low-level, easy-to-use benchmark suite called QASMBench based on the OpenQASM assembly representation. It consolidates commonly used quantum routines and kernels from a variety of domains including chemistry, simulation, linear algebra, searching, optimization, arithmetic, machine learning, fault tolerance, cryptography, and so on, trading-off between generality and usability. To analyze these kernels in terms of NISQ device execution, in addition to circuit width and depth, we propose four circuit metrics including gate density, retention lifespan, measurement density, and entanglement variance, to extract more insights about the execution efficiency, the susceptibility to NISQ error, and the potential gain from machine-specific optimizations. Applications in QASMBench can be launched and verified on several NISQ platforms, including IBM-Q, Rigetti, IonQ and Quantinuum. For evaluation, we measure the execution fidelity of a subset of QASMBench applications on 12 IBM-Q machines through density matrix state tomography, comprising 25K circuit evaluations. We also compare the fidelity of executions among the IBM-Q machines, the IonQ QPU and the Rigetti Aspen M-1 system. QASMBench is released at: http://github.com/pnnl/QASMBench.

Journal

ACM Transactions on Quantum Computing – Association for Computing Machinery

Published: Feb 24, 2023

Keywords: Benchmark

References

  • Quantum programming language converter
    [,
  • Quantum programming language converter
    [,
  • Quantum algorithm implementations for beginners
    [,
  • Quantum walks on graphs
    [,
  • A functional quantum programming language
    [,
  • https://github
    [,
  • Quantum supremacy using a programmable superconducting processor
    [,
  • Photonic quantum simulators
    [,
  • Classical and quantum algorithms for the Boolean satisfiability problem
    [,
  • A generative modeling approach for benchmarking and training shallow quantum circuits
    [,
  • The computer as a physical system: A microscopic quantum mechanical Hamiltonian model of computers as represented by Turing machines
    [,
  • Quantum cryptography: Public key distribution and coin tossing
    [,
  • Quantum complexity theory
    [,
  • Efficient quantum algorithms for simulating sparse Hamiltonians
    [,
  • Quantum machine learning
    [,
  • Quantum Examples QASM
    [,
  • Security of two quantum cryptography protocols using the same four qubit states
    [,
  • TensorFlow quantum: A software framework for quantum machine learning
    [,
  • Quantum Ising Phases and Transitions in Transverse Ising Models
    [,
  • Toward a MILP modeling framework for distribution system restoration
    [,
  • Quantum computing is getting real: Architecture, PL, and OS roles in closing the gap between quantum algorithms and machines
    [,
  • Learning the quantum algorithm for state overlap
    [,
  • Quantum computations with cold trapped ions
    [,
  • Preconditioned quantum linear system algorithm
    [,
  • Superconducting quantum bits
    [,
  • An approximate Fourier transform useful in quantum factoring
    [,
  • Challenges and opportunities of near-term quantum computing systems
    [,
  • Validating quantum computers using randomized model circuits
    [,
  • Open quantum assembly language
    [,
  • Quantum learning robust against noise
    [,
  • A new quantum ripple-carry addition circuit
    [,
  • A case for multi-programming quantum computers
    [,
  • Rapid solution of problems by quantum computation
    [,
  • The physical implementation of quantum computation
    [,
  • Arbitrary accuracy iterative quantum phase estimation algorithm using a single ancillary qubit: A two-qubit benchmark
    [,
  • Random circuit block-encoded matrix and a proposal of quantum LINPACK benchmark
    [,
  • Cloud quantum computing of an atomic nucleus
    [,
  • Three qubits can be entangled in two inequivalent ways
    [,
  • A quantum approximate optimization algorithm
    [,
  • Quantum computation and decision trees
    [,
  • A quantum teleportation experiment for undergraduate students
    [,
  • Simulating physics with computers
    [,
  • Open-Source Quantum Software Projects
    [,
  • Quantum memory for photons: Dark-state polaritons
    [,
  • Surface codes: Towards practical large-scale quantum computation
    [,
  • An experimental microarchitecture for a superconducting quantum processor
    [,
  • Two-particle quantum walks applied to the graph isomorphism problem
    [,
  • Quantum simulation
    [,
  • Quantum cryptography
    [,
  • Cloud based QC with Amazon Braket
    [,
  • [n
    [,
  • Going beyond Bell’s theorem
    [,
  • Is the trotterized UCCSD ansatz chemically well-defined? Journal of Chemical Theory and Computation (2019)
    [,
  • A fast quantum mechanical algorithm for database search
    [,
  • Quantum computers can search rapidly by using almost any transformation
    [,
  • Distributed quantum computing with QMPI
    [,
  • Quantum algorithm for linear systems of equations
    [,
  • Identification of networking quantum teleportation on 14-qubit IBM universal quantum computer
    [,
  • IBM Quantum Experience
    [,
  • Qiskit: Elements for building a quantum future
    [,
  • Best Practices for Using IonQ Hardware
    [,
  • [n
    [,
  • Quantum counterfeit coin problems
    [,
  • Quantum counterfeit coin problems
    [,
  • ScaffCC: A framework for compilation and analysis of quantum computing programs
    [,
  • Variational quantum algorithms for discovering Hamiltonian spectra
    [,
  • [n
    [,
  • Hardware-efficient variational quantum eigensolver for small molecules and quantum magnets
    [,
  • Implementation of SWAP test for two unknown states in photons via cross-Kerr nonlinearities under decoherence effect
    [,
  • Quantum recommendation systems
    [,
  • The quantum internet
    [,
  • Tunable two-dimensional arrays of single Rydberg atoms for realizing quantum Ising models
    [,
  • Overview and comparison of gate level quantum software platforms
    [,
  • LLVM: A compilation framework for lifelong program analysis & transformation
    [,
  • Quantum dynamics of single trapped ions
    [,
  • Creation of a six-atom ‘Schrödinger cat’state
    [,
  • SV-Sim: Scalable PGAS-based state vector simulation of quantum circuits
    [,
  • Density matrix quantum circuit simulation via the BSP machine on modern GPU clusters
    [,
  • Tackling the qubit mapping problem for NISQ-era quantum devices
    [,
  • Towards efficient superconducting quantum processor architecture design
    [,
  • Universal quantum simulators
    [,
  • Application-oriented performance benchmarks for quantum computing
    [,
  • Scalable and robust randomized benchmarking of quantum processes
    [,
  • Characterizing quantum gates via randomized benchmarking
    [,
  • A CMOS silicon spin qubit
    [,
  • A language and hardware independent approach to quantum–classical computing
    [,
  • OpenFermion: The electronic structure package for quantum computers
    [,
  • The theory of variational hybrid quantum-classical algorithms
    [,
  • [n
    [,
  • Benchmarking gate-based quantum computers
    [,
  • [n
    [,
  • [n
    [,
  • Quantum algorithms: An overview
    [,
  • From quantum multiplexing to high-performance quantum networking
    [,
  • Noise-adaptive compiler mappings for noisy intermediate-scale quantum computers
    [,
  • Full-stack, real-system quantum computer studies: Architectural comparisons and design insights
    [,
  • Software mitigation of crosstalk on noisy intermediate-scale quantum computers
    [,
  • Quantum computation and quantum information
    [,
  • Photonic quantum technologies
    [,
  • Google in a quantum network
    [,
  • Noise-tolerant parity learning with one quantum bit
    [,
  • A quantum Fredkin gate
    [,
  • Experimental evaluation of NISQ quantum computers: Error measurement, characterization, and implications
    [,
  • A single-atom electron spin qubit in silicon
    [,
  • Quantum computing in the NISQ era and beyond
    [,
  • Direct randomized benchmarking for multiqubit devices
    [,
  • List of QC simulators
    [,
  • Adaptive quantum state tomography with neural networks
    [,
  • Quantum computational finance: Monte Carlo pricing of financial derivatives
    [,
  • [n
    [,
  • Superconducting qubit in a waveguide cavity with a coherence time approaching 0
    [,
  • Code in QASM for quantum circuits and algorithms
    [,
  • An introduction to quantum machine learning
    [,
  • Optimized compilation of aggregated instructions for realistic quantum computers
    [,
  • Algorithms for quantum computation: Discrete logarithms and factoring
    [,
  • Polynomial-time algorithms for prime factorization and discrete logarithms on a quantum computer
    [,
  • On the power of quantum computation
    [,
  • A quantum computational compiler and design tool for technology-specific targets
    [,
  • ProjectQ: An open source software framework for quantum computing
    [,
  • EQC: Ensembled quantum computing for variational quantum algorithms
    [,
  • QuClassi: A hybrid deep neural network architecture based on quantum state fidelity
    [,
  • QuGAN: A generative adversarial network through quantum states
    [,
  • A quantum annealing approach for Boolean satisfiability problem
    [,
  • Ensemble of diverse mappings: Improving reliability of quantum computers by orchestrating dissimilar mistakes
    [,
  • Mitigating measurement errors in quantum computers by exploiting state-dependent bias
    [,
  • Not all qubits are created equal: A case for variability-aware policies for NISQ-era quantum computers
    [,
  • Reversible computing
    [,
  • SupermarQ: A scalable quantum benchmark suite
    [,
  • Quantum networks for elementary arithmetic operations
    [,
  • Quantum walks: A comprehensive review
    [,
  • Experimental bell-state analysis
    [,
  • Simulation of electronic structure Hamiltonians using quantum computers
    [,
  • Swift: A language for distributed parallel scripting
    [,
  • Quantum risk analysis
    [,
  • A Bayesian approach for characterizing and mitigating gate and measurement errors
    [,
  • Quantum approximate optimization algorithm: Performance, mechanism, and implementation on near-term devices
    [,