Abstract
One of the most important properties of classical neural networks is how surprisingly trainable they are, though their training algorithms typically rely on optimizing complicated, nonconvex loss functions. Previous results have shown that unlike the case in classical neural networks, variational quantum models are often not trainable. The most studied phenomenon is the onset of barren plateaus in the training landscape of these quantum models, typically when the models are very deep. This focus on barren plateaus has made the phenomenon almost synonymous with the trainability of quantum models. Here, we show that barren plateaus are only a part of the story. We prove that a wide class of variational quantum models—which are shallow, and exhibit no barren plateaus—have only a superpolynomially small fraction of local minima within any constant energy from the global minimum, rendering these models untrainable if no good initial guess of the optimal parameters is known. We also study the trainability of variational quantum algorithms from a statistical query framework, and show that noisy optimization of a wide variety of quantum models is impossible with a sub-exponential number of queries. Finally, we numerically confirm our results on a variety of problem instances. Though we exclude a wide variety of quantum algorithms here, we give reason for optimism for certain classes of variational algorithms and discuss potential ways forward in showing the practical utility of such algorithms.
Similar content being viewed by others
Introduction
The trainability of classical neural networks via simple gradient-based methods is one of the most important factors leading to their general success on a wide variety of problems. This is particularly exciting given the variety of no-go results via statistical learning theory, which demonstrates that in the worst case, these models are not trainable via stochastic gradient-based methods1,2,3,4. There has been recent hope that variational quantum algorithms (VQAs)—the quantum analog of traditional neural networks—may inherit these nice trainability properties from classical neural networks. Indeed, in certain regimes5, training algorithms exist such that the resulting quantum model provably outperforms certain classical algorithms. This would potentially enable the use of quantum models to efficiently represent complex distributions which are provably inefficient to express using classical networks6.
Unfortunately, such good training behavior is not always the case in quantum models. There have been previous untrainability results for deep VQAs due to vanishing gradients7,8,9,10, and for nonlocal models due to poor local minima11; however, no such results were known for shallow, local quantum models with local cost functions. Indeed, there have been promising preliminary numerical experiments on the performance of VQAs in these regimes, but typically have relied on good initialization12 or highly symmetric problem settings13,14,15 to show convergence to a good approximation of the global optimum.
Here, we show that, generally, such models are not trainable, particularly when a good choice of initial point is not known and when the model does not exhibit a high amount of symmetry. We first prove general untrainability results in the presence of noise using techniques from statistical query learning theory. Surprisingly, these results hold for all learning problems in a wide range of variational learning settings, and in many scenarios even when the magnitude of the noise is exponentially small in the problem size. We then consider the trainability of models that may not have noise by studying their typical loss landscapes. We prove that, for typical model instances, local minima concentrate far from the global optimum even for certain local shallow circuits that do not suffer from barren plateaus. This phenomenon can be visualized in Fig. 1, where the training landscape for a shallow QCNN learning a random instance of itself is shown to concentrate far from the global optimum. As in ref. 11, this phenomenon is the result of a trainability phase transition in the loss landscape of the quantum model. In ref. 11, this transition was governed by the ratio of the number of parameters to the Hilbert space dimension; we show in the shallow case that instead, this transition is governed by the ratio of the local number of parameters to the local Hilbert space dimension in the reverse light cone of a given measured observable. As this is typically much less than 1 for local variational ansatzes, these models are typically untrainable. We then give numerical evidence of this fact, and conclude by studying where there may be the reason for optimism in the training of certain variational quantum models.
Loss landscapes of underparameterized quantum variational algorithms generally appear “bumpy,” filled with various local minima and traps. Here, we plot the loss landscape as a a surface and b contour plot along two random normalized directions for the teacher-student learning task of the QCNN for 14 qubits. Though a global minimum is located at the center of the plot, finding this global minima is generally challenging due to the shape of the loss landscape. Details of this visualization are given in Supplementary Note 6.
Results
Preliminaries
Quantum machine learning algorithms have been a focus of intense research effort as potential use-cases for noisy, intermediate-scale quantum (NISQ)16 devices. Just as in classical machine learning, algorithms are tasked with minimizing some risk:
given a model f, a distribution of inputs x, and a loss function ℓ. To perform learning, one searches for a model \(\widehat{f}\in {{{{{{{\mathcal{F}}}}}}}}\) in the function class \({{{{{{{\mathcal{F}}}}}}}}\) (e.g., the set of functions expressed by quantum neural networks). The expected risk \({{{{{{{\mathcal{R}}}}}}}}(\widehat{f})\) is typically not something one can calculate, as it requires access to the full probability distribution of the data. Instead, one often minimizes the empirical risk \(\widehat{{{{{{{{\mathcal{R}}}}}}}}}(\widehat{f})\) (often named the training error) over a given training data set D:
Perhaps the most well-studied class of quantum machine learning algorithm consists of VQAs17. VQAs are a class of quantum generative models where one expresses the solution of some problem as the smallest eigenvalue and corresponding eigenvector (typically called the ground state) of an objective Hermitian matrix H—called the Hamiltonian—on n qubits. Given a choice of generative model—often called an ansatz in the quantum algorithms literature:
that for some choice of θ is the ground state of H, the solution is encoded as the minimum of the loss function
where:
is the Pauli decomposition of H. VQAs have found numerous applications18, and a countless number of VQA instances have been proposed for various quantum learning tasks.
Typically, models in VQAs come in one of two flavors: Hamiltonian agnostic models, and Hamiltonian informed models. Hamiltonian agnostic models are constructed such that the Ui are independent of H, and are generally chosen to be efficient to implement. This is most analogous to the case in classical generative modeling, where the model structure is usually independent from the specific choice of data H. One might hope then that training Hamiltonian agnostic VQAs is completely analogous to the classical setting, then, and the loss landscape of (4) exhibits the desirable properties that enable trainability found in classical networks19,20.
Unfortunately, unlike the classical setting, the performance of VQAs is often dominated by poor performance in the training procedure (see Supplementary Note 1 for a discussion). For one, VQAs tend to exhibit barren plataeus when they are deep; namely, gradients of deep variational quantum circuits vanish exponentially with the problem size in many settings7,8,10. Problematic training in this regime has also been studied beyond gradient descent21,22.
Until recently, less was known about the trainability of VQAs in the shallow model regime. Numerically, refs. 13, 23 showed that randomly chosen variational landscapes typically have poor local minima, a result which was later proven in ref. 11 for nonlocal models using tools from random matrix theory. In a similar line of research, ref. 24 showed that for certain quantum variational ansatzes or quantum neural networks, there exist data sets and loss functions which induce exponentially many local minima in the loss landscape. Refs. 25, 26 both showed that, in an overparameterized regime, these models experience good local minima, though this transition to trainability typically occurs at an intractable number of parameters. Finally, assuming the presence of a constant rate of noise per ansatz gate, ref. 27 showed convergence of the loss landscape to the uniform distribution at a rate exponential in the circuit depth. Many of these previous results on the untrainability of VQAs are summarized in Table 1, along with a summary of our results which focus on the shallow, local regime.
Learning in the statistical query framework
Quantum machine learning algorithms are inherently noisy due to both unavoidable sources of error—such as shot noise from sampling outputs—or potentially correctable sources of error, such as gate errors and state preparation noise. In such noisy settings, the statistical query (SQ) model provides a useful framework for quantifying the complexity of learning a class of functions by considering how many query calls to a noisy oracle are needed to learn any function in that class (see Supplementary Note 2 for a brief review and history of SQ models)2,28,29. In this setting, we consider the optimization of a risk of the form of (2). We assume there is a target observable M that we would like to learn on some distribution over states \({{{{{{{\mathcal{D}}}}}}}}\). We define a correlational statistical query qCSQ(O, τ), which takes in a bounded observable O with ∥O∥ ≤ 1 and a tolerance τ and returns a value in the range:
Note that there are no guarantees on the form of the additive error other than it is within the tolerance τ, and may, for instance, depend on the observable being queried O. Though SQ oracle calls may at first appear unrelated to variational algorithms, we show in the Methods that many common variational optimizers in the presence of noise of the magnitude τ reduce to calls to an SQ oracle; for instance, commonly used first and second order optimization algorithms fall within the framework of the SQ model we consider. In the Methods, we also describe an analogous SQ model for learning unitaries.
To quantify the hardness of learning variational circuits, we consider the task of learning certain function classes generated by shallow variational circuits over a distribution of inputs \({{{{{{{\mathcal{D}}}}}}}}\) which forms a 2-design. Our results also generally hold for distributions that are uniform over states in the computational basis, recovering the statistical query setting for classical Boolean functions. Table 2 summarizes the number of queries needed to learn various function classes which are generated by variational circuits, with proofs deferred to Supplementary Note 3. In all settings we consider, an exponential number of queries (in either n or the light cone size) are needed to learn simple classes, such as the class of functions generated by single qubit gates followed by a fixed global measurement. This hardness intuitively arises because each individual query can only obtain information about a few of the exponentially many orthogonal elements in the function class. More formally, we lower bound the SQ dimension (defined in the “Methods”) of the function classes considered in Table 2 to show our query lower bounds.
Our hardness results hold for any target observable M, as long as the learning setting is one we consider in Table 2. Furthermore, they hold for any variational ansatz—not just on average—provided it is in one of the settings of Table 2. Finally, our results hold for any constant error τ in the statistical queries; indeed, the majority of our results hold even if this noise were only exponentially small in the problem size. For instance, training via gradient descent where the gradient is estimated using polynomially many samples fits into this framework immediately just from the induced shot noise.
In a more positive light, learning local Hamiltonians generated by shallow depth circuits can potentially be efficiently performed as the complexity grows exponentially only with locality or depth in this setting. In fact, prior results have provably shown that certain classes of Hamiltonians are efficiently learnable using properly chosen algorithms30,31. Nevertheless, this does not correspond to efficient learnability of the ground state of a given Hamiltonian, as learnability of the properties of a Hamiltonian is not the same as the learnability of its ground state. Indeed, we will see in section ‘Loss landscapes of local variational quantum algorithms’ that typically, even in this setting, learning the ground state of such a local Hamiltonian is difficult.
Our hardness results do not indicate that simple classes of functions like those generated by single qubit rotations are hard to learn for all algorithms, but only those whose steps reduce to statistical queries. For example, the class of Pauli channels is not learnable in the SQ setting, but there exist simple, carefully constructed, algorithms which can learn Pauli channels32,33,34. This is analogous to the classical setting where parity functions are hard to learn in the noisy SQ setting, but efficient to learn using simple linear regression29. Similarly, the related work of ref. 35 showed that output distributions of Clifford circuits can be hard to learn using statistical queries, but efficient using a technique that resorts to linear regression on a matrix formed from samples of the overall distribution. More loosely, our results provide support to the basic maxim that algorithms which apply too broadly will work very rarely36; more careful construction of learning algorithms tailored to the problem at hand is generally necessary. One straightforward way to avoid the hardness of the SQ setting is to construct algorithms whose basic steps do not reduce to statistical queries, e.g., via the construction of non-global metrics37,38,39. However, such a fix is by no means guaranteed to avoid the more general issues of poor landscapes and noise that also make learning in the SQ setting so difficult, as we now examine.
Loss landscapes of local variational quantum algorithms
We now consider the trainability of VQAs in the noise-free regime, beyond optimization algorithms that reduce to statistical queries. Though we are unable to prove the very strong no-go results proved in the SQ framework, we are able to show that the loss landscapes of typical local variational algorithms with Hamiltonian agnostic ansatzes are unamenable to optimization. We achieve this by showing that typically, the loss landscapes of shallow, local VQAs are swamped with poor local minima.
As discussed in Table 1, it is already known that deep Hamiltonian agnostic ansatzes are typically untrainable due to the presence of barren plateaus7,8,10; hence, here, we focus on shallow ansatzes. Previous results11 have also shown that shallow, nonlocal models are untrainable, by showing that the scrambling of variational ansatzes over the entire system in these instances induce poor local minima. These techniques were not extendable to shallow, local ansatzes, however, which do not scramble globally.
Instead, here, we show that ansatzes that approximately scramble locally are difficult to train. As we will later show, this includes common classes of variational ansatzes, such as Hamiltonian agnostic checkerboard ansatzes on a d-dimensional lattice. We show that this approximate, local scrambling suffices to imply that the loss landscapes of these VQAs are close to those of Wishart hypertoroidal random fields (WHRFs). These are random fields parameterized by l, m of the form:
where J is drawn from a Wishart distribution with m degrees of freedom, and w are points on a certain embedding of the hypertorus \({({S}^{1})}^{\times l}\) in \({{\mathbb{R}}}^{{2}^{l}}\). We demonstrate this convergence via new techniques, directly bounding the error in the joint characteristic function of the function value, gradient, and Hessian components of the variational loss from those of WHRFs. As the typical loss landscapes of WHRFs are known given these random variables (see “Methods” for a summary), by demonstrating sufficient convergence of these random variables to those of WHRFs, we will be able to infer the distribution of critical points for local VQAs.
To begin, we take our (assumed traceless) problem Hamiltonian to have Pauli decomposition:
and for simplicity scale and shift the loss landscape of (4) to be of the form:
where α is the vector of all αi and the ansatz \(\left|{{{{{{{\boldsymbol{\theta }}}}}}}}\right\rangle\) is as given in (3). As this ansatz is assumed to be shallow and local, we assume that the reverse light cone of each Pi under the ansatz is of size l ≪ n.
As in most analytic treatments of Hamiltonian agnostic VQAs, we consider certain randomized classes of ansatzes7,8,10,11. Roughly, we assume that in a local region around each measured Pauli observable Pi the ansatz is an ϵ-approximate t-design; that is, its first t moments are ϵ-close to those of the Haar distribution. This is a much weaker assumption than global scrambling of the ansatz. For instance, for Pi of constant weight, such approximately locally scrambling circuits include constant depth local circuits with random local gates40. We discuss in more detail when this assumption holds in practice when specializing to common variational quantum learning scenarios, and defer technical details to Supplementary Note 4.
Our main result, informally, is that the random field given by (9) under this approximate, local scrambling assumption converges in distribution to that of a WHRF. The formal statement and derivation of this result are given in Supplementary Note 4, where we also lay out our assumptions more explicitly. Informally, the result follows by deriving a bound on the error in the joint characteristic function of the loss function and its first two derivatives from that of a WHRF. We then use this to bound the error in distribution that is incurred by the induced scrambling being only approximate. Finally, we show using properties of local Haar random gates and the locality of the problem Hamiltonian that this suffices to prove the convergence of these random variables to those of a WHRF.
Theorem 1
(Approximately locally scrambled variational loss functions converge to WHRFs, informal). Let
be the degrees of freedom parameter. Assume \(q\log \left(q\right)=o\left(m\right)\), where q is the number of ansatz parameters in the reverse light cone of each Pi. Then, the distribution of (9) and its first two derivatives are equal to those of a WHRF
with m degrees of freedom, up to an error in distribution on the order of \(\tilde{O}(\,poly(\frac{1}{t}+\epsilon+\exp (-l)))\). Here, w are points on the hypertorus \({({S}^{1})}^{\times l}\) parameterized by \({{{\tilde{{{{{\boldsymbol{\theta }}}}}}}}}\), where \({\tilde{\theta }}_{i}\) is the sum of all θj on qubit i.
We interpret this result as the degrees of freedom m of the model being given by roughly the sum of the local Hilbert space dimensions of the reverse light cones of terms in the Pauli decomposition of H. We interpret this as the local underparameterization of the model, to be contrasted with the global underparameterization interpretation when m is exponentially large in n. Using known properties of the loss landscapes of WHRFs (see “Methods”), we are then able to prove the following result on the loss landscapes of local VQAs:
Corollary 2
(Shallow, local VQAs have poor loss landscapes, informal). Let \({\widehat{{{{{{{{\mathcal{R}}}}}}}}}}_{{{{{{{\rm{VQE}}}}}}}}\) be a local VQA loss function of the form of (9). Assume all coefficients αi of the Pauli decomposition of H are \({{\Theta }}\left(1\right)\), and
Then \({\widehat{{{{{{{{\mathcal{R}}}}}}}}}}_{{{{{{{\rm{VQE}}}}}}}}\) has a fraction superpolynomially small in n of local minima within any constant additive error of the ground state energy.
Optimizing loss landscapes where only a superpolynomially small (in n) fraction of the local minima are near the global minimum in energy is expected to be difficult. Indeed, algorithms such as gradient descent would then expect to have to be restarted a superpolynomial number of times before finding a good approximation to the global minimum; we also give heuristic reasons why this should continue to be true for other local optimizers in Supplementary Note 7. Our results stand in stark contrast with the loss landscapes typically found in classical machine learning, where almost all local minima closely approximate the global minimum in function value19,20.
In the shallow ansatz regime—where \(q,l=O\left({{{{{\rm{polylog}}}}}}\left(n\right)\right)\)—and assuming an extensive problem Hamiltonian such that \(A=\Omega \left(n\right)\), the condition given by (12) is always satisfied. Interestingly, this is a regime where barren plateaus are known not to occur10, demonstrating that poor local minima can give rise to poor optimization performance even when the loss function features large gradients. We now specialize to common variational quantum learning scenarios, and consider the implications of Corollary 2.
First, let us consider d-dimensional checkerboard ansatzes of constant depth. Fix p, t to be sufficiently large constants. We assume that the initial state forms an \(O\left(\frac{1}{{{{{{\rm{poly}}}}}}\left(t\right)}\right)\)-approximate t-design on l qubits around each Pauli observable of weight k; this can be done via a depth p, d-dimensional circuit of 2-local Haar random unitaries when \(l=O\left(\frac{{\left(p+k\right)}^{d}}{{{{{{\rm{poly}}}}}}\left(t\right)}\right)\ge k\) for some fixed polynomial in t40,41. After this state preparation circuit, a traditional depth \({{\Theta }}\left({l}^{\frac{1}{d}}\right)\) (i.e., independent of n), d-dimensional, n-qubit checkerboard circuit is applied, with observable reverse light cones of size at greatest l. By Corollary 2, these variational ansatzes are untrainable due to poor local minima, yet by the results of ref. 10 do not suffer from barren plateaus.
One interesting consideration is extending this result to traditional checkerboard ansatzes, without the special state preparation procedure we have considered. There, the \(l=O\left(\frac{{\left(p+k\right)}^{d}}{{{{{{\rm{poly}}}}}}\left(t\right)}\right)\) qubit local state is mixed, and our results, therefore, do not directly apply. However, we expect no reason for the mixedness of the initial state to improve training performance in any way. We validate this intuition numerically in section ‘Numerical results’.
We also consider a class of models similar to quantum convolutional neural networks (QCNNs)12 previously shown not to suffer from barren plateaus42. Though these models are in full generality trained on arbitrary loss functions, for learning various physical models the loss may take the form of (4). QCNNs are defined by their measurement of a subset of qubits at periodic intervals, via so-called pooling layers; for sufficiently deep (i.e., large constant depth) convolutional layers, then, at some point in the model, the number of remaining qubits will be sufficiently small such that the remaining convolutional layers are approximately scrambling. If one then assumes that the initial states are adversarially chosen such that they remain pure by this layer, this scenario reduces to the shallow checkerboard ansatz scenario, and once again we expect poor local minima by Corollary 2. Even if the initial states are not adversarially chosen and the input to the scrambling convolutional layers is mixed, we expect by similar intuition the model to remain untrainable; we will see this numerically, where we also observe that this poor training occurs when training on loss functions beyond (4).
Numerical results
To numerically validate our theoretical findings, we perform numerical simulations showing that learning in various settings cannot be guaranteed unless exponentially many parameters are included in an ansatz. We only consider problems and ansatzes where the existence of a zero loss global minimum is guaranteed to study whether or not optimizers can actually find the global minimum or a similarly good critical point. We parameterize all trainable 2-qubit gates in the Lie algebra of the four-dimensional unitary group, and implement the resulting unitary matrix via the exponential map which is surjective and capable of expressing any local 4 × 4 unitary gate. In all cases, we perform simulations using calculations with computer precision and analytic forms of the gradient (see Supplementary Note 6 for more details). In practice, actual quantum implementations will be hampered by various sources of inefficiency, such as the lack of an analogous method of backpropogation for calculating gradients, sampling noise, or even gate errors. Thus, our numerical analysis can be interpreted as a “best case” setting for quantum computation where we disregard such inefficiencies and focus solely on learnability. In Supplementary Note 5, we further study variations of the teacher-student learning and random variational quantum eigensolver (VQE)17 settings discussed here. We also consider the training performance of VQE in finding the ground state of a Heisenberg XYZ Hamiltonian43. Our supplemental results reinforce our findings here.
One may conjecture that it is plausible to learn the class of functions generated by relatively shallow depth variational teacher circuits by parameterizing a shallow-depth student circuit of the same form and training its parameters. In this so-called teacher-student setup, we are guaranteed the existence of a perfect global minimum since recovering the parameters of the teacher circuit achieves zero loss. In other words, the global minimum is guaranteed to be achievable in the setting we consider here. Still, we showed earlier that such circuits typically have many poor local minima, and are always hard to learn in the statistical query setting. Here, we provide numerical evidence of these findings for the QCNN ansatz. Additional confirmation of these findings with a checkerboard ansatz is included in Supplementary Note 5.
The QCNN presents an interesting test bed for our analysis since it has been shown in prior work to avoid barren plateaus42. Nevertheless, the QCNN, like other models, is riddled with poor local minima in generic learning tasks. For our analysis, we attempt to learn randomly generated QCNNs with a parameterized QCNN of the same form. In the QCNN, both student and teacher circuits have parameterized 2-qubit gates at each layer followed by 2-qubit pooling layers (see Supplementary Note 6 for more details). Each 2-qubit gate is fully parameterized in the Lie algebra of the unitary group. Networks are trained to predict the probability of the measurement of the last qubit in the teacher circuit. In other words, the student network is trained on a classification problem defined by the teacher network where, by construction, perfect classification accuracy is known to be achievable. We benchmark performance with the classification accuracy, where a prediction is considered correct when it predicts the most likely measurement of the last qubit correctly. Networks are trained via the Adam optimizer44 to learn outputs of 512 randomly chosen computational basis states. QCNNs with 4, 8, 12, and 16 qubits have 32, 48, 64, and 64 trainable parameters, respectively.
Figure 2 plots the final training accuracy achieved over 100 random simulations for varying ranges of circuit sizes. For circuits with 4 qubits, the training is sometimes successful, often achieving an accuracy above 85 percent on the training dataset. However, as the number of qubits grows, even past 8 qubits, the optimizer is unable to recover parameters which match the outputs of the teacher circuit. The results here show that the QCNN circuit—which has \(O(\log n)\) depth—still scrambles outputs to hinder learnability.
The student circuit is unable to learn the teacher circuit as the number of qubits grows, converging to a local minimum of the loss landscape. The existence of a global optimum is guaranteed as the teacher circuit is drawn from a random initialization of the same QCNN structure of the student circuit. Here, for a ranging number of qubits, 100 student circuits are trained to learn randomized teacher circuits of the same form and the resulting swarm plots of the final training accuracy are shown.
We now consider VQE. To analyze the performance of variational optimizers, we consider problems and ansatzes which are capable of recovering the global minimum. We aim to find the ground states of local Hamiltonians Ht over n qubits that take the form of single qubit Pauli Z Hamiltonians conjugated by L* layers of two alternating unitary operators U1 and U2, which are product unitaries on neighboring 2-local qubits:
The added identity matrix normalizes the Hamiltonian to have ground state with energy 0. Since the ground state of \(\mathop{\sum }\nolimits_{i=1}^{n}{{{{{{{{\bf{Z}}}}}}}}}_{i}\) is the state \({\left|1\right\rangle }^{\otimes n}\), we are guaranteed the existence of a global minima when using a checkerboard ansatz of at least depth L*, since this ansatz can “undo” the conjugation by unitary operators. In the remainder of this section, we consider (13) with L* = 4.
We measure the performance of optimization with two metrics. The first is the loss function itself, which is the average energy \(\left\langle \psi \right|{{{{{{{{\bf{H}}}}}}}}}_{t}\left|\psi \right\rangle\) of the VQE ansatz state \(\left|\psi \right\rangle\) for the given Hamiltonian Ht. The second is the trace distance to the ground state \(|{\phi }_{g}\rangle\) of Ht, equal to \(\parallel|{\phi }_{g}\rangle \langle {\phi }_{g}|-|\psi \rangle \langle \psi|{\parallel }_{1}/2\). Both of these metrics converge to zero at the global minimum.
We first aim to learn the ground state using a checkerboard ansatz by performing vanilla gradient descent on L = L* = 4 parameterized layers, equal in depth to the Hamiltonian conjugation circuit and thus capable of recovering the ground state. In Fig. 3a, we plot the final values of the loss and trace distance for 24 randomly initialized VQE problems for a number of qubits ranging from 4 to 24. Similar results are observed when using more advanced optimizers such as Adam (see Supplementary Note 6)44. Consistent with our theoretical findings, convergence clusters around local minima far from the ground state, particularly as the number of qubits grows.
a Scatter plot of the final loss and trace distance of the VQE state after 30,000 steps of gradient descent optimization shows that the algorithm converges to poorer local minima as the number of qubits grows. 24 simulations are performed for each value of n. The algorithm always succeeds at obtaining the ground state with 4 qubits, but progressively struggles more with added qubits. b The number of layers needed to guarantee convergence to the ground state empirically grows exponentially with the number of qubits. Here, we consider 4-layer Hamiltonians of the form of (13) on 14 qubits where the number of layers L in the ansatz is varied. When the ansatz has 300 layers—enough that the number of ansatz parameters is larger than the explored Hilbert space dimension—the model successfully converges to the ground state, rather than remaining stuck in a poor local minimum.
Our theoretical results also imply the difficulty of training beyond a finite fraction of the ground state energy in a VQE setting. Figure 3b illustrates this phenomenon when performing optimization on a 14 qubit ansatz. As more parameters are added to the ansatz via increasing its depth L, the VQE algorithm performs better, but it is not until the number of parameters is exponential in the problem size that convergence to a global minimum (or even within a small additive error of the global minimum) is guaranteed. This is true even though the ansatz is capable of expressing the ground state at L = 4. Simulations here are performed as before on random L* = 4 Hamiltonians of the form of (13).
Discussion
Though VQAs—and quantum machine learning models in general—have been cited as perhaps the most promising use case for quantum devices in the near future16, theoretical guarantees of their training performance have been sparse. Here, we have excluded a wide class of variational algorithms by showing that in many settings, they are in fact not trainable. We showed this in two different frameworks: first, in section ‘Learning in the statistical query framework’, we studied various classes of quantum models in the statistical query framework. We showed that in the presence of noise, exponentially many queries in the problem size are needed for these models to learn. As a complementary approach, we also examined the typical loss landscapes of VQAs in the noiseless setting in section ‘Loss landscapes of local variational quantum algorithms’, and showed that even at constant depth these models can have a number of poor local minima superpolynomially large in the problem size. We also numerically confirmed these results for a variety of problems in section ‘Numerical results’. These results go beyond the typical studies on the presence of barren plateaus, as many of the models we study here have gradients vanishing only polynomially quickly in the problem size. Our work demonstrates that showing that barren plateaus are not present in a model does not necessarily vindicate it as trainable.
These results, though they exclude a wide variety of VQAs, still leave room for hope in the usefulness of these algorithms. Particularly, our analysis in the noiseless setting of landscapes of VQAs focuses on very general, Hamiltonian agnostic ansatzes; in various instances, more focused ansatzes may be trainable. For instance, as previously shown in ref. 5, for certain classes of problems the quantum approximate optimization algorithm (QAOA)45 is provably able to outperform the best unconditionally proven classical algorithms, even when taking into account the training of the model. This is due to parameter concentration, where the global optimum for small problem instances is close to the global optimum for large problem instances46. These results demonstrate the power of good model initialization in VQAs: even if the total variational landscape is swamped with poor local minima, good initialization may ensure that the optimizer begins in the region of attraction of the global minimum. Though this is perhaps most relevant for the VQE17 and QAOA45 where there exists physical intuition for potentially performant parameter initializations, in more traditional machine learning settings this may manifest as good performance on certain inputs to the model.
Variationally studying models with many symmetries may also avoid our poor performance guarantees. Intuitively, our results here are the consequence of underparameterization. Namely, unless the ansatz is parameterized such that the number of parameters grows with the (local) Hilbert space dimension, the model is not trainable. Typically, this Hilbert space dimension is exponentially larger than the number of parameters the ansatz uses to explore it. However, if the model is heavily constrained by symmetries, this dimension might be much smaller. Such models were studied numerically in refs. 13, 47, where it was shown that certain VQAs optimize efficiently. Though often these models can be solved classically when the symmetries are known, these symmetries may not be known a priori. Indeed, one may be able to test for the presence of symmetries in a given model by studying whether associated VQAs are trainable. Similar to these general symmetry considerations, known structure in the problem may also allow one to build up hierarchical ansatzes that are able to be trained sequentially. We leave further investigation in these directions to future work.
Finally, though many variational models fit the framework of (4), there exist other settings of VQAs. One class of such models includes quantum Boltzmann machines, which attempt to model given quantum states via the training of quantum Gibbs states48. When the full quantum Gibbs state is observed, it is known that these models are efficiently trainable30, and numerically it is known that these models are trainable even when the full state is not observed48,49. Furthermore, though in full generality preparing quantum Gibbs states is difficult, state preparation has been shown to be efficient in certain regimes relevant to machine learning49,50,51, potentially giving an end-to-end trainable quantum machine learning model. We leave further analytical investigation on the training landscapes of quantum Boltzmann machines to future work.
Our results contribute to the already vast library of literature on the trainability of variational quantum models in further culling the landscape of potentially trainable quantum models. We hope these results have the effect of focusing research efforts toward classes of models that have the potential for trainability, and whittle down the search for practical use cases of VQAs.
Methods
The statistical query learning framework
We give a brief overview of the classical SQ model here, and provide a more detailed review in Supplementary Note 2. Given an input and output space \({{{{{{{\mathcal{X}}}}}}}}\) and \({{{{{{{\mathcal{Y}}}}}}}}\), let \({{{{{{{\mathcal{D}}}}}}}}\) be a joint distribution on \({{{{{{{\mathcal{X}}}}}}}}\times {{{{{{{\mathcal{Y}}}}}}}}\). In the classical SQ model, one queries the SQ model by inputting a function f and receiving an estimate of \({{\mathbb{E}}}_{(x,y) \sim {{{{{{{\mathcal{D}}}}}}}}}[f(x,y)]\) within a given tolerance τ. As an example, one can query a loss function ℓ for a model mθ with parameters θ by querying the function ℓ(mθ(x), y). A special class of statistical queries are inner product queries where query functions g are defined only on \({{{{{{{\mathcal{X}}}}}}}}\) and the correlational statistical query returns an estimate of \({{\mathbb{E}}}_{(x,y) \sim {{{{{{{\mathcal{D}}}}}}}}}[g(x)\cdot y]\) within a specified tolerance τ.
In detail, the SQ models we consider take the forms below:
Definition 3
(Quantum correlational statistical query (qCSQ)). Assume there is a target observable M that we would like to learn on some distribution over states \({{{{{{{\mathcal{D}}}}}}}}\). Applying the correlational SQ model to the quantum setting, we define the query qCSQ(O, τ) which takes in a bounded observable O with ∥O∥ ≤ 1 and a tolerance τ and returns a value in the range:
Definition 4
(Quantum unitary statistical query (qUSQ)). In the unitary compilation setting, one aims to learn a target unitary transformation U* over a distribution \({{{{{{{\mathcal{D}}}}}}}}\) of input/output pairs of that unitary transformation. Here, the oracle qUSQ(V, τ) takes in a unitary matrix V and a tolerance τ and returns a value in the range:
Importantly, if \({{{{{{{\mathcal{D}}}}}}}}\) is a 1-design over n qubit states, then the above can be simplified using the formula \({{\mathbb{E}}}_{\rho \sim {{{{{{{\mathcal{D}}}}}}}}}[{{{{{\rm{Re}}}}}} [Tr({{{{{{{{\bf{U}}}}}}}}}_{*}^{{{{\dagger}}} }{{{{{{{\bf{V}}}}}}}}\rho )]]={2}^{-n}{{{{{\rm{Re}}}}}} [Tr({{{{{{{{\bf{U}}}}}}}}}_{*}^{{{{\dagger}}} }{{{{{{{\bf{V}}}}}}}})]\) (see proof in Supplementary Note 3). Queries to qUSQ are related to performing a Hadamard test52, also a common subroutine in variational algorithms53.
The queries above take the forms of inner products, with \({\langle {{{{{{{{\bf{M}}}}}}}}}_{1},{{{{{{{{\bf{M}}}}}}}}}_{2}\rangle }_{{{{{{{{\mathcal{D}}}}}}}}}={{\mathbb{E}}}_{\rho \sim {{{{{{{\mathcal{D}}}}}}}}}[Tr({{{{{{{{\bf{M}}}}}}}}}_{1}\rho )Tr({{{{{{{{\bf{M}}}}}}}}}_{2}\rho )]\) and \({\langle {{{{{{{{\bf{U}}}}}}}}}_{1},{{{{{{{{\bf{U}}}}}}}}}_{2}\rangle }_{{{{{{{{\mathcal{D}}}}}}}}}={{\mathbb{E}}}_{\rho \sim {{{{{{{\mathcal{D}}}}}}}}}[{{{{{\rm{Re}}}}}} [Tr({{{{{{{{\bf{U}}}}}}}}}_{1}^{{{{\dagger}}} }{{{{{{{{\bf{U}}}}}}}}}_{2}\rho )]]\). The inner products also induce corresponding L2 norms: \(\parallel {{{{{{{\bf{M}}}}}}}}{\parallel }_{{{{{{{{\mathcal{D}}}}}}}}}=\sqrt{{\langle {{{{{{{\bf{M}}}}}}}},{{{{{{{\bf{M}}}}}}}}\rangle }_{{{{{{{{\mathcal{D}}}}}}}}}}\). As the magnitude of this norm can change with the dimension, we introduce the quantity Cmax to denote the maximum value a query can take for any target observable in the qCSQ model, i.e., \({C}_{{{\mbox{max}}}}=\mathop{\max }\limits_{{{{{{{{\bf{M}}}}}}}}:\parallel {{{{{{{\bf{M}}}}}}}}\parallel \le 1}\parallel {{{{{{{\bf{M}}}}}}}}{\parallel }_{{{{{{{{\mathcal{D}}}}}}}}}^{2}\). For fair comparison, we quantify noise tolerances and hardness bounds with respect to Cmax. Note that for the qUSQ model Cmax = 1, but in the qCSQ model, Cmax can decay with the number of qubits under for example the Haar distribution of inputs.
A statistical query algorithm learns a function class if it can output a unitary or observable that is close to any target in that class.
Definition 5
(qCSQ/qUSQ learning of hypothesis class). A given algorithm using only statistical queries to qCSQ (qUSQ) successfully learns a hypothesis class \({{{{{{{\mathcal{H}}}}}}}}\) consisting of observables M, ∥M∥ ≤ 1 (unitaries U) up to ϵ error if it is able to output an observable O (unitary V) which is ϵ-close to the unknown target observable \({{{{{{{\bf{M}}}}}}}}\in {{{{{{{\mathcal{H}}}}}}}}\) (\({{{{{{{\bf{U}}}}}}}}\in {{{{{{{\mathcal{H}}}}}}}}\)) in the L2 norm, i.e., \(\parallel {{{{{{{\bf{M}}}}}}}}-{{{{{{{\bf{O}}}}}}}}{\parallel }_{{{{{{{{\mathcal{D}}}}}}}}}\le \epsilon\) (\(\parallel {{{{{{{\bf{U}}}}}}}}-{{{{{{{\bf{V}}}}}}}}{\parallel }_{{{{{{{{\mathcal{D}}}}}}}}}\le \epsilon\)).
The statistical query dimension quantifies the complexity of a hypothesis class \({{{{{{{\mathcal{H}}}}}}}}\) and is related to the number of queries needed to learn functions drawn from a class, as summarized in Theorem 7.
Definition 6
(Statistical query dimension1,54). For a distribution \({{{{{{{\mathcal{D}}}}}}}}\) and concept class \({{{{{{{\mathcal{H}}}}}}}}\) where \(\parallel {{{{{{{\bf{M}}}}}}}}{\parallel }_{{{{{{{{\mathcal{D}}}}}}}}}^{2}\le {C}_{{{{{\rm{max}}}}}}\) for all \({{{{{{{\bf{M}}}}}}}}\in {{{{{{{\mathcal{H}}}}}}}}\), the statistical query dimension (\({SQ{\mbox{-}}DIM}_{{{{{{{{\mathcal{D}}}}}}}}}({{{{{{{\mathcal{H}}}}}}}})\)) is the largest positive integer d such that there exists d observables \({{{{{{{{\bf{M}}}}}}}}}_{1},{{{{{{{{\bf{M}}}}}}}}}_{2},\ldots,{{{{{{{{\bf{M}}}}}}}}}_{d}\in {{{{{{{\mathcal{H}}}}}}}}\) such that for all i ≠ j: \(|{\langle {{{{{{{{\bf{M}}}}}}}}}_{i},{{{{{{{{\bf{M}}}}}}}}}_{j}\rangle }_{{{{{{{{\mathcal{D}}}}}}}}}|\le {C}_{{{{{\rm{max}}}}}}/d\).
Theorem 7
(Query complexity of learning1,2). Given a distribution \({{{{{{{\mathcal{D}}}}}}}}\) on inputs and a hypothesis class \({{{{{{{\mathcal{H}}}}}}}}\) where \(\parallel {{{{{{{\bf{M}}}}}}}}{\parallel }_{{{{{{{{\mathcal{D}}}}}}}}}^{2}\le {C}_{{{{{\rm{max}}}}}}\) for all \({{{{{{{\bf{M}}}}}}}}\in {{{{{{{\mathcal{H}}}}}}}}\), let \(d={SQ{\mbox{-}}DIM}_{{{{{{{{\mathcal{D}}}}}}}}}({{{{{{{\mathcal{H}}}}}}}})\) be the statistical query dimension of \({{{{{{{\mathcal{H}}}}}}}}\). Any qCSQ or qUSQ learner making queries with tolerance Cmaxτ must make at least (dτ2 − 1)/2 queries to learn \({{{{{{{\mathcal{H}}}}}}}}\) up to error Cmaxτ.
Since our setting differs slightly from the standard classical setting1,2, we include a proof of the above in Supplementary Note 3. For example, if the hypothesis class is rich enough to be able to express any n-qubit Pauli observable, then the statistical query dimension of that class is at least 4n over the Haar distribution of inputs since Pauli observables are all orthogonal. This forms the basis for our resulting proofs of hardness, summarized in Table 2 and proved in Supplementary Note 3.
Analogous to work in classical machine learning28, one can perform noisy gradient descent as a series of statistical queries. As an example, consider the task of learning a target Hamiltonian M by constructing a variational Hamiltonian H(θ) = U(θ)†HU(θ) with parameterized Pauli rotations and minimizing the mean squared error between expectations of M versus H(θ) over a distribution of states \({{{{{{{\mathcal{D}}}}}}}}\). Our loss function is
The parameter shift rule55 provides a means to calculate the partial derivative of a function f(μ) with respect to a parameter μ applied as a parameterized quantum gate e−iμG by calculating the function itself at two shifted coordinates. For example, for parameterized Pauli gates (\({{{{{{{\bf{G}}}}}}}}\in \frac{1}{2}\{{{{{{{{\bf{Z}}}}}}}},{{{{{{{\bf{X}}}}}}}},{{{{{{{\bf{Y}}}}}}}}\}\)), this takes the form:
By applying the parameter shift rule55, we can evaluate the gradient of the loss with respect to parameter entry θi as
where θ+ and θ− are the values of the parameters shifted at the ith entry according to the parameter shift rule for the gradient. The quantity \({{\mathbb{E}}}_{\rho \sim {{{{{{{\mathcal{D}}}}}}}}}\left[Tr[{{{{{{{\bf{H}}}}}}}}({{{{{{{\boldsymbol{\theta }}}}}}}})\rho ](Tr[{{{{{{{\bf{H}}}}}}}}({{{{{{{\boldsymbol{{\theta }}}}}}}^{+}}})\rho ]-Tr[{{{{{{{\bf{H}}}}}}}}({{{{{{{\boldsymbol{{\theta }}}}}}}^{-}}})\rho ])\right]\) can be directly evaluated without statistical queries, and the quantity \({{\mathbb{E}}}_{\rho \sim {{{{{{{\mathcal{D}}}}}}}}}\left[Tr[{{{{{{{\bf{M}}}}}}}}\rho ](Tr[{{{{{{{\bf{H}}}}}}}}({{{{{{{\boldsymbol{{\theta }}}}}}}^{+}}})\rho ]-Tr[{{{{{{{\bf{H}}}}}}}}({{{{{{{\boldsymbol{{\theta }}}}}}}^{-}}})\rho ])\right]\) can be evaluated using 2 statistical queries to qCSQ where the tolerance τ accounts for the noise in the estimate.
As a second example, this time in the unitary compiling setting of qUSQ, we can evaluate the commonly used procedure of measuring the inner product or average fidelity of n-qubit states between a target unitary U* and a variationally chosen unitary V(θ) using statistical queries analogous to a swap test on actual quantum hardware39,56,57,58. With slight abuse of notation, let \(|\phi \rangle \sim {{{{{{{\mathcal{D}}}}}}}}\) denote a distribution over pure states which forms a 2-design. Then via averaging over 2-designs (see Supplementary Note 3 for details), the average fidelity equals
Note that the key quantity \({\left|Tr({{{{{{{\bf{V}}}}}}}}{({{{{{{{\boldsymbol{\theta }}}}}}}})}^{{{{\dagger}}} }{{{{{{{{\bf{U}}}}}}}}}_{*})\right|}^{2}={{{{{\rm{Re}}}}}} {[Tr({{{{{{{\bf{V}}}}}}}}{({{{{{{{\boldsymbol{\theta }}}}}}}})}^{{{{\dagger}}} }{{{{{{{{\bf{U}}}}}}}}}_{*})]}^{2}+ {{{{{\rm{Re}}}}}} {[iTr({{{{{{{\bf{V}}}}}}}}{({{{{{{{\boldsymbol{\theta }}}}}}}})}^{{{{\dagger}}} }{{{{{{{{\bf{U}}}}}}}}}_{*})]}^{2}\) can be evaluated up to a desired tolerance using statistical queries qUSQ(V(θ), τ) and qUSQ(iV(θ), τ).
One important caveat is that in the SQ setting, learning must succeed for all values of the query within the given tolerance τ. Noise in quantum settings, which can arise from sampling a finite data set, gate error, state preparation error, measurement sampling noise, or other means does not exactly coincide with the assumed tolerance of an SQ model. Nevertheless, though noise during optimization may appear unnatural in classical settings, such noise in quantum settings is rather endemic and the SQ model allows one to rigorously analyze the complexity of learning in the presence of noise.
The loss landscapes of Wishart hypertoroidal random fields
The loss landscapes of Wishart hypertoroidal random fields (WHRFs; see Supplementary Note 4 for a brief review) are known11 to exhibit a computational phase transition governed by the order parameter
called the overparameterization ratio. Here, l is the number of parameters of the WHRF, and m its degrees of freedom (see Supplementary Note 4). When γ ≪ 1 (the underparameterized regime), WHRFs exhibit poor local minima and thus are essentially untrainable; when γ ≥ 1 (the overparameterized regime), however, essentially all local minima of a WHRF are close to the global minimum in function value. More specifically, when \(\gamma=o\left(\frac{1}{\log \left(n\right)}\right)\), a superpolynomially small (in n) fraction of the local minima are within any constant additive energy error to the global minimum. When restoring units to the variational risk of (9), this is an error extensive in the problem size. The asymptotic expression of the distribution of local minima is also known, which is given by (up to a normalization factor):
for the density of local minima at any given energy \(0\le E\le \frac{1}{2}\), in units of the mean eigenvalue of H (shifted such that the global minimum is at E = 0). Representative plots of this distribution in various parameterization regimes are shown in Fig. 4.
Plot of the asymptotic distribution of local minima of WHRFs with m degrees of freedom on the l-torus in: the extremely underparameterized regime, where l ≪ 2m; the moderately underparameterized regime, where l is a finite fraction of 2m; and at the critical overparameterization regime, where l = 2m. Here, the energy is scaled and shifted as per (9) so that global minima have zero energy. In the underparameterized regime, only a fraction \(\sim \exp \left(-m\right)\) of the critical points are within any constant additive error of the global minimum. In the overparameterized regime, local minima are exponentially concentrated at the global minimum.
This distribution of local minima is calculated from the joint distribution of the WHRF function value, its gradient, and its Hessian. Thus, by demonstrating the convergence of this joint distribution in the variational loss functions we consider to the analogous distribution in WHRFs at a sufficient rate, we are able to show the same phase transition occurs in variational loss functions. Our full proof is given in Supplementary Note 4.
Data availability
The processed data generated and analyzed for this study are available at https://github.com/bkiani/Beyond-Barren-Plateaus and ref. 59.
Code availability
The code used for the current study is available at ref. 59.
References
Blum, A. et al. Weakly learning DNF and characterizing statistical query learning using Fourier analysis. In Proceedings of the Twenty-Sixth Annual ACM Symposium on Theory of Computing, STOC ’94 253–262 (Association for Computing Machinery, 1994).
Szörényi, B. Algorithmic Learning Theory (eds Gavaldà, R., Lugosi, G., Zeugmann, T. & Zilles, S.) 186–200 (Springer, 2009).
Goel, S., Gollakota, A. & Klivans, A. Statistical-query lower bounds via functional gradients. In Proceedings of the 34th International Conference on Neural Information Processing Systems (Curran Associates Inc., Red Hook, 2020).
Shalev-Shwartz, S., Shamir, O. & Shammah, S. Failures of gradient-based deep learning. In Proceedings of the 34th International Conference on Machine Learning - Volume 70, 3067–3075 (JMLR.org, 2017).
Farhi, E., Goldstone, J., Gutmann, S. & Zhou, L. The quantum approximate optimization algorithm and the Sherrington-Kirkpatrick model at infinite size. Quantum 6, 759 (2022).
Gao, X., Anschuetz, E. R., Wang, S.-T., Cirac, J. I. & Lukin, M. D. Enhancing generative models via quantum correlations. Phys. Rev. X 12, 021037 (2022).
McClean, J. R., Boixo, S., Smelyanskiy, V. N., Babbush, R. & Neven, H. Barren plateaus in quantum neural network training landscapes. Nat. Commun. 9, 4812 (2018).
Cerezo, M., Sone, A., Volkoff, T., Cincio, L. & Coles, P. J. Cost function dependent barren plateaus in shallow parametrized quantum circuits. Nat. Commun. 12, 1791 (2021).
Marrero, C. O., Kieferová, M. & Wiebe, N. Entanglement-induced barren plateaus. PRX Quantum 2, 040316 (2021).
Napp, J. Quantifying the barren plateau phenomenon for a model of unstructured variational ansätze. Preprint at https://arxiv.org/abs/2203.06174 (2022) .
Anschuetz, E. R. Critical points in quantum generative models. In International Conference on Learning Representations https://openreview.net/forum?id=2f1z55GVQN (2022).
Cong, I., Choi, S. & Lukin, M. D. Quantum convolutional neural networks. Nat. Phys. 15, 1273–1278 (2019).
Wiersema, R. Exploring entanglement and optimization within the Hamiltonian variational ansatz. PRX Quantum 1, 020319 (2020).
Kim, J., Kim, J. & Rosa, D. Universal effectiveness of high-depth circuits in variational eigenproblems. Phys. Rev. Res. 3, 023203 (2021).
Kim, J. & Oz, Y. Quantum energy landscape and circuit optimization. Phys. Rev. A 106, 052424 (2022).
Preskill, J. Quantum Computing in the NISQ era and beyond. Quantum 2, 79 (2018).
Peruzzo, A. A variational eigenvalue solver on a photonic quantum processor. Nat. Commun. 5, 4213 (2014).
Cerezo, M. Variational quantum algorithms. Nat. Rev. Phys. 3, 625–644 (2021).
Choromanska, A., Henaff, M., Mathieu, M., Arous, G. B. & LeCun, Y. The loss surfaces of multilayer networks. In Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics, Proceedings of Machine Learning Research. Vol. 38 (eds Lebanon, G. & Vishwanathan, S. V. N.) 192–204 (PMLR, San Diego, 2015)
Chaudhari, P. & Soatto, S. On the energy landscape of deep networks. Preprint at https://arxiv.org/abs/1511.06485 (2017).
Cerezo, M. & Coles, P. J. Higher order derivatives of quantum neural networks with barren plateaus. Quantum Sci. Technol. 6, 035006 (2021).
Arrasmith, A., Cerezo, M., Czarnik, P., Cincio, L. & Coles, P. J. Effect of barren plateaus on gradient-free optimization. Quantum 5, 558 (2021).
Kiani, B. T., Lloyd, S. & Maity, R. Learning unitaries by gradient descent. Preprint at https://arxiv.org/abs/2001.11897 (2020).
You, X. & Wu, X. Exponentially many local minima in quantum neural networks. In Proceedings of the 38th International Conference on Machine Learning, Proceedings of Machine Learning Research, Vol. 139 (eds Meila, M. & Zhang, T.) 12144–12155 (PMLR, 2021).
Liu, J. et al. An analytic theory for the dynamics of wide quantum neural networks. Preprint at https://arxiv.org/abs/2203.16711 (2022).
You, X., Chakrabarti, S. & Wu, X. A convergence theory for over-parameterized variational quantum eigensolvers. Preprint at https://arxiv.org/abs/2205.12481 (2022).
Deshpande, A. et al. Tight bounds on the convergence of noisy random circuits to the uniform distribution. Preprint at https://arxiv.org/abs/2112.00716 (2021).
Goel, S., Gollakota, A., Jin, Z., Karmalkar, S. & Klivans, A. Superpolynomial lower bounds for learning one-layer neural networks using gradient descent. In Proceedings of the 37th International Conference on Machine Learning, Proceedings of Machine Learning Research, Vol. 119 (eds Daumé, H., III & Singh, A.) 3587–3596 (PMLR, 2020).
Kearns, M. Efficient noise-tolerant learning from statistical queries. J. ACM 45, 983–1006 (1998).
Anshu, A., Arunachalam, S., Kuwahara, T. & Soleimanifar, M. Sample-efficient learning of interacting quantum systems. Nat. Phys. 17, 931–935 (2021).
Bairey, E., Arad, I. & Lindner, N. H. Learning a local Hamiltonian from local measurements. Phys. Rev. Lett. 122, 020504 (2019).
Chen, S., Zhou, S., Seif, A. & Jiang, L. Quantum advantages for Pauli channel estimation. Phys. Rev. A 105, 032435 (2022).
Huang, H.-Y., Kueng, R. & Preskill, J. Information-theoretic bounds on quantum advantage in machine learning. Phys. Rev. Lett. 126, 190505 (2021).
Gollakota, A. & Liang, D. On the hardness of PAC-learning stabilizer states with noise. Quantum 6, 640 (2022).
Hinsche, M. et al. Learnability of the output distributions of local quantum circuits. Preprint at https://arxiv.org/abs/2110.05517 (2021).
Wolpert, D. H. & Macready, W. G. No free lunch theorems for optimization. IEEE Trans. Evol. Comput. 1, 67–82 (1997).
Kiani, B. T., De Palma, G., Marvian, M., Liu, Z.-W. & Lloyd, S. Learning quantum data with the quantum earth mover’s distance. Quantum Sci. Technol. 7, 045002 (2022).
Huang, H.-Y. Power of data in quantum machine learning. Nat. Commun. 12, 2631 (2021).
Khatri, S. Quantum-assisted quantum compiling. Quantum 3, 140 (2019).
Harrow, A. & Mehraban, S. Approximate unitary t-designs by short random quantum circuits using nearest-neighbor and long-range gates. Preprint at https://arxiv.org/abs/1809.06957 (2018).
Haferkamp, J. Random quantum circuits are approximate unitary t-designs in depth \(O\left(n{t}^{5+o(1)}\right)\). Quantum 6, 795 (2022).
Pesah, A. Absence of barren plateaus in quantum convolutional neural networks. Phys. Rev. X 11, 041011 (2021).
Heisenberg, W. Zur theorie des ferromagnetismus. Z. Phys. 49, 619–636 (1928).
Kingma, D. P. & Ba, J. Adam: a method for stochastic optimization. In International Conference on Learning Representations (2015).
Farhi, E., Goldstone, J. & Gutmann, S. A quantum approximate optimization algorithm. Preprint at https://arxiv.org/abs/1411.4028 (2014).
Brandao, F. G. S. L., Broughton, M., Farhi, E., Gutmann, S. & Neven, H. For fixed control parameters the quantum approximate optimization algorithm’s objective function value concentrates for typical instances. Preprint at https://arxiv.org/abs/1812.04170 (2018).
Larocca, M., Ju, N., García-Martín, D., Coles, P. J. & Cerezo, M. Theory of overparametrization in quantum neural networks. Preprint at https://arxiv.org/abs/2109.11676 (2021).
Amin, M. H., Andriyash, E., Rolfe, J., Kulchytskyy, B. & Melko, R. Quantum Boltzmann machine. Phys. Rev. X 8, 021050 (2018).
Kieferová, M. & Wiebe, N. Tomography and generative training with quantum Boltzmann machines. Phys. Rev. A 96, 062327 (2017).
Anschuetz, E. R. & Cao, Y. Realizing quantum Boltzmann machines through eigenstate thermalization. Preprint at https://arxiv.org/abs/1903.01359 (2019).
Zoufal, C., Lucchi, A. & Woerner, S. Variational quantum Boltzmann machines. Quantum Mach. Intell. 3, 7–21 (2021).
Aharonov, D., Jones, V. & Landau, Z. A polynomial quantum algorithm for approximating the Jones polynomial. In Proceedings of the Thirty-Eighth Annual ACM Symposium on Theory of Computing 427–436 (Association for Computing Machinery, New York, 2006).
Wang, X., Song, Z. & Wang, Y. Variational quantum singular value decomposition. Quantum 5, 483 (2021).
Reyzin, L. Statistical queries and statistical algorithms: foundations and applications. Preprint at https://arxiv.org/abs/2004.00557 (2020).
Schuld, M., Bergholm, V., Gogolin, C., Izaac, J. & Killoran, N. Evaluating analytic gradients on quantum hardware. Phys. Rev. A 99, 032331 (2019).
Mitarai, K., Negoro, M., Kitagawa, M. & Fujii, K. Quantum circuit learning. Phys. Rev. A 98, 032309 (2018).
Buhrman, H., Cleve, R., Watrous, J. & de Wolf, R. Quantum fingerprinting. Phys. Rev. Lett. 87, 167902 (2001).
Beer, K. Training deep quantum neural networks. Nat. Commun. 11, 808 (2020).
Kiani, B. T. bkiani/Beyond-Barren-Plateaus: code for Beyond Barren Plateaus paper. https://doi.org/10.5281/zenodo.7338595 (2022).
Acknowledgements
The authors thank Giacomo De Palma, Tongyang Li, Seth Lloyd, Milad Marvian, Quynh T. Nguyen, and Agnes Villanyi for helpful feedback and discussions. E.R.A. was supported by the National Science Foundation Graduate Research Fellowship Program under Grant No. 4000063445. B.T.K. was supported by the MIT Energy Initiative fellowship.
Author information
Authors and Affiliations
Contributions
E.R.A. and B.T.K. both wrote this manuscript and formulated the original project ideas, contributed to the proofs, and performed numerical experiments.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Peer review
Peer review information
Nature Communications thanks Xiao Yuan and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. Peer reviewer reports are available.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Anschuetz, E.R., Kiani, B.T. Quantum variational algorithms are swamped with traps. Nat Commun 13, 7760 (2022). https://doi.org/10.1038/s41467-022-35364-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467-022-35364-5
This article is cited by
-
Quantifying the effect of gate errors on variational quantum eigensolvers for quantum chemistry
npj Quantum Information (2024)
-
Enhancing the expressivity of quantum neural networks with residual connections
Communications Physics (2024)
-
Quantum-classical separations in shallow-circuit-based learning with and without noises
Communications Physics (2024)
-
A Lie algebraic theory of barren plateaus for deep parameterized quantum circuits
Nature Communications (2024)
-
Theoretical guarantees for permutation-equivariant quantum neural networks
npj Quantum Information (2024)