# Exponential Enhancement of the Efficiency of Quantum Annealing by Non-Stoquastic Hamiltonians

## Abstract

Non-stoquastic Hamiltonians have both positive and negative signs in off-diagonal elements in their matrix representation in the standard computational basis and thus cannot be simulated efficiently by the standard quantum Monte Carlo method due to the sign problem. We describe our analytical studies of this type of Hamiltonians with infinite-range non-random as well as random interactions from the perspective of possible enhancement of the efficiency of quantum annealing or adiabatic quantum computing. It is shown that multi-body transverse interactions like and with positive coefficients appended to a stoquastic transverse-field Ising model render the Hamiltonian non-stoquastic and reduce a first-order quantum phase transition in the simple transverse-field case to a second-order transition. This implies that the efficiency of quantum annealing is exponentially enhanced, because a first-order transition has an exponentially small energy gap (and therefore exponentially long computation time) whereas a second-order transition has a polynomially decaying gap (polynomial computation time). The examples presented here represent rare instances where strong quantum effects, in the sense that they cannot be efficiently simulated in the standard quantum Monte Carlo, have analytically been shown to exponentially enhance the efficiency of quantum annealing for combinatorial optimization problems.

## I Introduction

Quantum annealing is a metaheuristic for combinatorial optimization problems Kadowaki and Nishimori (1998); Kadowaki (1998); Brooke et al. (1999); Farhi et al. (2000, 2001); Santoro and Marton (2002); Santoro and Tosatti (2006); Das and Chakrabarti (2008); Morita and Nishimori (2008). A combinatorial optimization problem can generally be expressed as the minimization of an Ising Hamiltonian, i.e., the ground-state search of a classical Ising model Lucas (2014). Then, quantum fluctuations are appended, typically as a uniform transverse field, and the total Hamiltonian constitutes the transverse-field Ising model. The amplitude of the appended term for quantum fluctuations is gradually decreased from a very large value, large relative to the original classical Ising model, toward zero. If one starts from the ground state of the initial Hamiltonian and the rate of change of the amplitude is sufficiently slow, the system follows the instantaneous ground state according to the adiabatic theorem of quantum mechanics. This implies that the system eventually reaches the ground state of the original Ising model representing the solution to the combinatorial optimization problem. There exists a large body of analytical, numerical, and experimental studies on quantum annealing, and active debates are going on to compare quantum annealing with the corresponding classical heuristic, simulated annealing, recent examples of which include Refs. Boixo et al. (2014); Rønnow et al. (2014); Katzgraber et al. (2014); Hen et al. (2015); Heim et al. (2015); V. Isakov et al. (2015); Venturelli et al. (2015); Katzgraber et al. (2015); Steiger et al. (2015); Albash et al. (2015); Martin-Mayor and Hen (2015); Muthukrishnan et al. (2016); Kechedzhi and Smelyanskiy (2016); Denchev et al. (2016); Mandrà et al. (2016a); Marshall et al. (2016); Matsuda et al. (2009); Mandrà et al. (2016b); Crosson and Harrow (2016); Young et al. (2010); Hen and Young (2011); Farhi et al. (2012).

To numerically test the performance of quantum annealing, one often uses quantum Monte Carlo simulation, which is a classical algorithm to sample the equilibrium distribution of the transverse-field Ising model. Although the quantum Monte Carlo simulation is designed to sample the equilibrium Boltzmann distribution, it has been found that some aspects of dynamics of quantum annealing can also be described by quantum Monte Carlo simulations V. Isakov et al. (2015); Jiang et al. (2016); Denchev et al. (2016). Also remarkable are the generic convergence conditions for quantum annealing under quantum dynamics Morita and Nishimori (2007); Somma et al. (2007); Morita and Nishimori (2008) and quantum Monte Carlo simulations Morita and Nishimori (2006, 2008), both of which have a very similar asymptotic polynomial decrease of the control parameter that is much quicker than the corresponding inverse-log law for simulated annealing Geman and Geman (1984). These observations suggest the possibility that quantum annealing might be efficiently simulated on classical computers even for its dynamical aspects, the latter being important to judge the performance of quantum annealing. If this is indeed the case, the role of dedicated hardware to run quantum annealing may have to be reconsidered.

Related to the above observation is the concept of stoquastic Hamiltonians Bravyi et al. (2008). Loosely speaking, it is a class of Hamiltonians that can usually be simulated efficiently on classical computers because there is no sign problem in the standard classical implementation using the Suzuki-Trotter decomposition Suzuki (1976) ^{1}

There exist several studies related to this idea. Farhi et al. Farhi et al. (2002) investigated the effects of randomly generated non-stoquastic Hamiltonians in a variant of the infinite-range Ising model and found that a finite fraction of examples showed enhancement of performance compared to the stoquastic case. Crosson et al. Crosson et al. (2014) ran extensive numerical tests of hard MAX-2SAT problems by directly solving the Schrödinger equation for small-size systems. They concluded that additional terms, which make the Hamiltonian non-stoquastic, improve the success rate, although not decisively better than stoquastic cases. Hormozi et al. Hormozi et al. (2016) numerically studied the spin glass problem to find that non-stoquastic Hamiltonians have improved success probabilities for hard instances, possibly not by increasing the energy gap for strict adiabatic evolution but by promoting diabatic transitions. Seki and Nishimori Seki and Nishimori (2012, 2015) and Seoane and Nishimori Seoane and Nishimori (2012) used quantum statistical-mechanical techniques to analyze systematically the infinite-range Ising models with ferromagnetic as well as random interactions to conclude that additional terms, by which the Hamiltonian becomes non-stoquastic, sometimes reduce first-order quantum phase transitions in the stoquastic Hamiltonian to second-order transitions. This means an exponential enhancement of the efficiency, exponential in the system size, because second-order quantum phase transitions have the minimum energy gap that decreases polynomially as a function of the system size whereas first-order transitions have an exponentially small gap. Remember that the adiabatic theorem states that the time needed for a system to stay close to the instantaneous ground state is proportional to the inverse of a polynomial of the minimum energy gap Jansen et al. (2007); Lidar et al. (2009); Elgart and Hagedorn (2012).

The present article describes the findings in Refs. Seki and Nishimori (2012, 2015); Seoane and Nishimori (2012) from the viewpoint of possible enhancement of the efficiency by non-stoquastic Hamiltonians, which was not mentioned explicitly in those papers. Also explained is the effect of interactions of the system with its environment.

## Ii Ferromagnetic -spin model

The first problem to be discussed is the ferromagnetic -spin model with infinite-range interactions Seki and Nishimori (2012); Jörg et al. (2010),

(1) |

where is the component of the Pauli matrix at site , and is an integer. The ground state of this Ising Hamiltonian is doubly degenerate for even, and , and non-degenerate for odd, . This Hamiltonian (the cost function for combinatorial optimization) is a simple polynomial of the order parameter , and the steepest descent method readily finds the ground state. In this sense, the problem is easily solved classically. Our focus, however, is on how quantum annealing compares with its classical counterpart, simulated annealing, according to the criterion of ‘limited quantum speedup’ Rønnow et al. (2014) as well as on how a non-stoquastic Hamiltonian compares with its stoquastic counterpart.

In the present section, we consider the case with since the model in a transverse field has a second-order quantum phase transition and is therefore easy to solve already in the stoquastic case. We restrict ourselves to the subspace of without losing generality.

### ii.1 Simulated annealing

Simulated annealing is a classical heuristic to sample the Boltzmann distribution with the temperature decreasing from a very high value to zero Kirkpatrick et al. (1983). To understand the process theoretically for the present problem, it is convenient to see how the free-energy landscape behaves as a function of the order parameter at each given temperature. To this end, we write the partition function as

(2) |

where is the inverse temperature with the Boltzmann constant chosen to be 1 for simplicity. We have dropped a trivial prefactor in the above expression. The exponent in the integrand in the last line is the generalized free energy for given values of and . In the thermodynamic limit , the integral is evaluated by the saddle point method. The extremum condition of the exponent with respect to is . By eliminating using this equation, we obtain the Landau-type free energy per site as a function of ,

(3) |

As shown in Fig. 1, there exists a jump in the minimum as the temperature changes and hence the transition is of first order.

In simulated annealing, one should drive the system from a disordered state () to an ordered state over the free-energy barrier as the temperature is decreased. This takes an exponentially long time since the probability to go over the peak of the free-energy barrier is exponentially small, proportional to , where is the height of the barrier of the free energy per site at the transition temperature. Therefore, the present simple problem is hard to solve by simulated annealing. The existence of a first-order phase transition is the origin of the difficulty.

### ii.2 Quantum annealing with stoquastic Hamiltonian

What will happen if we apply quantum annealing to the same problem? The conventional choice of the transverse-field Ising model for quantum annealing has the Hamiltonian

(4) |

where is the time-dependent parameter to control the dynamical evolution of the system running from the initial value to the final with being the computation time. A typical example is . Equation (4) is a stoquastic Hamiltonian.

For our problem Hamiltonian of Eq. (1), Eq. (4) reads

(5) |

which can be expressed in terms of the normalized total spin operators,

(6) |

as

(7) |

The normalized total spin operators satisfy the commutation relation,

(8) |

Since the norm of those operators, defined as the largest absolute eigenvalue, is unity, the right-hand side of Eq. (8) vanishes in the thermodynamic limit . The same is true for other commutators of , and . It is also useful to remember that the total spin operator commutes with the Hamiltonian and therefore is conserved in the present -spin model. We are interested in the subspace with the largest value of the total spin, since we start quantum annealing in this subspace. For these reasons, we may regard the operators and as and components of a classical vector of unit length written as

(9) |

in the polar coordinate. Equation (5) then reduces to a classical energy, whose value per site is

(10) |

To minimize this energy, the angle is 0 if is odd, and or for even. We may thus drop and write

(11) |

As one sees in Fig. 2 for the case of , the minimum jumps from to at some .

The system has a first-order phase transition, and the energy gap between the ground state and the first excited state is expected to decrease exponentially as a function of the system size, which has indeed been shown to be the case explicitly in the present problem both analytically and numerically Jörg et al. (2010). This is a difficult situation for quantum annealing in its adiabatic formulation (adiabatic quantum computation Farhi et al. (2000, 2001)) because one should spend an exponentially long computation time to reach the correct ground state of the target Hamiltonian . The authors of Jörg et al. (2010) thus wrote legitimately that this is “a problem that quantum annealing cannot solve”.

One may wonder if the above analysis using a classical vector would properly describe the essential features of quantum annealing under the Hamiltonian Eq. (5). The answer is positive as far as the properties of phase transitions are concerned: Jörg et al used full quantum statistical-mechanical tools to reach the same conclusion as above Jörg et al. (2010). Quantum effects should be carefully taken into account if one wishes to fully understand the behavior of the energy gap for finite-size systems, as was done by Jörg et al Jörg et al. (2010), and to describe more subtle properties of the system around the phase transition and within the ferromagnetic phase Susa et al. (2016). However, the classical analysis is sufficient to predict the type of phase transitions in the thermodynamic limit. We take advantage of this observation in the next section for a non-stoquastic Hamiltonian.

It is also worth noticing that the performance of quantum annealing is comparable to that of simulated annealing discussed in the previous section, both of which should spend an exponentially long time to reach the ground state. In this sense, there is no ‘limited quantum speedup’ in the present case, according to the classification of Rønnow et al. (2014), although there may exist quantitative differences such as the difference in the coefficients of the exponent.

### ii.3 Quantum annealing with non-stoquastic Hamiltonian

We next study the non-stoquastic case with the Hamiltonian

(12) |

where is a parameter to control the strength of the additional term, the second term on the right-hand side (to be called the antiferromagnetic multiple- term), and is an integer. The parameter will later be chosen to be a function of . Notice that the coefficient of the second term is positive so that this term makes the Hamiltonian non-stoquastic. For , the above Hamiltonian reduces to the stoquastic Eq. (5)

Quantum annealing starts at ( arbitrary), in which case the Hamiltonian is the simple transverse field,

(13) |

just as in the stoquastic case of the previous section. Then one increases toward 1 and, at the same time, is increased toward 1 in an appropriate way as will be described later. The goal is at , where the final Hamiltonian is the target cost function,

(14) |

The analysis proceeds as before by the replacement of the normalized total spin operator with a classical unit vector. The energy per site is

(15) |

Two typical examples of the behavior of this energy at and are shown in Fig. 3 for and Fig. 4 for . The former is essentially the same as the stoquastic case () of Fig. 2 with a first-order phase transition at . The latter is drastically different with a second-order phase transition at .

This second-order transition point can be understood by a Landau-type expansion of the energy near ,

(16) |

A second-order phase transition takes place when the coefficient of the quadratic term vanishes according to the Landau theory Nishimori and Ortiz (2011), , which gives for . This second-order transition is masked by a first-order transition if the latter happens at a smaller , which is indeed the case for

Comparison of Figs. 3 and 4 suggests that the antiferromagnetic multiple- term in the Hamiltonian with a large amplitude ( close to 0) would change a first-order phase transition (for large ) to second order (small ), thus reducing the computation time drastically from exponential to polynomial as a function of the system size. Exhaustive studies have been carried out along this line Seki and Nishimori (2012); Seoane and Nishimori (2012). The results are positive for . Figures 5 and 6 show typical examples of the - phase diagrams.

Figure 5 is for , i.e. with interactions. For a fixed , the first-order transition at (stoquastic Hamiltonian) extends down to a smaller value of around the middle of the phase diagram, and then is replaced by a line of second order transitions that continues to and . The first order transition persists even after the second-order transition line branches out, and there exists a line of first-order transitions within the ferromagnetic phase. We have denoted those two ferromagnetic phases as F and F, though there is no qualitative difference between F and F. In this way, it has been established that a first-order phase transition in the stoquastic Hamiltonian at has been reduced to second order by the effects of the antiferromagnetic multiple- term with a relatively large amplitude, close to 0. Quantum annealing starts at and arbitrary (anywhere on the line at the bottom of the phase diagram) and ends at (the upper right corner of the phase diagram), and it is possible to choose a path connecting those points which avoids a first-order transition (i.e. to go only across the boundary between QP and F phases). In other words, the antiferromagnetic multiple- term, which represents strong quantum effects not to be simulated classically in the standard way, exponentially enhances the efficiency of quantum annealing.

The case of turns out to be an exception in that the first-order transition line persists down to . This fact may be interpreted in terms of the Landau theory of phase transitions that there would appear a cubic term in the Landau free energy for the cubic Hamiltonian with , which strongly enhances the possibility of first-order transition.

The case of in Fig. 6 is similar with a few minor differences. There exist two paramagnetic phases, denoted as QP and QP. The former has with magnetization vector and the latter with . The QP phase appears at the top left corner of the phase diagram, where the antiferromagnetic multiple- term dominates. The transition is of second order only between QP and F phases. The first-order transition line within the ferromagnetic phase between F and F extends toward QP at the upper left part of the phase diagram. For larger , this line reaches the phase boundary of the QP phase as seen for in Fig. 6. The two ferromagnetic phases, F and F, are then completely separated by a line of first-order transitions. It is therefore concluded for that a proper choice of annealing path makes it possible to reduce the first-order phase transition for the stoquastic case () to second order (smaller ) as long as is not too large. These features are shared by other values of , even similar to Fig. 5 and odd to Fig. 6.

Although the above analyses use only classical variables, it has been shown that quantum statistical-mechanical computations reproduce those phase boundaries quantitatively very faithfully in the thermodynamic limit Seki and Nishimori (2012); Seoane and Nishimori (2012). It has also been confirmed numerically that the energy gap as a function of the system size closes exponentially at first-order phase transitions and polynomially at second order transitions Seki and Nishimori (2012). We therefore conclude with confidence that the antiferromagnetic multiple- term in the Hamiltonian has the capacity to reduce the computational complexity drastically from exponential to polynomial for the present infinite-range ferromagnetic -spin model.

### ii.4 Quantum annealing under the influence of the environment

It is important to study how the environment affects the behavior of the system. One of the standard models to describe the interactions of the system with its environment is the following Hamiltonian Leggett et al. (1987), in which the spin degrees of freedom are coupled linearly with harmonic oscillators representing the environment,

(17) |

Here runs over all possible modes of harmonic oscillators, denotes the coupling strength, and is the frequency of mode . In this model Hamiltonian (17), the interactions with the environment are assumed to apply uniformly over all sites . Such a situation may exist when the correlation length of the environment is much larger than the linear size of the system Breuer and Petruccione (2002).

Following the previous analysis (see also Sinha and Dattagupta (2013)), we replace by the classical variable and rewrite Eq. (17) as

(18) |

where

(19) |

Let us define the spectral density of couplings as

(20) |

and assume super/normal/sub Ohmic dissipation with cutoff frequency Leggett et al. (1987)

(21) |

Super, normal, and sub Ohmic cases correspond, respectively, to , , and . We can then write the coefficient in Eq. (19) as

(22) |

where is the Gamma function.

Equation (18) reveals that the environment and the spin system are effectively decoupled and can be treated independently. Since we are interested in the ground state, the environment is simply in the vacuum. The effects of environment to the spin system have been taken into account as the term . If we consider for simplicity the case of , the environment coupled with the component of the system effectively reduces the coefficient of the antiferromagnetic multiple- term from to . This is detrimental to the performance of quantum annealing for the reason discussed in the previous section. On the other hand, if , the normalization of the vector implies that the final coupling term in Eq. (18) has a positive contribution to the antiferromagnetic multiple- term. Therefore the two types of couplings with the environment or ) give completely the opposite contributions. More detailed analyses will be given in a forthcoming paper.

## Iii Hopfield model

One may wonder if the above results for the -spin model would apply to more difficult problems. To answer this question, we have studied the Hopfield model Seki and Nishimori (2015), which has randomness in interactions and the ground state is non-trivial Amit et al. (1985a, b, 1987); Nishimori and Nonomura (1996). In the present section, we compare quantum annealing strategies with and without an antiferromagnetic multiple- term in the Hamiltonian, i.e. non-stoquastic and stoquastic Hamiltonians, for the Hopfield model.

### iii.1 Finite patterns embedded

The Hopfield model with -body interactions has the Hamiltonian

(23) |

where

(24) |

with each (representing the state of the th site for the th embedded pattern) being randomly with equal probability. The total non-stoquastic Hamiltonian has the same form as before,

(25) |

The antiferromagnetic multiple- term has been chosen to be quadratic ( in the notation of the previous section) for simplicity. We first discuss the case with the number of embedded patterns finite.

It is impossible to apply the simple classical method used in the -spin ferromagnetic model because of the complexity of interactions. Quantum statistical-mechanical techniques have been exploited in Seki and Nishimori (2015), by which the quantum system is reduced to a corresponding classical Ising model by the Suzuki-Trotter decomposition. We refer the reader to Seki and Nishimori (2015) for details and write the resulting energy per site as a function of the order parameters,

(26) |

where the square brackets stand for the average over the random variables . Notice that the index of has disappeared in the above equation due to the infinite-range (mean-field) characteristics of the Hopfield model.

The parameter has the same meaning as in the -spin ferromagnetic model, the component of the averaged spin operator. The other parameter represents the overlap (or similarity) of the component of the Pauli matrix with the th embedded pattern,

(27) |

where the angular brackes denote the average by the ground-state wave function.

The energy of Eq. (26) is to be minimized with respect to the order parameters and . There exist a large number of candidate states that are the solutions to the self-consistent equation obtained as the vanishing condition of the derivatives of the energy with respect to the order parameters. It is known in the classical Hopfield model () at finite temperatures that the simplest non-trivial solution, and , has the lowest free energy and is realized at low temperatures, in addition to the paramagnetic solution (all ) valid at high temperatures Amit et al. (1985a). Almost the same turns out to be the case in the quantum Hopfield model Nishimori and Nonomura (1996); Seki and Nishimori (2015), the trivial differences being that the energy, not the free energy, is to be minimized and that the quantum paramagnetic state has .

When only is finite with all other ’s being zero, the energy Eq. (26) turns out to have exactly the same form as the corresponding energy of the -spin ferromagnetic model analyzed by the quantum statistical-mechanical methods. Thus the analyses of the previous section apply directly. This is the same situation as in the classical Hopfield model Amit et al. (1985a). We may then conclude that the antiferromagnetic multiple- term helps the Hopfield model avoid first-order phase transitions in the process of quantum annealing exactly in the same way as in the -spin ferromagnetic system. It has thus been established that the antiferromagnetic multiple- term exponentially improves the efficiency of quantum annealing even in the presence of randomness in interactions.

### iii.2 Many numbers embedded (I)

When , the number of patterns embedded, increases with the system size , the situation becomes dependent on . We discuss the case of in this section.

When and is supposed to increase with , turns out to be proportional to , , in order for the free energy to be extensive. Under this condition, the free energy for arbitrary temperature can be evaluated using the standard techniques from quantum statistical mechanics, the Suzuki-Trotter decomposition, the replica method under replica-symmetric ansatz, and the static approximation to drop the Trotter-number dependence of order parameters Nishimori and Nonomura (1996); Seki and Nishimori (2015). The resulting free energy per site in the zero-temperature limit (the ground state energy) is

(28) |

where

(29) | ||||

(30) |

with . The parameters denote the overlap, the spin glass order parameter, and the magnetization along the axis,

(31) |

It has been assumed that the solution with only one of the embedded patterns being retrieved is more stable than other possibilities, as in the case of the classical Hopfield model Amit et al. (1985a, b, 1987).

Extremization conditions of with respect to and and comparison of energy values among different solutions lead to the phase diagram of Fig. 7.

There exist three phases, quantum paramagnetic (QP) (), spin glass (SG) (), and retrieval (R) (). In the stoquastic case with , it is known that the phase transition between the spin glass and retrieval phases is of first order Nishimori and Nonomura (1996). As shown in Fig. 7, this first-order transition persists even when an antiferromagnetic multiple- term is introduced down to . It is impossible to reach the final state through a path that avoids a first-order transition starting from the initial state with . The spin-glass phase covering the middle of the phase diagram causes an essential difficulty in the present case ^{2}

### iii.3 Many numbers embedded (II)

We next discuss the case of . Again, the standard quantum statistical-mechanical method can be applied to the analysis of the model with Seki and Nishimori (2015). Since the computations are straightforward but quite lengthy, we refer the reader to Seki and Nishimori (2015) for details ^{3}

(32) |

where

(33) |

The extremization condition of the energy leads to a set of self-consistent equations for the order parameters, the solutions to which indicate possible phases at each point in the - phase diagram. It turns out that the spin glass phase always has a higher energy than other phases, the retrieval phase and the paramagnetic phase, and is not realized as a stable phase for . The transition between the retrieval and paramagnetic phases for the stoquastic model () is of first order. The introduction of the antiferromagnetic multiple- term () leads to replacement of this first-order transition by a second-order transition below a threshold value of provided that . An example of is depicted in Fig. 8.

For , the first-order transition continues to exist up to as was the case without randomness.

We have therefore established that the antiferromagnetic multiple- term has the effect of drastically enhancing the computational efficiency even in some cases with randomness.

## Iv Conclusion

We have shown that antiferromagnetic multiple- terms reduce a first-order quantum phase transition to second order in the infinite-range ferromagnetic -spin model as well as in the quantum Hopfield model. This means that the efficiency of quantum annealing in its formulation as adiabatic quantum computation is exponentially enhanced by the antiferromagnetic multiple- term, which renders the Hamiltonian non-stoquastic. Although not shown explicitly in the present article, it has been confirmed numerically for the ferromagnetic -spin model in Seki and Nishimori (2012) that the minimum gap at the phase transition indeed closes exponentially or polynomially according to the order of phase transition. It is reasonable to expect that the same holds for the Hopfield model. Since a non-stoquastic Hamiltonian cannot be simulated efficiently on classical computers in the standard quantum Monte Carlo simulation, it may be interpreted to represent strong quantum effects. We may therefore conclude that the exponential enhancement of the efficiency for quantum annealing is achieved in the present models by strong quantum effects. These are the first cases, as far as the authors are aware of, where such a conclusion has been drawn by analytical methods. Notice in this relation that numerical evidence of related nature was presented in Farhi et al. (2002); Crosson et al. (2014); Hormozi et al. (2016). Our conclusion does not necessarily exclude the existence of other efficient numerical methods to study a given non-stoquastic Hamiltonian including, possibly, the spin-vector dynamics Smolin and Smith (2014); Albash et al. (2015); Owerre and Paranjape (2014); Muthukrishnan et al. (2016) or even the simple steepest descent method.

We have also shown for the ferromagnetic -spin model that certain types of system-environment couplings either enhance or reduce the effect of the antiferromagnetic multiple- term depending on the component of spin operators appearing in the coupling term. The argument leading to this conclusion crucially depends on the special property of the ferromagnetic -spin model that the spin Hamiltonian commutes with the total spin operator. It is an interesting question whether or not similar behavior can be observed in other cases.

It should be remembered that antiferromagnetic multiple- terms discussed in the present paper are far from versatile to enhance the efficiency. Indeed, the first-order transitions in the ferromagnet with and the Hopfield model with have been shown not to be relaxed to second order. It has also been known that the first-order transition in the -body interacting random-field Ising model persists in the presence of antiferromagnetic multiple- terms if the distribution of random field is bimodal Ichikawa (2014).

One may wonder if there is any other way to show that an antiferromagnetic multiple- term indeed represents strong quantum effects by a more direct method, not via the impossibility of the standard quantum Monte Carlo technique. We are now investigating this problem, and the result will soon be published Susa et al. (2016). One of the hints may lie in the sign of coefficients of the ground-state wave function in the standard computational basis. For a stoquastic Hamiltonian, the coefficients can be chosen to be all non-negative, according to the Perron-Frobenius theorem. This leads to the natural interpretation of the (squared) magnitude of a coefficient as the probability. If, in contrast, the Hamiltonian is non-stoquastic, some of the coefficients can be negative or even complex, and the conventional interpretation of the squared absolute value of the coefficient as the probability does not necessarily fit very well to our (classical) intuition. Whether or not this fact suggests strong quantum effects needs further scrutiny.

It is an interesting question how far the present results for the infinite-range fully-connected models apply to more realistic problems with relatively sparse connections, e.g. a problem on a finite-dimensional lattice with short-range interactions. It is of course difficult to say something with confidence without explicit evidence. Nevertheless, our experience in the physics of phase transitions suggests that a mean-field analysis often provides reliable results also for finite-dimensional systems with a finite number of connections per site as far as qualitative descriptions are concerned Nishimori and Ortiz (2011). It would come as a surprise if this general rule of thumb does not apply to the present case. It is worth an effort to investigate if and how antiferromagnetic multiple- terms widen the energy gap in systems with finite connections. We are studying a related problem, and the results will be published before too long Okuyama et al. (2016).

###### Acknowledgements.

Most of the technical results described in this article appeared in Refs. Seki and Nishimori (2012, 2015); Seoane and Nishimori (2012) albeit from a little different viewpoint than presented here. One of the authors (H.N.) sincerely thanks Yuya Seki and Beatriz Seoane for stimulating collaboration. Also acknowledged are useful comments by Tameem Albash, Jacob Biamonte, Eddie Farhi, Itay Hen, Layla Hormozi, Helmut Katzgraber, and Daniel Lidar. This work was funded by the ImPACT Program of Council for Science, Technology and Innovation, Cabinet Office, Government of Japan, and by the JPSJ KAKENHI Grant No. 26287086.### Footnotes

- It is to be noticed that, in some cases, it is non-trivial to efficiently simulate a stoquastic Hamiltonian. See, for example, Hastings and Freedman (2013); Jarret et al. (2016).
- It has been pointed out in Knysh (2016) that a different type of difficulty exists within the spin glass phase of the Hopfield model when the random variables are Gaussian-distributed, not binary as in the present paper.
- Notice that the replica symmetric ansatz Nishimori (2001) is used in the calculations. Our experience in the simple quantum Hopfield model in a transverse field suggests that the replica symmetry breaking takes place only in a very limited region in the phase diagram Nishimori and Nonomura (1996), and we expect it to be reasonable to assume a similar situation in the present case as well.

### References

- T. Kadowaki and H. Nishimori, Phys. Rev. E 58, 5355 (1998).
- T. Kadowaki, Ph.D. thesis, Tokyo Institute of Technology (1998), arXiv:quant-ph/0205020.
- J. Brooke, D. Bitko, T. F. Rosenbaum, and G. Aeppli, Science 284, 779 (1999).
- E. Farhi, J. Goldstone, S. Gutmann, and M. Sipser (2000), eprint arXiv:quant-ph/0001106.
- E. Farhi, J. Goldstone, S. Gutmann, J. Lapan, A. Lundgren, and D. Preda, Science 292, 472 (2001).
- G. E. Santoro and R. Marton, Science 295, 2427 (2002).
- G. E. Santoro and E. Tosatti, J. Phys. A: Math. Gen. 39, R393 (2006).
- A. Das and B. Chakrabarti, Rev. Mod. Phys. 80, 1061 (2008).
- S. Morita and H. Nishimori, J. Math. Phys. 49, 125210 (2008).
- A. Lucas, Frontiers in Phys. 2, 1 (2014).
- S. Boixo, T. F. Rønnow, S. V. Isakov, Z. Wang, D. Wecker, D. A. Lidar, J. M. Martinis, and M. Troyer, Nature Physics 10, 218 (2014).
- T. F. Rønnow, Z. Wang, J. Job, S. Boixo, S. V. Isakov, D. Wecker, J. M. Martinis, D. A. Lidar, and M. Troyer, Science 345, 420 (2014).
- H. G. Katzgraber, F. Hamze, and R. S. Andrist, Phys. Rev. X 4, 021008 (2014).
- I. Hen, J. Job, J. Job, M. Troyer, and D. A. Lidar, Phys. Rev. A 92, 042325 (2015).
- B. Heim, T. F. Rønnow, S. V. Isakov, and M. Troyer, Science 348, 215 (2015).
- S. V. Isakov, G. Mazzola, V. N. Smelyanskiy, Z. Jiang, S. Boixo, H. Neven, and M. Troyer (2015), eprint arXiv:1510.08057.
- D. Venturelli, S. Mandrà, S. Knysh, B. O’Gorman, R. Biswas, and V. Smelyanskiy, Phys. Rev. X 5, 031040 (2015).
- H. G. Katzgraber, F. Hamze, Z. Zhu, A. J. Ochoa, and H. Munoz-Bauza, Phys. Rev. X 5, 031026 (2015).
- D. S. Steiger, T. F. Rønnow, and M. Troyer, Phys. Rev. Lett. 115, 230501 (2015).
- T. Albash, T. Rønnow, M. Troyer, and D. Lidar, Euro. Phys. J. Special Topics 224, 111 (2015).
- V. Martin-Mayor and I. Hen, Sci. Rep. 5, 15324 (2015).
- S. Muthukrishnan, T. Albash, and D. A. Lidar, Phys. Rev. X 6, 031010 (2016).
- K. Kechedzhi and V. N. Smelyanskiy, Phys. Rev. X 6, 021028 (2016).
- V. S. Denchev, S. Boixo, S. V. Isakov, N. Ding, R. Babbush, V. Smelyanskiy, J. Martinis, and H. Neven, Phys. Rev. X 6, 031015 (2016).
- S. Mandrà, Z. Zhu, W. Wang, A. Perdomo-Ortiz, and H. G. Katzgraber, Phys. Rev. A 94, 022337 (2016a).
- J. Marshall, V. Martin-Mayor, and I. Hen, Phys. Rev. A 94, 012320 (2016).
- Y. Matsuda, H. Nishimori, and H. G. Katzgraber, New J. Phys. 11, 073021 (2009).
- S. Mandrà, Z. Zhu, and H. G. Katzgraber (2016b), eprint arXiv:1606.07146.
- E. Crosson and A. W. Harrow (2016), eprint arXiv:1601.03030.
- A. P. Young, S. Knysh, and V. N. Smelyanskiy, Phys. Rev. Lett. 104, 020502 (2010).
- I. Hen and A. P. Young, Phys. Rev. E 84, 061152 (2011).
- E. Farhi, D. Gosset, I. Hen, A. W. Sandvik, P. Shor, A. P. Young, and F. Zamponi, Phys. Rev. A 86, 052334 (2012).
- Z. Jiang, V. N. Smelyanskiy, S. V. Isakov, S. Boixo, G. Mazzola, M. Troyer, and H. Neven (2016), eprint arXiv:1603.01293.
- S. Morita and H. Nishimori, J. Phys. Soc. Jpn. 76, 064002 (2007).
- R. Somma, C. Batista, and G. Ortiz, Phys. Rev. Lett. 99, 030603 (2007).
- S. Morita and H. Nishimori, J. Phys. A: Math. Gen. 39, 13903 (2006).
- S. Geman and D. Geman, IEEE Trans. Pattern Analy. Mech. Intell. PAMI-6, 721 (1984).
- S. Bravyi, D. P. Di Vincenzo, R. Oliveira, and B. M. Terhal, Quanum Inf. Comput. 8, 361 (2008).
- M. Suzuki, Prog. Theor. Phys. 56, 1454 (1976).
- J. Biamonte and P. Love, Phys. Rev. A 78, 012352 (2008).
- E. Farhi, J. Goldstone, and S. Gutmann (2002), eprint arXiv:0208135.
- E. Crosson, E. Farhi, C. Y.-y. Lin, H.-h. Lin, and P. Shor (2014), eprint arXiv:1401.7320.
- L. Hormozi, E. W. Brown, G. Carleo, and M. Troyer (2016), eprint arXiv:1609.06558.
- Y. Seki and H. Nishimori, Phy. Rev. E 85, 051112 (2012).
- Y. Seki and H. Nishimori, J. Phys. A: Math. Theor. 48, 335301 (2015).
- B. Seoane and H. Nishimori, J. Phys. A: Math. Theor. 45, 435301 (2012).
- S. Jansen, M.-B. Ruskai, and R. Seiler, J. Math. Phys. 48, 102111 (2007).
- D. A. Lidar, A. T. Rezakhani, and A. Hamma, J. Math. Phys. 50, 102106 (2009).
- A. Elgart and G. A. Hagedorn, J. Math. Phys. 53, 1020 (2012).
- T. Jörg, F. Krzakala, J. Kurchan, A. C. Maggs, and J. Pujos, EPL 89, 40004 (2010).
- S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi, Science 220 (1983).
- Y. Susa, J. F. Jadebeck, and H. Nishimori (2016), eprint arXiv:1612.08265.
- H. Nishimori and G. Ortiz, Elements of Phase Transitions and Critical Phenomena (Oxford University Press, 2011).
- A. J. Leggett, S. Chakravarty, A. T. Dorsey, M. P. A. Fisher, A. Garg, and W. Zwerger, Rev. Mod. Phys. 59, 1 (1987).
- H.-P. Breuer and F. Petruccione, The Theory of Open Quantum Systems (Oxford University Press, 2002).
- S. Sinha and S. Dattagupta, Euro. Phys. J. B 86, 96 (2013).
- D. J. Amit, H. Gutfreund, and H. Sompolinsky, Phys. Rev. Lett. 55, 1530 (1985a).
- D. J. Amit, H. Gutfreund, and H. Sompolinsky, Phys. Rev. A 32, 1007 (1985b).
- D. J. Amit, H. Gutfreund, and H. Sompolinsky, Ann. Phys. 67, 30 (1987).
- H. Nishimori and Y. Nonomura, J. Phys. Soc. Jpn. 65, 3780 (1996).
- J. A. Smolin and G. Smith, Front. Phys. 2, 52 (2014).
- S. A. Owerre and M. B. Paranjape, Phys. Rep. 546, 33 (2014).
- T. Ichikawa, Master’s thesis, Tokyo Institute of Technology (2014).
- M. Okuyama, K. Nishimura, and H. Nishimori, in preparation (2016).
- M. B. Hastings and M. Freedman, Quantum Inf. Comp. 13, 1038 (2013).
- M. Jarret, S. P. Jordan, and B. Lackey (2016), eprint arXiv:1607.03389.
- S. Knysh, Nature Commun. 7, 12370 (2016).
- H. Nishimori, Statistical Physics of Spin Glasses and Information Processing: An Introducion (Oxford University Press, 2001).