# Order in a Spatially Anisotropic Triangular Antiferromagnet

## Abstract

The phase diagram of the spin-1/2 Heisenberg antiferromagnet on an anisotropic triangular lattice of weakly coupled chains, a model relevant to CsCuCl, is investigated using a renormalization group analysis which includes marginal couplings important for connecting to numerical studies of this model. In particular, the relative stability of incommensurate spiral spin density order and collinear antiferromagnetic order is studied. While incommensurate spiral order is found to exist over most of the phase diagram in the presence of a Dzyaloshinskii-Moriya (DM) interaction, at small interchain and extremely weak DM couplings, collinear antiferromagnetic order can survive. Our results imply that CsCuCl is well within the part of the phase diagram where spiral order is stable. The implications of the renormalization group analysis for numerical studies, many of which have found spin-liquid like behavior, are discussed.

## I Introduction

Frustrated magnets are of considerable interest because of their potential for exhibiting novel ground states in two or higher dimensions.?; ?; ? The spin-1/2 Heisenberg antiferromagnet (HAF) on an anisotropic triangular lattice is a particularly well-studied model of frustrated magnetism and is relevant to CsCuCl, a material whose neutron spectrum has been taken as evidence for close proximity to a two-dimensional spin liquid phase.Coldea *et al.* (2003, 2001); Isakov *et al.* (2005) Below 0.6K, CsCuCl orders into an incommensurate spiral spin density state and is well described by the spin-1/2 HAF on a triangular lattice, with interchain diagonal exchange weaker than the intrachain exchange , although weak interlayer and Dzyaloshinskii-Moriya (DM) interactions also play a role in stabilizing the ordered state.

The spiral phase with ordering wave vector is the classical ground state for the HAF on a triangular lattice for all . It is well established that the nearly isotropic () spin-1/2 HAF exhibits spiral order that smoothly connects to the three sublattice Néel order at =. Several studies have proposed that, as is further reduced, quantum fluctuations destroy this order and stabilize a two-dimensional spin liquid phase.Alicea *et al.* (2006); Weng *et al.* (2006); Chung *et al.* (2001); Isakov *et al.* (2005); Yunoki and Sorella (2006); Shen and Zhang (2002); Hauke *et al.* () Although this model is in proximity to a one-dimensional spin liquid (=), it lacks the features typically associated with possible spin liquid order in higher than one dimension. That is, it neither exhibits macroscopic degeneracy of the classical ground state, as occurs for Kagome or pyrochlore lattices, nor substantial ring exchange, as occurs near a metal-insulator transition. Nevertheless, essentially all calculations show that the quantum fluctuations are unusually large and the local moment has been estimated to go to zero for as large as .Hauke *et al.* (); Dalidovich *et al.* (2006); Heidarian *et al.* (2009); Reuther and Thomale (2011)

While it has typically been assumed that the loss of spiral order signals the appearance of a quantum disordered state, Starykh and Balents,Starykh and Balents (2007) using a renormalization group (RG) approach, found a collinear antiferromagnetic (CAF) state stabilized at small .Starykh and Balents (2007); Starykh *et al.* (2010) They identified quantum fluctuations of order that couple second nearest-neighbor (nn) chains antiferromagnetically, leading to CAF order, whereas a ferromagnetic second nn chain interaction would be compatible with spiral order. This result is surprising since, although quantum fluctuations will typically select a specific state from a degenerate manifold of classical ground states, it is unusual for fluctuations to stabilize an ordered state of higher classical energy.? This order is rather subtle since it is only selected at , so numerical studies taken as evidence for spin-liquid behavior may also be compatible with such order, as well as with spiral order which is strongly renormalized by quantum fluctuations. Exponentially weak spiral order has been predicted within a random phase approximationBocquet *et al.* (2001) which does not include the antiferromagnetic fluctuations identified in Ref. Starykh and Balents, 2007. Numerical studies on multi-leg ladders find incommensurate spiral correlations with a wavelength which is strongly renormalized from the classical value and smaller than the finite system size for .Weichselbaum and White () This provides evidence for an incommensurate spiral ground state in this range of , but one would need to study even larger systems for smaller since the spiral wavelength, , is expected to grow rapidly with decreasing .

Calculations that directly compare the energies of the CAF and spiral states have given conflicting results. Pardini and Singh,Pardini and Singh (2008) using linked cluster series expansions, found that the spiral phase, with a variational ordering wave vector, appears to have lower energy than the collinear state for . They also found the ordered moment vanished rapidly with decreasing , as expected for either ordered state. By contrast, a coupled cluster method yielded a lower energy for the CAF state for , although this method was unable to capture the vanishing moment.Bishop *et al.* (2009); Bishop and Li (2010) Neither method is strictly variational, making direct comparisons of the energies difficult to interpret, as discussed in Ref. Pardini and Singh, 2008. Nevertheless, both methods show that the energy difference between these two states at small is significantly smaller than the energy scale set by quantum fluctuations, i.e., than the difference between the classical and quantum energies.

Here, we reexamine the RG approach of Ref. Starykh and Balents, 2007, but rather than starting by integrating out every second chain as was done in Ref. Starykh and Balents, 2007, we adhere more strictly to the real-space RG method and keep quantum fluctuations of . These are generated by marginal (and irrelevant) couplings and are not expected to order the system as . However, these fluctuations dominate the energy and are important for interpreting numerical results as they extend over an unusually large length scale (which diverges as ). Surprisingly, these are of the opposite sign to the fluctuations responsible for CAF ordering. Thus, our RG analysis elucidates the competition between spiral and CAF order. We also present numerical studies that show that ferromagnetic fluctuations dominate at all , and, consistent with the RG analysis, these fluctuations only grow weakly with system size for small systems.

The remainder of this paper is organized as follows. The model and RG equations is presented in Sec. II and the general RG flows and resulting ground states for varying initial conditions are discussed in Sec. III. Section IV discusses the specific initial conditions appropriate for the Heisenberg model and the resulting RG analysis. The crossover from CAF to spiral order with increasing is also discussed in Sec. IV. Numerical studies of this system are presented in Sec. V and compared to the RG results, while Sec. VI considers the effect of a weak Dzyaloshinskii-Moriya interaction. A summary and discussion of the results are given in Sec. VII. An approximate analytic solution to the RG equations, used in the analysis of the numerical studies, is given in Appendix.

## Ii Model and RG Equations

Here, we derive the RG equations following an approach similar to Ref. Starykh and Balents, 2007, but starting from short length scales and including marginal couplings and fluctuations of in order to connect to finite size studies and to study the relative stability of collinear, spiral and dimer ordered states, as summarized in Fig. 1. Our starting point is the Hamiltonian:

(1) | |||||

where indexes sites on the horizontal chains, is the chain label, and and are, respectively, intra- and interchain couplings as shown in Fig. 1a. The last term in Eq. (1) is the interchain DM interaction, where .Dalidovich *et al.* (2006); Starykh *et al.* (2010)

We first consider the case =. The continuum approximation is made for the horizontal chains, while the other direction is kept discrete. The spin operators are written in terms of the uniform and staggered magnetizations: Shelton *et al.* (1996) , where the subscript indexes the chains, and we use the sign convention shown in Fig. 1a.

The Hamiltonian for each chain is the Wess-Zumino-Novikov-Witten (WZNW) SU(2) model which defines the fixed point of decoupled chains, perturbed by intrachain backscattering, with coupling :Affleck (1985)

(2) |

The interchain part of in the continuum limit becomes:

(3) | |||||

where ellipses indicate irrelevant terms with more derivatives. is the sum of the left- and right-moving currents, and , which have scaling dimension , so and backscattering both have scaling dimension and are marginal. The scaling dimension of is and, therefore, that of the twist term (with coupling ) is .

In addition to the above couplings, there are two relevant and two marginal interactions that are not prohibited by any of the symmetries of this model:
and
with scaling dimension , and
and
with dimension . is the staggered dimerization operator and has scaling dimension .Gogolin *et al.* (1999)
Third and further nn chain couplings can be ignored for small because of their much smaller initial values.

The theory is regularized by imposing a short distance cutoff for how close to each other the operators that perturb can be. Real-space RG along is then conveniently performed using operator product expansions (OPE) of the above interaction terms at separate space-time points and integrating over short relative spatial and temporal separations.Tremblay and Bourbonnais (2003); Starykh *et al.* (2005) The OPEs of chiral currents can be directly derived from the OPEs of chiral fermion fields, but the correct OPEs of and require bosonization.Shelton *et al.* (1996) Neglecting terms of and higher, the -functions for the relevant and marginal coupling constants are: ?

(4) | |||||

(5) | |||||

(6) | |||||

(7) | |||||

(8) | |||||

(9) | |||||

(10) | |||||

(11) |

All couplings are scaled by , and , so that , where is the physical length and is the initial length scale, which has been set equal to one in the above equations. Equations. (9)-(11) are only brought in because these couplings affect the initial values of more relevant couplings. is the coupling for the interaction term , and is that of . Both of these are irrelevant couplings with scaling dimensions 3 and 4. The -functions of and only describe the renormalization of the interchain backscattering part of (coupling between currents with opposite chiralities) which also are the parts that enter in the other -functions.

The -functions of Ref. Starykh and Balents, 2007 differ from Eqs. (4)-(8) in that only the first three terms in the -functions for and [in Eqs. (6)-(7)] were included in Ref. Starykh and Balents, 2007 and the renormalization of marginal couplings other than were not considered. , in particular, is needed to interpret the numerical results and to study the relative stability of the spiral and collinear AF states. As discussed below, the term in Eq. (6) is not expected to order the system, but describes the dominant fluctuations at short and intermediate distances and is important for interpreting numerical results on finite systems. The key RG equations for our study are Eqs. (4)-(6).

## Iii General RG flows

At the lattice scale, only couplings present in the bare Hamiltonian, , , ? are nonzero. Integrating out short wavelength fluctuations up to the initial length scale (larger than but comparable to the lattice spacing) generates all couplings allowed by symmetry, in particular, the two relevant couplings, and . Once generated, these couplings tend to grow exponentially in (or linearly in ) while the marginal and irrelevant couplings grow at most logarithmically with . It follows from Eqs. (6) and (7) that, in the presence of negative backscattering, grows faster than . Therefore, for small , the value of largely determines the fate of the system, as it will reach one (or in unscaled units) at some length scale, , while the other couplings will remain much smaller.

If is positive (i.e., antiferromagnetic), it follows from Eq. (6), that remains positive and flows to +1 at some . In this case, second nn chains will order antiferromagnetically. This is the result found in Ref. Starykh and Balents, 2007, where every second chain was integrated out to give , where is a normalization factor. The CAF state is then stabilized for small , by the order-from-disorder mechanism, when one includes the effect of .Starykh and Balents (2007)

However, numerics on finite systems show that second nn chains are coupled ferromagnetically, not antiferromagnetically as implied by . Figure 2 shows the interchain Neel susceptibility, where a small finite staggered magnetic field is applied to one chain and the response of the second neighbor chain is calculated using exact diagonalization (ED) for three chains of length 12 sites or less, with open boundary conditions. For a staggered field, , along , the response , where site is one of the center sites on the chain, is calculated. This response is the interchain Neel susceptibility,

(12) |

It is found that aligns ferromagnetically with the second neighbor chain for all , as well as for small . , which is discussed further in Sec. V below, is analytic in the couplings and, for small , is proportional to to leading order. Therefore, it follows from these ED results that , where , and are all ferromagnetic and, in fact, ferromagnetic fluctuations dominate in these systems of up to 36 spins. calculated for four chains with periodic boundary conditions applied perpendicular to the chains (along ) yields exactly the same quadratic and cubic terms and a larger ferromagnetic quartic term. The difference in the quartic term is due to the longer range analog of which couples third neighbor chains and is not included in the above RG equations as it has no qualitative effect on the running couplings. dum ()

The calculated is sensitive to boundary conditions for small systems. Periodic boundary conditions (PBC) along the chains (along ) frustrate spiral correlations generated by , which we will see in the next section are connected to ferromagnetism. Indeed, for the small systems studied with PBC along (up to 30 spins, not shown here) we found is of order and has the opposite sign to the data in Fig. 2. However, the fact that spins and for small are coupled ferromagnetically at order and the higher one is independent of the boundary condition and is seen even in small systems with PBC along . In particular, is always positive irrespective of the boundary condition. This implies that . In fact, for open boundary conditions, our ED studies find that is positive for all , all systems sizes and values studied ().

It follows from the RG equations that for , can be either negative or positive, depending on the precise value of . In this case, the flow of is sensitive to the magnitude of the initial value due to the competition between and terms in Eq. (6) that drive antiferromagnetic. This sensitivity to initial conditions can be seen by numerically studying the RG flows for an initial as the constant is varied. Here, we use bare values (i.e., values at the lattice scale) for the initial values of the other couplings. RG flows are shown in Fig. 3 for . For , one finds that flows to 1 (strong antiferromagnetic coupling) and remains small, while for , flows to -1 (strong ferromagnetic coupling) and increases marginally. As discussed below, signals spiral order, whereas signals CAF order as studied by Starykh and Balents.Starykh and Balents (2007) However, as seen in the inset of Fig. 3 for , even in the case of CAF order, the initial RG flows can display increasing ferromagnetic coupling between second nn chains. In Sec. IV, it will be shown that this is the case for the Heisenberg model. In a narrow range for (which widens as is increased), the growth of is hindered and , or reach unity first. This crossover value, , depends on and . Depending on initial conditions, columnar or staggered dimerizations or more complicated incommensurate states can be stabilized in this crossover region, as denoted by the shaded area in Fig. 1b.

In the ferromagnetic regime where grows exponentially to negative values (), sites along the direction align, consistent with zero component of the ordering wave vector. In this regime, , which stabilizes spiral order, grows marginally. In the classical limit, the ordering wave vector is for . The effect of quantum fluctuations on , or , can be determined from the RG analysis. The most robust spiral state occurs if ferromagnetism is selected at quadratic order in . The length scale, , at which becomes comparable to in magnitude is inversely proportional to the initial value of which, in turn, is in this case. Since changes logarithmically and remains negative as grows, at this length scale, we expect almost the same intrachain Hamiltonian but with a somewhat renormalized . This Hamiltonian describes interactions between blocks of Néel-ordered spins of length and can be treated classically. Thus, the ground state has a spiral order with . Since for small , the pitch of the spiral is much longer than the Neel blocks and this treatment is justified. This is a significant renormalization of the ordering wave vector toward the 1D limit of , where spins on neighboring antiferromagnetic chains are oriented at with respect to each other and requires that ferromagnetism is selected at quadratic order.

Even more fragile spiral order is stabilized if and ferromagnetism is selected at cubic or quartic order in . Then , where (or 5) for cubic (or quartic) selection. The exponentially weak spiral order, found within a random phase approximation,Bocquet *et al.* (2001) also follows from the RG equations if one assumes that neither nor can grow. To leading order in , Eq. (5) describes this exponentially weak spiral order, where if the value at is used. However, since there is no symmetry that prevents (or ) from growing at all orders, one does not expect an exponentially weak spiral order to be stable for very small .

As increases, even for initial conditions that favor antiferromagnetism, , the RG flows move toward increasing , i.e., toward the spiral state. This is because is boosted by both backscattering and . The latter enhances the spiral incommensuration, , so it is larger than . For the Heisenberg model, where is sufficiently negative to suppress the growth of relative to , the competition is predominantly between the CAF and the spiral states. If a sufficiently strong frustrating second nn interaction along the chains is added to the Hamiltonian, the competition is then between the CAF and dimerized phases as discussed in Ref. Starykh and Balents, 2007.

## Iv Initial Conditions and RG Results

It follows from the above discussion of the RG flows that it is important to determine accurately. Numerics on small systems clearly show that is ferromagnetic, whereas Eq. (6) would naively predict that . In fact, only antiferromagnetism appears to enter the RG equation for to all orders in . This would imply not only that spins on second neighbor chains are always antiferromagnetically ordered, but that the dominant fluctuations at all length scales are antiferromagnetic. Actually, one sees how second neighbor chains can be coupled ferromagnetically by considering the effect of a twist in one chain on spins in neighboring chains. Treating as perturbations to the decoupled 1D chains, one finds in second order that fluctuations in the -th chain generate a local ferromagnetic coupling, . Although the static twist is small, the fluctuation can be , mediating an interaction of order .

The peculiar behavior where the sign of the quantum correction for depends strongly on scale can also be seen in the continuum theory, once the theory is regularized. The OPE between two twist terms generates a term in the effective action:

(13) |

Here , and is larger than but comparable to the lattice spacing. The integrand in Eq. (13) is positive for , which generates the ferromagnetic initial condition for , but becomes negative for , favoring antiferromagnetic correlation at longer lengths.

The presence of a ferromagnetic coupling at short distances is very general and independent of the specific regularization scheme: it simply follows from the fact that in Eq. (13) is a total derivative which integrates to zero and is negative at large distances. The presence of this total derivative implies that this term does not contribute at in a gradient expansion and, consequently, is not expected to order the system.? For example, if one fully integrates out every second chain to generate effective couplings between second nn chains, as was done in Ref. Starykh and Balents, 2007, this term vanishes. This implies that the initial value of at quadratic order must be such as to cancel the effect of in the -function in the limit. This places constraints on the initial conditions that are discussed below. In general, however, , where and are all negative (i.e., ferromagnetic). The cubic and quartic contributions to the initial condition are related to the quadratic and cubic contributions in the beta function for .

We note here that the term in the -function for is not the only term that contributes ferromagnetism at short length scales. For example, the longer range analog of and irrelevant couplings such as (or even higher derivative terms) contribute to the -function for in a very similar way to the term, but with smaller coefficients. While the inclusion of such irrelevant terms can have a quantitative effect at short lengths, the qualitative behavior of strong ferromagnetism, which persists to fairly long-length scales, is captured by including the effects of the marginal coupling, , only and is unchanged by the inclusion of more irrelevant couplings.

That should not grow exponentially due to the term is not only suggested by Eq. (13), but can be seen by expanding the interchain susceptibility, , in powers of , treating the interchain interaction as a perturbation. One finds, using the simple power counting suggested by scaling, that grows at most logarithmically in at quadratic and cubic orders, but there is a contribution at quartic order that grows linearly in . It follows from this perturbative expansion that the term causes no exponential growth in . The initial condition that corresponds to “tuning” (no exponential growth) is given in Eq. (23) in Appendix, where the RG equations are solved analytically to cubic order. For and the initial condition, , it follows from Eqs. (5) and (6) that remains constant at quadratic order. However, for nonzero , flows even at quadratic order and a larger ferromagnetic initial condition is needed to ensure that does not grow exponentially in at quadratic order.

While there is a ferromagnetic quartic contribution to from the term, there is also an antiferromagnetic contribution from the term in the -function. This term, generated within the operator product expansion technique, is analogous to the antiferromagnetic initial condition identified by Starykh and Balents.Starykh and Balents (2007) is zero at the lattice scale since these couplings do not appear in the microscopic Hamiltonian, but is nonzero in subsequent RG steps and provides an initial condition equal to at if one sets . This differs from the Starykh and Balents initial condition by about a factor of two, but both calculations rely on the continuum approximation which is only approximate near the lattice scale. Also, the two results are almost identical if one uses the value of extrapolated to the lattice scale. An analysis of both calculations shows that they rely on the same physics, which involves generation of a gradient coupling between second-neighbor chains () and requires chiral symmetry breaking (i.e., nonzero in the continuum RG language).

The long-distance RG results of Ref. Starykh and Balents, 2007 are recovered within our analysis for sufficiently small if the ferromagnetic initial condition associated with is equal to to . In this case, the quartic term, , provides the essential contribution to the initial condition of that drives the ordering. For this initial condition, the RG flow for small corresponds to one of the flows shown in Fig. 2 where is initially ferromagnetic, but passes through zero at an intermediate length and then becomes large and antiferromagnetic. For small , the intermediate length where crosses over from ferromagnetic to antiferromagnetic, is proportional to , neglecting logarithmic corrections. This follows from the fact that the quadratic contribution to grows at most logarithmically in , while the quartic antiferromagnetic contribution grows linearly in . Consequently, the second nn chains in finite systems with chains of length will be ferromagnetically correlated for . The coefficient is estimated to be 20-40 lattice spacings, depending on which value is used for the antiferromagnetic contribution to .

A direct transition from CAF to spiral order is expected to be discontinuous, while the RG flows change continuously. Nevertheless, one can extract some information about this transition from the RG analysis. As increases, the RG flows move toward larger at , which shows a tendency of moving toward spiral order. From the numerical solution of the -functions of Eqs. (4)-(8), it follows that , where is defined as the value at which first reaches while . For , remains small compared to at this , so the RG predicts that there is no intermediate dimer phase between the CAF and spiral ordered phases. This estimate for results from using the value for the AF contribution to the initial conditionStarykh and Balents (2007) and setting the ferromagnetic initial condition or tuning as discussed at the end of Appendix.

Terms higher order than and irrelevant couplings which are ignored, as well as exactly where one terminates the RG flows, can all affect so is only a crude estimate. The main reason for the somewhat small value of is that the CAF state is only selected at quartic order, while the competing marginal coupling, is linear in and boosted both by backscattering and by , which is also linear in . We note that the estimate of is compatible with the observation of spiral correlations at in numerical studies of multi-leg ladder systems.Weichselbaum and White ()

## V Numerical Results

The ED results shown in Fig. 2 show only ferromagnetism at all , but the system sizes are not large enough to determine whether the strength of the ferromagnetism is changing with increasing system size for small . To address this, we turn to a more detailed analysis of the numerical studies of the interchain susceptibility, , using density matrix renormalization (DMRG) to study larger systems. Specifically, we address the question of what initial conditions are compatible with the study of finite systems or, alternatively, are finite size studies compatible with the RG analysis. Using finite-size scaling, the susceptibility of the system with size with couplings defined at scale can be related to the susceptibility of the system with size as

where the linear- dependence in the prefactor is due to having scaling dimension in the absence of the backscattering, and the second factor is the contribution of the running backscattering that modifies the scaling dimension of . For small (small ), is analytic in the couplings and proportional to to leading order, and we have . There is no further quantum correction to this relation to leading order in , since is fully renormalized and includes all quantum fluctuations.

Since three chains captures all contributions to and to order as well as the key fluctuations that drive CAF order, we confine our studies to three-chain systems. The interchain susceptibility is studied using ED and DMRG for the HAF on three chains with open boundary conditions for 24 to 84 spins (=8 to 28); ED was used for up to 36 spins. Up to , states were kept in the DMRG, while typically keeping the precision . The results are shown in Fig. 4. For all values of , was found to be ferromagnetic. As noted earlier, ED studies also found that the correlation between second nn chains has quadratic, cubic, quartic (and higher order) in contributions which are all ferromagnetic for (as expected from analyzing the term), and the additional quartic contribution from 4 chains is also ferromagnetic. There is no sign in the data of a turnover to negative values of expected for AF correlations. As increases, the length scale at which antiferromagnetism should be observable if the CAF state is stable becomes shorter. For example, at , the RG analysis predicts that one should see a turnover in for , although we don’t expect RG to be quantitatively accurate at such large . As increases, higher-order fluctuations that are not included in the RG and that are not fully captured by studying three chains, can either further stabilize or destabilize CAF order.

For and , the change in as a function of is fit to the predicted RG flow for , , and as functions of initial conditions, treated as fitting parameters. is incorporated approximately to capture the cubic behavior of as described in the Appendix. The restriction to small is to ensure that is proportional to and higher order terms can be neglected. Figure 5 shows scaled by , with the lines being the RG fits to the data. One can see the different slopes of curves for positive and negative values of , which shows the effect of the cubic term. It is also clear from these curves that is growing only weakly with .

The initial conditions at extracted from the numerical data are , , , and . While the extracted value of is substantially closer to zero than the value of for periodic boundary conditions, this is consistent with an independent calculation of for a single chain. For short chains, open boundary conditions are known to favor dimerization relative to periodic boundary conditions.Affleck and Qin (1999) The fact that the ratio of extracted from the numerical data is noticeably larger than the ratio at the lattice scale can be attributed to the effect of irrelevant couplings that contribute ferromagnetism in an analogous way to the term.

Although the extracted initial conditions are such that flows to a large ferromagnetic value, which would seem to indicate spiral order, the deviation from tuning at both quadratic and cubic orders is sufficiently small to be compatible with finite size effects. For the values of , , and extracted from the data, tuning corresponds to . Therefore the quadratic (cubic) term deviates by () from the value predicted from the RG equations for an order selected at . Given the uncertainty introduced by finite-size effects for and the approximations made in the RG, the numerics for small are consistent with no order being selected to cubic order, while the lack of any tendency toward antiferromagnetism with increasing for suggests the CAF state is not stable for these larger values of . The numerics also confirm the RG prediction that, not only is there ferromagnetism at the lattice scale for all values of , but this ferromagnetism continues to grow to fairly long length scales. Ideally, one would like to study the quartic term for small as a function of system size since the RG analysis predicts that CAF order is selected by an initial condition for that deviates from tuning by about 20% at quartic order. However, this would require studying larger system sizes while keeping more states in the DMRG calculations and is beyond the scope of this study.

## Vi Dzyaloshinskii-Moriya interaction

It is also interesting to consider the effect of a nonzero DM interaction in this RG picture, since it is known that the interchain DM interaction further stabilizes spiral order in this model. Dalidovich *et al.* (2006); Fjærestad *et al.* (2007) In the continuum limit, the interchain DM interaction can be written as with the initial condition . Note that this term breaks the SU(2) symmetry of the original model and will order the spins in a plane perpendicular to the direction of . Just like the term, the DM interaction has scaling dimension and is relevant. It flows according to the following -function:

(14) |

The DM interaction also introduces a term (for components perpendicular to ) in the -function of , Eq. (6). In addition to getting some boost from the marginal backscattering and , the DM interaction both is enhanced by and promotes ferromagnetic . Consequently, it suppresses CAF order relative to spiral order. In any region of the phase diagram where spiral order is stable for , the DM interaction will further stabilize this phase relative to CAF order.

Since both and have the same exponential growth for small , a DM interaction with greater than the untuned (antiferromagnetic) part of will overcome the CAF order as will grow to be of first. The DM interaction favors neighboring Neel chains to be aligned perpendicular to each other, but in the presence of (which grows marginally), a spiral state will be stabilized. This suggests the phase diagram shown in Fig. 6 with a transition between the CAF and spiral states at for small . This transition is expected to be first order, so the RG crossover between these two states is only approximate. However, because CAF order is only weakly favored, at order , the maximum for which CAF order survives will also be very small and is estimated from the RG analysis to be less than if . Even if the interchain coupling for CsCuCl is such as to stabilize CAF order in the absence of any DM interaction, the estimated DM interaction for CsCuCl, , is much greater than what is required to stabilize spiral order.

One can also consider the effect of an intrachain DM interaction with the Hamiltonian . This interaction can promote several different phases even in a single spin-1/2 chain for interchain DM coupling, , comparable to . Garate and Affleck (2010) For , it has little effect on the phase diagram shown in Fig 6. One can show that the primary effect of is to renormalize the interchain DM coupling, . Ghamari () For , this implies that will stabilize spiral order at small . For nonzero and or smaller, the intrachain DM coupling can slightly tilt the ordering plane and/or slightly shift the phase boundary between CAF and spiral, depending on the relative directions of and . This can be understood from the fact that, for small , the CAF and spiral states exhibit essentially the same AF order along a chain and only differ significantly in how the chains order with respect to each other.

## Vii Conclusions and Discussion

In summary, the full RG equations for the HAF on an anisotropic triangular lattice describe the intense competition between CAF and incommensurate spiral orders. A tiny perturbation of can tilt the balance between these two states at small , while a larger perturbation is needed to stabilize dimer order. As predicted by Starykh and Balents,Starykh and Balents (2007) the CAF state is stable at sufficiently small , but either an interchain DM interaction or a ferromagnetic second neighbor interchain interaction of would stabilize an incommensurate spiral state. By contrast, an intrachain interaction that pushes backscattering, , toward zero or an interchain dimer coupling, which is larger than is needed to stabilize dimer order. The fact that such an extremely weak interchain DM coupling is sufficient to stabilize spiral order at all , implies that CsCuCl, with an estimated , is well within the region of stability for spiral order and is not close to a CAF instability.

For zero or extremely weak DM coupling, the RG analysis suggests a direct transition from CAF to spiral order as increases, without an intermediate dimer phase. This transition is estimated to occur at and is compatible with recent DMRG studies which find evidence in favor of spiral order for .Weichselbaum and White () On the other hand, this estimate would seem to be in contradiction to other studies that have concluded that spiral order is lost at significantly larger values of , such as at .Weng *et al.* (2006); Heidarian *et al.* (2009); Reuther and Thomale (2011) However, numerics which are interpreted as loss of spiral order could be compatible with the weak spiral order expected in the presence of quantum fluctuations. Furthermore, since the wavelength of the spiral grows rapidly with decreasing and its energy lies so close to that of the CAF, as well as to many disordered states, it is important to use open boundary conditions in finite size studies.

The RG analysis connects directly to numerical studies on finite systems where, for small , second neighbor chains couple ferromagnetically, the opposite to what one would expect for CAF order. For the infinite system, the static interchain spin-spin correlation function, , is ferromagnetic and of order at even in the CAF state. The RG analysis suggests that these ferromagnetic correlations persist to quite large since the ferromagnetic coupling between chains grows with increasing system size up to chain lengths that are smaller than, but comparable to . The ED and DMRG results are consistent with this and suggest that the antiferromagnetism is hidden by larger ferromagnetic fluctuations except at very long length scales. One might be able to see these ferromagnetic correlations in the CAF state using cluster or series expansion calculations for the infinite system.

While our numerical studies are consistent with the RG analysis, they do not provide any direct evidence of CAF order. Given the long-length scales involved for , it would be extremely challenging to identify this order from finite-system-size studies. For small , a large static magnetic susceptibility has been observed at or very close to ,Weng *et al.* (2006); Reuther and Thomale (2011) but this feature is common to both CAF and spiral fluctuations. The two states would be distinguished by the dependence of the susceptibility and very long chain lengths are required for these correlations to develop. The interchain Neel susceptibility, , together with finite-size scaling may provide one fruitful avenue for such studies. For example, one could simply look for any indication of a sign change in with increasing for . Our numerical studies are restricted to , because of the high precision required to extract RG parameters and give no evidence of a sign change. However, to within the expected accuracy, the numerics are consistent with the RG prediction that quadratic and cubic (in ) fluctuation effects do not select any order.

###### Acknowledgements.

The authors thank Leon Balents, Ganapathy Baskaran, John Berlinsky, Subhro Bhattacharjee, Oleg Starykh, and Andreas Weichselbaum for many useful discussions. This work was supported by NSERC and by the Shared Hierarchical Academic Research Computing Network. CK acknowledges support from the Canadian Institute for Advanced Research and Canada Research Chairs.*

## Appendix A Approximate Analytic Solutions

To better understand the flow of and under the RG, one may attempt solving a reduced subset of the given -functions [Eqs. (4-8)] analytically. If one drops terms in the -functions that contribute at quartic and higher orders (in ) to , partial analytic solutions can be obtained that yield insight into the initial conditions corresponding to “tuning”, i.e., to no exponential growth in . This leaves us with the following reduced -functions:

(15) | |||||

(16) | |||||

(17) |

which lead to the analytic expressions:

(18) | |||||

(19) | |||||

(20) | |||||

For a non-zero , the integral in Eq. (20) cannot be expressed in terms of elementary functions. However, assuming , it is possible to expand and find an expression for as series of lower, incomplete gamma-functions:

(21) | |||||

where is given recursively by:

(22) | |||||

Each term in Eq. (21) is accompanied by a power of , and also we have a factor that multiplies the sum. Since the above analytic expressions for the couplings were derived by neglecting quartic and higher-order contributions, we dismiss all terms in the expansion except the first two terms. Finally, using the above analytic expressions, the tuned initial condition for the Neel-Neel coupling, , is found []: