Role of multiorbital effects in the magnetic phase diagram of ironpnictides
Abstract
We elucidate the pivotal role of the bandstructure’s orbital content in deciding the type of commensurate magnetic order stabilized within the itinerant scenario of ironpnictides. Recent experimental findings in the tetragonal magnetic phase attest to the existence of the socalled charge and spin ordered density wave over the spinvortex crystal phase, the latter of which tends to be favored in simplified band models of itinerant magnetism. Here we show that employing a multiorbital itinerant Landau approach based on realistic bandstructures can account for the experimentally observed magnetic phase, and thus shed light on the importance of the orbital content in deciding the magnetic order. In addition, we remark that the presence of a hole pocket centered at the Brillouin zone’s point favors a magnetic stripe rather than a tetragonal magnetic phase. For inferring the symmetry properties of the different magnetic phases, we formulate our theory in terms of magnetic order parameters transforming according to irreducible representations of the ensuing D point group. The latter method not only provides transparent understanding of the symmetry breaking schemes but also reveals that the leading instabilities always belong to the subset of irreducible representations, independent of their C or C nature.
I introduction
The importance of a nested bandstructure and the concomitant emergence of itinerant magnetism have recently come to the fore in the field of ironbased superconductors (FeSC). A detailed understanding of the microscopic mechanism driving magnetism in these systems is significant and interesting in its own right, but can also lead to new insights regarding the emergence of superconductivity upon hole or electron doping (1). At present, a conclusive microscopic description of the origin of the various magnetic phases of the FeSC along with their evolution with temperature, doping, and pressure remains an open problem.
The prevalent magnetic phase of the FeSC is characterized by a metallic spindensity wave (SDW) with ordering wavevectors or , and is also known as the magnetic stripe (MS) phase. In the latter, magnetism is collinear and additionally introduces an orthorhombic distortion to the otherwise Csymmetric Fe crystal lattice. In addition, the magnetic moments are oriented ferromagnetically (antiferromagnetically) along the shorter (longer) axis. However, early theoretical studies pointed out the potential relevance of additional socalled double magnetic phases, in which simultaneous ordering at both wavevectors takes place (2); (3); (4); (5). There are two distinct double magnetic phases allowed to appear at a paramagnetic(PM)magnetic transition: a collinear nonuniform charge and spinordered density wave (CSDW) phase, and a noncollinear socalled spinvortex crystal (SVC) phase where the moments on neighboring sites are at right angles to each other (see Fig. 2, top panel).
So far, a series of theoretical studies have explored the phase diagram, and determined the preferred magnetic state, MS, CSDW or SVC, in terms of temperature, electron filling, microscopic interaction paramenters, spinorbit coupling (SOC), and disorder (2); (3); (4); (5); (6); (7); (8); (9); (10); (11); (12); (13). Nevertheless, it is still unclear which features of a given bandstructure are responsible for selecting the magnetic state, or how this choice depends on the values of the interactions. Detailed theoretical calculations are thus required in each seperate case to accurately determine the global minimum of the magnetic free energy. On top of that, a full consensus on the phase diagram is lacking; whereas free energy expansions in terms of the magnetic order parameter in threeband models consistently find SVC and MS phases (6); (8); (14); (10), microscopic HartreeFock studies at low temperatures show the existence of both SVC, MS, and CSDW phases in the typical temperature versus doping phase diagram (7); (15).
Experimentally, the presence of double magnetism has been confirmed via employing diverse techniques in a number of FeSC materials, including holedoped BaNaFeAs (16); (17), BaKFeAs (18); (19); (20); (21); (22), SrNaFeAs (23); (24), and most recently CaNaFeAs (25). Notably, scattering methods have proven suitable for differentiating between the C and C phases, by comparison of magnetic and crystal Bragg peaks. The Csymmetric phases have been so far detected at the foot of the magnetic dome consisting mainly of MS ordering, in agreement with some theoretical studies (7). Recently, the sitesensitivity of Mössbauer spectroscopy was exploited to conclude that in SrNaFeAs, the relevant magnetic double ordered phase exhibits only moments on half of the Fe ions (23), in agreement with the CSDW phase, and the general itinerant scenario for magnetism in these compounds (26).
Fuelled by these continued experimental findings and the abovementioned theoretical puzzle, we show here that accounting for the multiorbital character of the bandstructure in the free energy expansion yields improved agreement with the experimentally inferred magnetic phases compared to models that neglect the orbital structure of the band. In more detail, we retrieve the commensurate magnetic phase diagram upon varying the profile of the bandstructure, that here is based on density functional theory (DFT) studies (27). Using the Landau formalism, we identify the leading magnetic instability and evaluate the relevant Landau coefficients in order to determine the system’s preferred magnetic state and the symmetry of the respective magnetic order parameter. Here we focus on commensurate magnetic phases, for incommensurate ordering vectors the expression for the Landau free energy is modified, and new magnetic phases arise as shown recently (28). Within our approach the orbital content of the bands can be excluded when evaluating the ground state magnetic order. This allows the direct comparison of our results to the ones obtained via previous band models that neglected the orbital content.
In addition, we pursue resolving the influence of the hole pocket centered at the point, on the phase diagram, as it can be present or absent depending on the FeSC material under investigation. Our results suggest that the presence of the above hole pocket tends to favor the emergence of the MS phase at the expense of the other two Csymmetric phases. Finally we note that a crucial component of our theoretical analysis is to classify the magnetic order parameters according to the irreducible representations (IRs) of the D point group that characterizes the bandstructure under consideration. In this manner we find that the order parameters of the leading instabilities belong to particular IR subsets, irrespective of the C or C nature of the magnetic ground state.
Below we provide a summary of our main results, that we discuss in more detail in the upcoming sections.

The magnetic order parameters belong to the following three different subsets , and , formed by IRs of D. The magnetic order parameters with IRs of a given subset share the same critical temperature. For the cases studied here the magnetic order parameter of the leading instability was always found to belong to the IR subset. This implies a nearly diagonal magnetic order parameter matrix in orbital space, with offdiagonal components of character, as highlighted in Eq. (9). We stress that the form of the order parameters presented in Eqs. (9)–(11) is not a property of any specific bandstructure but a generic consequence of the point group symmetries.

Excluding the orbital content promotes the SVC phase over the CSDW phase in agreement with previous theoretical calculations (14); (10). Instead, taking into account the orbital degrees of freedom at or near the FS, captures to a large extent the salient features of the case with all excitations in the Fe3 shell included. For more details see Fig. 5.

For the bandstructure studied here, we find that the Mpocket plays an important role in selecting the single over the double magnetic phases, as shown in Fig. 7. In the absence of a holepocket at M, the value of the quartic coefficient deciding between C and C phases is reduced, thus favoring a C phase. Nevertheless, the C phase is recovered at lower temperatures and larger interaction strengths.
All our results from the Landau approach are compared onetoone with results from HartreeFock calculations. As expected, the two methods yield identical results close to the transition temperature of the magnetic phase. Our results thus corroborate the importance of accounting for the full bandstructure when modelling the magnetic phase diagrams of FeSC.
Ii microscopic model and IR decomposition
To study commensurate magnetism within the framework of itinerant electrons we adopt the multiorbital HubbardHund Hamiltonian
(1)  
(2)  
(3)  
where the momentum sums run over the 1Fe Brillouin zone (BZ), being the number of momentum space points, the are taken from Table II, upper right, in Ref. (27) (LaFeAsO) and . Here and label Fe 3orbitals and labels spin, with . We treat the interactions on a meanfield level and perform a HartreeFock decoupling in both the intraorbital charge channel and the magnetic channel. The meanfield densities are solved for in a selfconsistent manner resulting in an orbitally dependent shift of the chemical potential (29). The effects of doping are modelled by a rigid shift of the chemical potential thus leading to an appropriate alteration of the electron filling. The meanfield Hamiltonian is thus
(4)  
Here , correspond to the HubbardHund interaction parameters
(5) 
and
(6) 
At this point we adopt the parameterization and , which is a consequence of imposing SO(3) rotational invariance on the sum of the interaction terms (30).
Integrating out the electrons in Eq. (4) and expanding the resulting tracelog to quartic order yields the magnetic free energy
(7)  
reflecting the fact that the order parameters have an orbital structure as well. Here we have maintained the dependence of the magnetic order parameter at quadratic level so to distinguish commensurate and incommensurate magnetic phases. The coefficient is the static bare spinspin susceptibility
(8)  
where are unitary transformations between band and orbital space and and label the bands. Here we discuss a method to evaluate the quartic coefficients appearing in the Landau free energy Eq. (7) by writing the magnetic order parameters in terms of the IRs of the point group and identifying which of these is the first to condense. This allows us to project the coefficients onto the appropriate IR. The decomposition in terms of IRs has the added benefit of providing an understanding of why specific orbital combinations appear together in the orbitally resolved magnetic order parameter.
The appropriate space groups in the paramagnetic tetragonal phase for describing the FeSCs are or and hence the relevant point group is D. In the following we do not consider complications arising from nematic or strutural transitions above the magnetic transition. Assuming a negligible SOC implies that the related operations act separately on wavevector and orbital spaces, while spin space remains inert. The effects of SOC were considered in Ref. (31) although in a simplified threeorbital model. In the present case we find that the magnetic order parameters belonging to the relevant IRs , split into the following two and onedimensional IRs, and , respectively.
The ordering wavevectors, and , are located at the BZ boundary and satisfy up to a reciprocal lattice vector. The latter property implies that the relevant IRs for the present study consist of the three subsets , and . At quadratic level the IRs of a given subset are degenerate, thus reflecting the inability of the quadratic term to distinguish between single and double phases. We stress that the form of the order parameters presented in Eq. (9)–(11) is not a consequence of the bandstructure considered here but follows from the D point group symmetry. The magnetic order parameters that transform according to the IRs are given by the nonzero matrix elements in orbital space (see Appendix A for the detailed expressions):
(9) 
while the orbital composition reads:
(10) 
and finally the corresponds to:
(11) 
As these different types of magnetic order parameters belong to distinct IRs, they are mutually exclusive. This implies that certain orbital combinations never appear in tandem, at least not as a result of a transition from a paramagnetic phase. Note that this does not rule out accidental degeneracies between the three, although for the cases studied here we find that the condensed order parameter is well separated from the others, as shown in Fig. 1.
As stated previously, our goal is to project the quartic coefficients onto the leading magnetic instability occuring at , which can be achieved in any representation. Hence, in the orbital space picture we write the magnetic order parameters as
(12) 
The internal structure of the order parameters at the onset of the instability, reflected in the orbital space matrix , can be found from the quadratic term in the free energy. The latter defines the static part of the inverse propagator of the magnetic order parameter fluctuations , defined as
(13) 
For the remaining analysis we will refer to the above simply as the inverse magnetic propagator, note however, that it is not identical to the random phase approximation (RPA) spin susceptibility.
We evaluate the inverse magnetic propagator as a function of temperature until a magnetic transition, signified by its smallest eigenvalue crossing zero, occurs:
(14) 
Note that this is equivalent to the divergence of the leading eigenvalue of the RPA susceptibility (32).
The calculation of the magnetic propagator, that is a rank4 tensor in orbital space, greatly simplifies when transferring to the IR formalism. In the latter case, one can define a single rank2 magnetic propagator per IR (), i.e. . Thus the magnetic propagator can only mix different order parameters (), belonging to the same IR. Moreover, invariance under translations implies that the eigenvalues of and are degenerate, and similarly for the subset, see Appendix A. In Fig. 1 we show the resulting eigenvalues as a function of filling. Interestingly, for the cases explored in this paper, the smallest pair of eigenvalues always originate from the subset of IRs. In fact, also the subleading pair belongs to the latter subset as shown in Fig. 1.
The condensation of the representations is consistent with HartreeFock methods, which find magnetic order parameters with the orbital structure given in Eq. (9) (7); (15), with the offdiagonal component being smaller than the diagonal components by an order of magnitude. As shown in Fig. 1, the eigenvalues of the inverse magnetic propagator cluster into two groups. The group closest to corresponds to the real representations of the magnetic order parameters, while the group around corresponds to the imaginary ones.
Having established the orbital structure of the leading instability we can proceed with evaluating the quartic coefficients. These are rank8 tensors (see Appendix B for the explicit expressions) in orbital space, and to determine the symmetry of the magnetic order at the instability we project these onto the leading instability using the orbital content obtained from the diagonalization of the (inverse) magnetic propagator at the instability, Eq. (14). At the instability we can then define
(15)  
(16)  
(17)  
(18) 
and we note that while the results of the contractions in Eq. (15) and (16) are identical by symmetry, the orbitally resolved coefficients and are related by C rotations since these act nontrivially on orbital indices. The quartic terms in the free energy thus read
(19)  
In Fig. 2 we show the leading instabilities associated with this free energy along with values for the quartic coefficients obtained using the method described above. With this method we can assess the effect of the orbital weights in Eqs. (15)–(18) and thus infer the contrasts between cases where the orbital content is included or neglected.
We end this section by noting that, as is wellknown, meanfield theories neglect of the effects of order parameter fluctuations. In the context of the pnictides, magnetic fluctuations lead to a number of preemptive orders, such as the prevalent spinnematic order (43); (44); (45), along with the less familiar charge density wave associated with the CSDW phase, and the spinvortex density wave associated with the SVC phase (46). However, as these preemptive orders are decided by the same free energy coefficients as the magnetic orders, the phase boundaries between the various magnetic phases should be stable against their presence.
Iii results
iii.1 Effects of orbital content
To demonstrate the effects due to the presence of the orbital content we consider a specific choice of interaction parameters, eV and , and evaluate the coefficients , , and using the method described in the previous section, and the associated Appendices. At a filling of , for which the Fermi surface is shown in Fig. 3(a), we find that the magnetic order parameter is dominated by the orbital along with the () orbital for magnetic orders modulated along ().
This is reflected in Fig. 4(a). The large contribution arises due to nesting between the and pockets and the pocket while the contribution is due to nesting between the pocket and the X and Y pockets [cf. the Fermi surface in Fig. 3(a)].
In Fig. 5(a) we show the type of the established magnetic phase near upon varying doping and temperature, as obtained from the analysis of the free energy coefficients, as shown in Fig 2. All magnetic transitions were found to be of second order, in agreement with Ref. (7). As usual, the meanfield approach allows for a finite even though it is the result of a twodimensional calculation and overestimates the actual magnetic transition temperature. Including fluctuations in a threedimensional calculation, i.e., taking into account the layered structure of the material will yield a finite but downwardrenormalized . As seen from Fig. 5(a), we find a magnetic dome dominated by the MS phase, while the CSDW phase appears on both the electron and the holedoped sides. As discussed previously, standard DFTgenerated tightbinding bands do not generally lead to a magnetic dome centered with maximum at (7); (33).
The findings in Fig. 5(a) are confirmed by selfconsistent HartreeFock calculations. The latter are performed with a momentumspace grid with points in the 1Fe BZ, while the quartic coefficients are computed using a grid size of . Overall our findings are consistent with previous studies (7), though we cannot confirm the presence of the SVC phase for eV at any filling even down to low temperatures. We attribute this discrepancy to the slow convergence of the meanfields. In our present study the iterative solution of the meanfield equations was stopped when the rate of change between iterations, , for the dimensionless order parameters dropped below a certain value. Only for a stopping criterion we reach the reported CSDW phase. Comparing the free energy evaluated for converged HartreeFock solutions between SVC and CSDW confirms that the CSDW state indeed is the preferred state among the commensurate SDW states in this parameter regime. A less strict selfconsistency requirement indeed yields an SVC phase in the electrondoped region, as reported previously (7).
We note, however, that we find both the CSDW and the SVC phases when the interaction strength is increased to eV, Fig. 6, in agreement with Ref. (7).
More specifically, both our analysis of the Landau free energy and our selfconsistent HartreeFock calculations show that for eV the MS phase is realized close to throughout the magnetic dome. Within HartreeFock, we confirm a subsequent change of the magnetic phase in the electron doped region, from the C MS to the C SVC, as the temperature is lowered. In agreement with Ref. (7), we find the transitions between magnetic states to be of second order. Note that, as shown in Ref. (6), including the effect of magnetic fluctuations drives the transitions first order. The quartic coefficients were also computed in Ref. (5) using a slightly different approach, and we find broad agreement with the results presented there, albeit the interactions applied in Ref. (5) are larger than the ones used in this work. In Ref. (5) a large MS region was found, with an SVC region appearing upon electron doping. The energy landscape was reported to be rather flat on the electron doped side, consistent with the fact that our HartreeFock calculations require a high accuracy to properly converge. In contrast to our results however, first order transitions are reported in Ref. (5) for a narrow doping range. This discrepancy could, however, be caused by the different methods applied.
As mentioned above, a direct PMSVC transition was not observed for any of the parameters considered. This is in contrast to results from threeband models, which predict the dominant tetragonal phase to be the SVC phase (14); (10). To shed light on this discrepancy we evaluate the quartic coefficients in the absence of orbital content and project onto the Fermi surface. This is achieved by fixing the matrix elements in the Green functions to unity and only including energies within a window of meV about the Fermi level. In this case we find a PMSVC transition for a large doping range, as evidenced in Fig. 5(b). The MS phase shrinks and the CSDW phase is entirely replaced by the SVC phase, thus connecting to the results obtained from earlier band models.
Hence the orbital content of the FS plays an important role in promoting the CSDW double phase over the SVC double phase. To illustrate the effect of the orbital content we also consider the case in which the coefficients are projected onto the FS, while the orbital content is fully retained in the Green functions. The result is shown in Fig. 5(c) and exhibits some agreement with the case where the entire bandstructure is included. While the MS phase is still present, the C phases are more prevalent when only lowenergy contributions to the quartic coefficients are included. We interpret the fact that Figs. 5(a) and 5(c) are not identical as evidence that both temperature effects and finite energy particlehole excitations are important for determining the symmetry of the magnetic order parameter (34).
iii.2 Impact of the Mpocket
The strong influence of the orbital along with the fact that it is mainly encountered in the pocket, which only appears in certain materials, prompt additional calculations. Below we compare calculations carried out with or without the holepocket at M. For the current bandstructure, the pocket can be removed by adding to the Hamiltonian a C invariant term where . In order to avoid magnetic transition temperatures that become too small to resolve numerically, we switch to study a case with interaction parameters given by and . For the original bandstructure this reproduces an MS phase in the region of the phase diagram examined here, as shown in Fig. 7(a). However, as the pocket is removed, the single MS phase is replaced by the double CSDW phase, as seen in Fig. 7(b). This finding is confirmed by HartreeFock calculations, which additionally finds that in this case the two double phases are nearly degenerate.
The above results can be understood as follows. First one notes that when the M pocket is present, it facilitates the simultaneous nesting of all the pockets, with a single wavevector, thus promoting the MS phase. The latter argument is supported by the findings presented in Fig. 4(a), where we find that the () and the contributes roughly equally to the nesting along (). In contrast, when the pocket is absent the formation of a MS phase is expected to be suppressed, since single nesting will unavoidably leave the FS of one electron pocket ungapped. As the latter situation is in general energetically costly, the system can instead prefer to stabilize a double phase, via nesting both the orbital part of the pocket and the orbital part of the pocket with the inner hole pocket at . In this case, nesting along () is dominated by (), as it is found in Fig. 4(b).
At the level of the quartic coefficients, the value of is lowered upon the removal of the Mpocket, thus favoring the double Csymmetric phases. Furthermore, the value of is observed to be very close to zero, reflecting the neardegeneracy observed in HartreeFock calculations. It is tempting to associate these findings with the modification of the FS nesting properties, directly discernable from comparing Figs. 3(a) and 3(b). However, HartreeFock calculations show that the MS phase reappears at lower temperatures and higher values of , leading us to conclude that, while the absence of the holepocket at M disfavors the C MS phase, it does not rule it out.
Iv Conclusions
In this work we focused on the role of the orbital degrees of freedom in the formation of commensurate magnetism for a realistic itinerant model of FeSC. Throughout our analysis we classified the orbitally resolved magnetic order parameters in terms of the irreducible representations of the point group . Employing this formalism greatly facilitated the multiorbital analysis, and allowed us to show that the structure of the magnetic order parameters fall into three distinct categories, spanned by the IR subsets , and .
For the parameter values studied in this paper we obtained that the IRs condense first, corresponding to a nearlydiagonal magnetic order parameter in orbital space. This finding is consistent with previous results retrieved via HartreeFock calculations (7); (15). On the other hand, magnetic order parameters with nonzero offdiagonal elements in orbital space might appear as a consequence of increasing the ratio . The latter can enhance the interorbital contributions in Eq. (6) and promote the or IRs. However, from the constraints imposed by SO(3) rotational invariance (30), an increase in entails a decrease in Hund’s coupling, which however is also believed to be substantial (35); (36); (37). Interestingly, recent renormalization group (RG) studies (38) indicate that is a fixed trajectory of the RG flow even for finite Hund’s coupling thus violating the assumed rotational invariance of the microscopic interactions (39).
Besides our generic conclusions regarding the most prominent IR of the stabilized magnetic order parameter, in this work we further investigated the effect of the bandstructure’s orbital character on the order’s type, i.e. MS, CSDW or SVC, via contrasting various ways of including the orbital content. We found that in the absence of orbitals, the preferred C magnetic structure is the SVC phase, in agreement with calculations based on threeband models (14); (10). With the inclusion of orbital content, however, the SVC phase gives way to the CSDW phase, whose magnetic structure is consistent with the experimentally observed magnetic C phase (23).
Additionally, we studied the impact of the pocket on the resulting symmetry of the order parameter of the magnetic ground state. In the presence of a hole pocket at we find a C magnetic phase driven primarily by intraorbital and magnetic fluctuations along (). While we find that the Mpocket is important to the formation of a C symmetric phase, its absence does not rule out the appearance of a C phase. The bandstructure considered here was independent of , however some FeSC can show rather anisotropic dispersions along the direction, with the M pocket only being present for certain values of (40); (41); (42). The natural next step towards a complete understanding of the effect of the M pocket on the preferred magnetic order parameter is to extend our investigation to such dispersions.
We end with a brief remark on the fate of our results in the presence of SOC. The latter breaks the SO(3) spinrotational invariance, and its effects can be described by adding the following quadratic term to the free energy (31); (9)
(20)  
with denoting the spin components of the order parameter. Explicit expressions for the coefficients were given in Ref. (9) where the magnetic anisotropy induced by a term was considered. The term modifies the free energy at the quadratic level with respect to the order parameters and therefore plays an important role in the determination of the leading magnetic instability. Beyond the differentiation of directions in spin space, SOC may even support new types of magnetic states, constituting an interesting future avenue of research.
Acknowledgements.
We thank A. V. Chubukov, R. M. Fernandes, and M. N. Gastiasoro for useful discussions. M.H.C. and B.M.A acknowledge financial support from a Lundbeckfond fellowship (Grant No. A9318).Appendix A Decomposition into irreducible representations of D
In this section we present how the magnetic order parameters and transform under the point group symmetry operations. Here the denotes matrices in orbital space. The wavevectors considered here are located at the boundary of the Brillouin zone and thus satisfy up to reciprocal lattice vectors. In this section we outline the restrictions the point group symmetries impose on the orbital structure of the order parameters.
The relevant space groups for the FeSC are the P4/nmm and the I4/mmm both of which have the same point group, D. Assuming negligible SOC renders the spinindices inert under the point group transformations, and additionally implies that the nonsymmorphic nature of P4/nmm does not enter the considerations. Moreoever, since both the magnetic ordering vectors and and the Fe 3orbitals are invariant under inversion , the symmetry classification can proceed according to the subgroup C. The operations contained in C are the identity , two rotations, a rotation, two mirror operations and two mirror operations. We note that these act separately on the wavevector and orbital spaces.
For demonstrating how the point group symmetry operations act on wavevector space, let us consider for simplicity a scalar object labelled by one of the two wavevectors, i.e. and . One then finds
The above 2d representation is reducible and can be decomposed into the two 1d IRs, and :
(21) 
The above analysis implies that the linear combinations carry the 1d IRs and , respectively.
Notably, the wavevector dependence of the order parameters additionally implies that they transform nontrivially under translations. The latter are generated by where is a vector commensurate with the lattice. In momentum space we find , implying that translations act as U(1) gauge transformations in momentum space. By setting the lattice constant equal to unity, any translation can be generated by a combination of unit translations along the and axes, and , which act on the function in the following manner:
(22)  
(23) 
and hence for . Translational invariance thus implies that the free energy should be invariant under exchange of the IR indices . This manifests itself in the degeneracy of the eigenvalues of and , as discussed in the main text.
On the other hand, the Fe orbitals transform according to the following D IRs:
(24)  
(25) 
Since the magnetic order parameters constitute rank2 tensors in the orbital space, their matrix elements can be symmetry classified according to a Kronecker product of two IRs of the point group. By employing the decomposition rule for the IRs of interest presented in Table 1 we can classify the magnetic order parameters using the IRs of D.
To exemplify the method let us focus on the subspace and consider a Hermitian matrix defined in the latter space. By taking into account that the two component orbital basis in this subspace transforms according to the IR, the possible IRs for the matrix are retrieved from the product decomposition
(26) 
The corresponding matrices in orbital space can be inferred from linear combinations of the functions , , , and :
(27)  
(28) 
where e.g. is a function transforming under the point group transformations and the was included so to guaranteee the assumed Hermitian character of . The above linear combinations yield the following IR matrices:
(29)  
(30) 
Therefore, based on the above one can infer the orbitalsubspace transformation properties of the magnetic order parameters. By properly extending the above analysis so to include all five orbitals one can retrieve the complete action of the symmetry operations in orbital space.
To obtain the full transformation properties of the magnetic order parameters we combine orbital and wavevector transformation properties. As shown above, linear combinations of the wavevectors fall into either or IRs, while the orbitals have components in all of the four 1d IRs. Since, the leading and subleading instabilities are described by order parameters belonging to the subset of IRs, we present below only the latter:
(31)  
(33)  
where we made use of the shorthand notation .
Combining these matrices yields the matrix order parameter given in Eq. (9) while the structure in Eq. (10) or Eq. (11) is found from the corresponding or IR space defined magnetic order parameters. These matrices allow us to write the magnetic order parameter in the space of IRs:
(34) 
with while denotes the number of order parameters that belong to the same IR, e.g. for the and similar for the IRs. Via employing Eq. (34) we can rewrite the bare susceptibility in the space of IRs, in which it becomes a blockdiagonal matrix, with each block corresponding to a different IR.
Appendix B Quartic coefficients in orbital space
The derivation of the quartic coefficients is straightforward but tedious. Here we present the results of carrying out the tracelog expansion to fourth order (6). We find the coefficients to be
(35)  
(36)  