---
abstract: 'Infinite-range spin-glass models with Levy-distributed interactions show a freezing transition similar to disordered spin systems on finite connectivity random graphs. It is shown that despite diverging moments of the local field distribution this transition can be analyzed within the replica approach by working at imaginary temperature and using a variant of the replica method developed for diluted systems and optimization problems. The replica-symmetric self-consistent equation for the distribution of local fields illustrates how the long tail in the distribution of coupling strengths gives rise to a significant fraction of strong bonds per spin which form a percolating backbone at the transition temperature.'
author:
- 'A. Engel'
title: 'Replica mean-field theory for Levy spin-glasses '
---

Introduction
============

Spin-glasses are model systems of statistical mechanics in which simple degrees of freedom interact via random couplings drawn from a given probability distribution [@BiYo]. The ensuing interplay between disorder and frustration gives rise to peculiar static and dynamic properties which made spin-glasses paradigms for complex systems with competing interactions. In this way the concepts and techniques developed for their theoretical understanding [@MPV] became invaluable tools in the quantitative analysis of problems originating from such diverse fields as algorithmic complexity [@RemiNat; @MPZ; @HaWe], game theory [@DiOp; @EnBe], artificial neural networks [@EnvB], and cryptography [@KaKi].

In the present note we study a spin-glass for which the couplings strengths are drawn from a Levy-distribution. The main characteristic of these distributions are power-law tails resulting in diverging moments. Compared to the extensively studied spin-glass models with Gaussian [@SK] or other finite moment distributions [@ViBr; @KaSo; @MePa] Levy-distributed couplings are interesting for several reasons. On the one hand the comparatively large fraction of strong bonds gives rise to a mechanism for the glass transition which is different from the usual scenario. On the other hand these systems pose new challenges to the theoretical analysis because the diverging second moments invalidate the central limit theorem which is at the bottom of many mean-field techniques. Related issues of interest include the spectral theory of random matrices with Levy-distributed entries [@ranmat1; @ranmat2] and relaxation and transport on scale-free networks [@AlBa]. It is also interesting to note that the characteristic properties of the Cauchy-distribution have recently enabled progress in the mathematically rigorous analysis of matrix games with random pay-off matrices [@Roberts].

The model considered below with the help of the replica method was analyzed previously by Cizeau and Bouchaud (CB) using the cavity approach [@CiBo]. In their paper CB remark that they resorted to the cavity method because they were not able to make progress within the replica framework. This might have been caused by the fact that at that time the central quantity in the replica method was the second moment of the local field distribution, the so-called Edwards-Anderson parameter [@EdAn], which for Levy-distributed couplings is likely to diverge. Later a variant of the replica method was developed to deal with non-Gaussian local field distributions characteristic for diluted spin glasses and complex optimization problems [@Remi]. Until now this approach was used only in situations where the local field distribution is inadequately characterized by its second moment alone and higher moments of the distribution are needed for a complete description. Here we show that the method may also be adapted to situations where the moments not even exist.

The model
=========

We consider a system of $N$ Ising spins $S_i=\pm 1,\, i=1,...,N$ with Hamiltonian $$\label{eq:H}
  H(\{S_i\})=-\frac1 {2N^{1/{\alpha}}} \sum_{(i,j)} J_{ij} S_i S_j\; ,$$ where the sum is over all pairs of spins. The couplings $J_{ij}=J_{ji}$ are i.i.d. random variables drawn from a Levy distribution $P_{\alpha}(J)$ defined by its characteristic function [@Levydist] $$\label{eq:defP}
  \tilde{P}_{\alpha}(k):=\int dJ \; e^{-ikJ}\; P_{\alpha}(J)=e^{-|k|^{\alpha}} \;$$ with the real parameter ${\alpha}\in (0,2]$. The thermodynamic properties of the system are described by the ensemble averaged free energy $$\label{eq:deff}
  f(\beta):=-\lim_{N\to\infty}\frac{1}{\beta N}\overline{\ln
    Z(\beta)}\; ,$$ with the partition function $$\label{eq:defZ}
  Z(\beta):=\sum_{\{S_i\}}\exp(-\beta H(\{S_i\}))\; .$$ Here $\beta$ denotes the inverse temperature and the overbar stands for the average over the random couplings $J_{ij}$.

Replica theory
==============

To calculate the average in (\[eq:deff\]) we employ the replica trick [@EdAn] $$\label{eq:replicatrick}
  \overline{\ln Z}=\lim_{n\to 0}\frac{\overline{Z^n}-1}{n}\; .$$ As usual we aim at calculating $\overline{Z^n}$ for integer $n$ by replicating the system $n$ times, $\{S_i\}\mapsto \{S^a_i\},\,
a=1,...,n$, and then try to continue the results to real $n$ in order to perform the limit $n\to 0$.

Due to the algebraic decay $P_{\alpha}(J)\sim |J|^{-{\alpha}-1}$ of the distribution $P_{\alpha}(J)$ for large $|J|$ the average $\overline{Z^n(\beta)}$ does not exist for real $\beta$. On the other hand, for a purely imaginary temperature, $\beta=-ik,\,k\in\mathds{R}$, we find from the very definition of $P_{\alpha}(J)$, cf. (\[eq:defP\]) $$\label{eq:Zn}
  \overline{Z^n(-ik)}=\sum_{\{S_i^a\}} \exp
\Big(-\frac{|k|^{\alpha}}{2N}\sum_{i,j} \Big |\sum_a S_i^a S_j^a\Big |^{\alpha}+ {\cal{O}}(1)\Big) \; .$$ Note that the replica Hamiltonian is extensive which justifies a-posteriori the scaling of the interaction strengths with $N$ used in (\[eq:H\]). The determination of $\overline{Z^n}$ can be reduced to an effective single site problem by introducing the distributions $$\label{eq:c}
  c({\vec{S}})=\frac1 N \sum_i\delta({\vec{S}}_i,{\vec{S}})\; ,$$ where ${\vec{S}}=\{S^a\}$ stands for a spin vector with $n$ components. We find after standard manipulations [@Remi] $$\overline{Z^n(-ik)}=
  \int\prod_{{\vec{S}}}dc({\vec{S}})\delta(\sum_{{\vec{S}}}c({\vec{S}})-1) 
  \exp\Big(-N\Big[\sum_{{\vec{S}}}c({\vec{S}})\ln c({\vec{S}})+\frac{|k|^{\alpha}}{2}
  \sum_{{\vec{S}},{\vec{S}}'}c({\vec{S}})c({\vec{S}}') |{\vec{S}}\cdot{\vec{S}}'|^{\alpha}\Big]\Big)\; .\label{eq:Zn2}$$ In the thermodynamic limit, $N\to\infty$, the integral in (\[eq:Zn2\]) can be calculated by the saddle-point method. The corresponding self-consistent equation for $c({\vec{\sigma}})$ has the form $$\label{eq:saddle}
  c({\vec{\sigma}})=\Lambda(n)\exp\Big(-|k|^{\alpha}\sum_{{\vec{S}}}c({\vec{S}})|{\vec{S}}\cdot{\vec{\sigma}}|^{\alpha}\Big)  \; ,$$ where the Lagrange parameter $\Lambda(n)$ enforces the constraint $\sum_{{\vec{S}}} c({\vec{S}})=1$ resulting from (\[eq:c\]).

Replica symmetry
================

Within the replica symmetric approximation one assumes that the solution of (\[eq:saddle\]) is symmetric under permutations of the replica indices implying that the saddle-point value of $c({\vec{S}})$ depends only on the sum, $s:=\sum_a S^a$, of the components of the vector ${\vec{S}}$. It is then convenient to determine the distribution of local magnetic fields $P(h)$ from its relation to $c(s)$ as given by [@Remi] $$\label{eq:Ph}
  c(s)=\int dh\; P(h)\; e^{-ikhs} \qquad\qquad 
  P(h)=\int \frac{ds}{2\pi}\; e^{ish}\; c(\frac s k) \; .$$ Note that the $P(h)$ defined in this way is normalized only after the limit $n\to 0$ is taken. The distribution of local magnetic fields is equivalent to the free energy $f(\beta)$ since all thermodynamic properties may be derived from suitable averages with $P(h)$ [@MePa2].

To get an equation for $P(h)$ from (\[eq:saddle\]) we need to calculate $$\begin{aligned}
\sum_{{\vec{S}}} e^{-ikhs}|{\vec{S}}\cdot{\vec{\sigma}}|^{\alpha}&=
\int\frac{dr\,d{\hat{r}}}{2\pi} |r|^{\alpha}e^{ir{\hat{r}}} 
\sum_{{\vec{S}}}\exp\Big(-ikhs-i{\hat{r}}{\vec{S}}\cdot{\vec{\sigma}}\Big)\\
&=\int\frac{dr\,d{\hat{r}}}{2\pi} |r|^{\alpha}e^{ir{\hat{r}}} 
\sum_{{\vec{S}}}\prod_a \exp\Big(-iS^a(kh+{\hat{r}}\sigma^a)\Big)\\
&=\int\frac{dr\,d{\hat{r}}}{2\pi} |r|^{\alpha}e^{ir{\hat{r}}} 
[2\cos(kh+{\hat{r}})]^{\frac{n+\sigma}{2}}\;[2\cos(kh-{\hat{r}})]^{\frac{n-\sigma}{2}}\\
&\rightarrow \int\frac{dr\,d{\hat{r}}}{2\pi} |r|^{\alpha}e^{ir{\hat{r}}} 
\left[\frac{\cos(kh+{\hat{r}})}{\cos(kh-{\hat{r}})}\right]^{\frac\sigma 2}\; ,\end{aligned}$$ where the limit $n\to 0$ was performed in the last line and $\sigma:=\sum_a\sigma^a$. Using $\Lambda(n)\to 1$ for $n\to 0$ [@Remi] we therefore find from (\[eq:saddle\]) in the replica symmetric approximation $$\label{eq:h1}
  c(\sigma)= \exp\left(-|k|^{\alpha}\int dh P(h)\int\frac{dr\,d{\hat{r}}}{2\pi}
    |r|^{\alpha}\exp\Big(ir{\hat{r}}+\frac\sigma
    2\ln\frac{\cos(kh+{\hat{r}})}{\cos(kh-{\hat{r}})}\Big)\right)\; .$$ Using this result in (\[eq:Ph\]) and performing the transformations $r\mapsto r/k, {\hat{r}}\mapsto {\hat{r}}k$ we get $$\label{eq:Phrs}
  P(h)=\int\frac{ds}{2\pi}\exp
       \left(ish-\int dh' P(h')\int\frac{dr\,d{\hat{r}}}{2\pi} |r|^{\alpha}\exp\Big(ir{\hat{r}}+\frac s{2k}
       \ln\frac{\cos(kh'+k{\hat{r}})}{\cos(kh'-k{\hat{r}})}\Big)\right)\; .$$ We are now in the position to continue this result back to real values of the temperature by simply setting $k=i\beta$. In this way we find the following self-consistent equation for the replica symmetric field distribution $P(h)$ of a Levy spin-glass at inverse temperature $\beta$ $$\label{eq:resrs}
  P(h)=\int\frac{ds}{2\pi}\exp
    \left(ish-\int dh' P(h')\int\frac{dr\,d{\hat{r}}}{2\pi} |r|^{\alpha}\exp\Big(ir{\hat{r}}-i\frac s{2\beta}
    \ln\frac{\cosh\beta(h'+{\hat{r}})}{\cosh\beta(h'-{\hat{r}})}\Big)\right)\; .$$

Spin glass transition
=====================

From (\[eq:resrs\]) we infer that the paramagnetic field distribution, $P(h)=\delta(h)$, is always a solution. To test its stability we plug into the r.h.s. of (\[eq:resrs\]) a distribution $P_0(h)$ with a small second moment, $\epsilon_0:=\int dh P_0(h)\, h^2 \ll 1$, calculate the l.h.s. (to be denoted by $P_1(h)$) by linearizing in $\epsilon_0$ and compare the new second moment, $\epsilon_1:=\int dh P_1(h)\, h^2$, with $\epsilon_0$. We find $\epsilon_1>\epsilon_0$, [*i.e.*]{} instability of the paramagnetic state, if the temperature $T$ is smaller than a critical value $T_{f,{\alpha}}$ determined by $$(T_{f,{\alpha}})^{\alpha}=-\int\frac{dr\,d{\hat{r}}}{2\pi} |r|^{\alpha}e^{ir{\hat{r}}}
  \tanh^2 {\hat{r}}=-\frac{\Gamma({\alpha}+1)}{\pi}\,\cos(\frac{{\alpha}+1}{2} \pi)
      \int\frac{d{\hat{r}}}{|{\hat{r}}|^{{\alpha}+1}} \tanh^2 {\hat{r}}.$$ This result for the freezing temperature is essentially the same as the one obtained by CB using the cavity method [@CiBo]. Our somewhat more detailed prefactor ensures that the limit ${\alpha}\to 2$ correctly reproduces the value $T_f^{SK}=\sqrt{2}$ of the SK-model [@SK]. The dependence of $T_{f,{\alpha}}$ on ${\alpha}$ is shown in fig. \[f.1\].

![Freezing temperature $T_{c,{\alpha}}$ of an infinite-range spin-glass with Levy-distributed couplings as function of the parameter ${\alpha}$ of the Levy-distribution defined in (\[eq:defP\]). For the scaling of the coupling strength with $N$ as chosen in (\[eq:H\]) there is a finite transition temperature for all values of ${\alpha}$. In the limit ${\alpha}\to 2$ the result for the SK-model is recovered.[]{data-label="f.1"}](tclevy1.eps){width="60.00000%"}

The peculiarities of the spin-glass transition in the present system are apparent from the similarity between (\[eq:resrs\]) and analogous results for strongly diluted spin glasses and disordered spin systems on random graphs [@ViBr; @Remi; @MePa2]. To make this analogy more explicit we rewrite (\[eq:resrs\]) in a form that allows to perform the $s$-integration to obtain $$\begin{aligned}
\nonumber
  P(h) &=\int\frac{ds}{2\pi} e^{ish}  
     \sum_{d=0}^\infty \frac{(-1)^d}{d!} \int \prod_{i=1}^d 
 \Big(dh_i P(h_i)\frac{dr_i\,d{\hat{r}}_i}{2\pi} |r_i|^{\alpha}e^{ir_i{\hat{r}}_i}\Big)
    \exp\Big(-i\frac s{2\beta}\sum_{i=0}^d
    \ln\frac{\cosh\beta(h_i+{\hat{r}}_i)}{\cosh\beta(h_i-{\hat{r}}_i)}\Big)\\
  &=\sum_{d=0}^\infty \frac{(-1)^d}{d!} \int \prod_{i=1}^d 
  \Big(dh_i P(h_i)\frac{dr_i\,d{\hat{r}}_i}{2\pi} |r_i|^{\alpha}e^{ir_i{\hat{r}}_i}\Big)
  \;\delta\Big(h-\frac{1}{\beta}\sum_{i=0}^d 
          \tanh^{-1}(\tanh\beta h_i\tanh\beta{\hat{r}}_i)\Big)\; . \end{aligned}$$ This form of the self-consistent equation is similar to those derived within the cavity approach for systems with locally tree-like topology [@ViBr; @Remi; @HaWe] and may also form a suitable starting point for a numerical determination of $P(h)$ using a population-dynamical algorithm [@MePa2].

Discussion
==========

Infinite-range spin-glasses with Levy-distributed couplings are interesting examples of classical disordered systems. The broad variations in coupling strengths brought about by the power-law tails in the Levy-distribution violate the Lindeberg condition for the application of the central limit theorem and give rise to non-Gaussian cavity field distributions with diverging moments. We have shown that it is nevertheless possible to derive the replica symmetric properties of the system in a compact way by using the replica method as developed for the treatment of strongly diluted spin glasses and optimization problems [@Remi] which focuses from the start on the complete distribution of fields rather than on its moments.

Due to the long tails in the distribution of coupling strengths Levy spin-glasses interpolate between systems with many, i.e. $\mathcal{O}(N)$, weak couplings per spin as the Sherrington-Kirkpatrick model and systems with few, i.e. $\mathcal{O}(1)$, strong couplings per spin as the Viana-Bray model. The majority of the $N-1$ random interactions coupled to each spin are very weak (of order $N^{-1/{\alpha}}$). These weak couplings will influence only the very low temperature behaviour which may be expected to be similar to that of the SK-model. On the other hand the largest of $N$ random numbers drawn independently from the distribution (\[eq:defP\]) is of order $N^{1/{\alpha}}$ [@BoGe] and hence every spin also shares a fraction of strong bonds, $J_{ij}=\mathcal{O}(1)$, which are for $|J_{ij}|>1/\beta$ practically frozen. With decreasing temperature a growing backbone of frozen bonds builds up that percolates at the transition temperature $T_{f,{\alpha}}$ [@CiBo]. The mechanism for the freezing transition is hence rather different from that operating in the Sherrington-Kirkpatrick model and resembles the one taking place in disordered spin systems on random graphs with local tree-structure.

I would like to thank Daniel Grieser, Rémi Monasson and Martin Weigt for clarifying discussions.

[0]{} Binder K. and Young. A. P., [*Rev. Mod. Phys.*]{} [ **58**]{}, 801 (1986) Mezard M., Parisi G., and Virasoro M. A., [ *Spin-glass Theory and Beyond*]{} (World Scientific, Singapore, 1987) Monasson R., Zecchina R., Kirkpatrick S., Selman B., and Troyanski L., [*Nature*]{} [**400**]{}, 133 (1999) Mezard M., Parisi G., and Zecchina R., [*Science*]{} [**297**]{}, 812 (2002) Hartmann A. K. and Weigt M., [*Phase Transitions in Combinatorial Optimization Problems*]{} (Wiley VCH, Weinheim, 2005) Diederich S. and Opper M., [*Phys. Rev.*]{} [**A39**]{}, 4333 (1989) Berg J. and Engel A., [*Phys. Rev. Lett.*]{} [ **81**]{}, 4999 (1998) Engel A. and Van den Broeck C., [*Statistical Mechanics of Learning*]{}, (Cambrigde University Press, Cambrigde, 2001) Mislovaty R., Klein E., Kanter I., and Kinzel W., [*Phys. Rev. Lett.*]{} [**91**]{}, 118701 (2003) Sherrington D. and Kirkpatrick S., [*Phys. Rev. Lett.*]{} [**35**]{}, 1972 (1975) Viana L. and Bray A. J., [*J. Phys.*]{} [**C18**]{}, 3037 (1985) Kanter I. and Sompolinski H., [*Phys. Rev. Lett.*]{} [**58**]{}, 164 (1987) Mezard M. and Parisi G., [*Europhys. Lett.*]{} [**3**]{}, 1067 (1987) Burda Z., Jurkiewicz J., Nowak M. A., Papp G., and Zahed I., Biroli G., Bouchaud J.-P., and Potters M., Albert R. and Barabasi A.-L., [*Rev. Mod. Phys.*]{} [**74**]{}, 47 (2002) Roberts D. P. [*Int. J. Game Theory*]{} [**34**]{}, 167 (2006) Cizeau P. and Bouchaud J.-P., [*J. Phys.*]{} [ **A26**]{}, L187 (1993) Edwards S. F. and Anderson P. W., [*J. Phys.*]{} [ **F5**]{}, 965 (1975) Monasson R., [*J. Phys.*]{} [**A31**]{}, 513 (1998) Mezard M. and Parisi G., [*Eur. Phys. J. B*]{} [ **20**]{}, 217 (2001) Gnedenko B. V. and Kolmogorov A. N., [*Limit Distributions for Sums of Independent Random Variables*]{} (Addison-Wesley, Reading MA, 1954) Bouchaud J.-P. and Georges A., [*Phys. Rep.*]{} [ **195**]{}, 127 (1990), App. B
