# Fluctuations of the total entropy production in stochastic systems

## Abstract

Fluctuations of the total entropy are experimentally investigated in two stochastic systems in a non-equilibrium steady state : an electric circuit with an imposed mean current and a harmonic oscillator driven out of equilibrium by a periodic torque. In these two linear systems, we study the total entropy production which is the entropy created to maintain the system in the non-equilibrium steady state. Fluctuation theorem holds for the total entropy production in the two experimental systems, both for all observation times and for all fluctuation magnitudes.

###### pacs:

05.40.-a###### pacs:

05.70.-aFluctuation phenomena, random processes, noise, and Brownian motion Thermodynamics

Thermodynamics of systems at equilibrium has been developed by defining the internal energy, the injected work, and the dissipated heat. The first law of Thermodynamics describes energy conservation and gives a relation between those three energies. The second law of Thermodynamics imposes that the entropy variation is positive for a closed system. Statistical Physics further gives a microscopic definition of entropy, which allows analytical results on entropy production. The extension of Thermodynamics to systems in non-equilibrium steady states is an active field of research. Within this context, the first law has been extended for stochastic systems described by a Langevin equation [1, 2, 3]. It has been noted that the second law is not verified at all times but only in average, i.e. over macroscopic times : entropy production can have instantaneously negative values. The probabilities of getting positive and negative entropy production are quantitatively related in non-equilibrium systems by the Fluctuation Theorem (FT). This theorem has been first demonstrated in deterministic systems [4, 5, 6] and secondly extended to stochastic dynamics [7, 8, 9, 10]. FTs for work and heat fluctuations have been theoretically and experimentally studied in Brownian systems described by the Langevin equation [11, 12, 13, 14, 15, 16, 17, 3, 2, 18]. For these systems in non-equilibrium steady state, Fluctuation Theorems hold only in the limit of infinite time:

(1) |

where is the Boltzmann constant, the temperature of the heat bath and is the probability density function (PDF) of . is called symmetry function and stands for either injected work or dissipated heat, averaged over a time lag . For the injected work, eq. 1 is valid for all fluctuation magnitudes ; for the dissipated heat, eq. 1 is satisfied for values lower than the mean value [13].

We are interested here in the total entropy production in a non-equilibrium steady state (NESS), introduced in ref. [19, 20, 21] and directly related to previous work on housekeeping heat [22, 23]. Entropy production has been studied both theoretically and experimentally in several systems [24, 25, 26, 27, 28, 29, 30]. In [19], Seifert and Speck have shown that the total entropy production for a stochastic system described by a first order Langevin equation in a NESS satisfies a Detailed Fluctuation Theorem (DFT) :

(2) |

The relation (2) is valid for all integration time and all fluctuation magnitudes of the total entropy production. This relation is closely related to the Jarzynski and Crooks non-equilibrium work relations [31, 32] which can be exploited to measure equilibrium free energy in experiments [33, 34, 35, 36, 37] and it has been extended to Markov processes [38].

In this Letter, we measure the total entropy production in two out-of-equilibrium systems and show that this quantity verifies eq. (2). In the first part of the letter, we recall the general definition of dissipated heat, ”trajectory-dependent” entropy and total entropy production. In the second part, we detail our two experimental systems. The first one is an electric circuit maintained in a NESS by an injected mean current. The second system is a torsion pendulum driven in a NESS by forcing it with a periodic torque.

The heat dissipated by the system is the heat given to the thermostat during a time ; we note it . It is related to the work , given to the system during the time , and to the variation of internal energy during this period, thanks to the first law of Thermodynamics:

(3) |

Expressions of and for our two experimental setups are given below. Following notations of ref [19], we define the entropy variation in the system during a time as :

(4) |

where is the temperature of the heat bath. For thermostated systems, entropy change in medium behaves like the dissipated heat. The non-equilibrium Gibbs entropy is :

(5) |

where denotes the set of control parameters at time and is the probability density function to find the particle at a position at time , for the state corresponding to . This expression allows the definition of a ”trajectory-dependent” entropy :

(6) |

The variation of the total entropy during a time is the sum of the entropy change in the system during and the variation of the ”trajectory-dependent” entropy in a time , :

(7) |

In this letter, we study fluctuations of computed using (4) and (6). We will show that satisfies a DFT (eq. (2)). In ref. [38], the relevance of boundary terms like has already been pointed out.

Our first experimental system is an electric circuit composed of a resistance M in parallel with a capacitance pF [15]. The time constant of the circuit is ms. The voltage across the dipole fluctuates due to Johnson-Nyquist thermal noise. We drive the system out of equilibrium by injecting a constant controlled current A. After some , the system is in a NESS. Electric laws give in this setup [15] :

(8) |

where is the Gaussian thermal noise, delta-correlated in time of variance .

Multiplying (8) by and integrating it between and , we define the work , injected into the system, and the dissipated heat , together with the internal energy :

(9) | |||||

(10) | |||||

(11) |

where is the current flowing in the resistance : . This system has only one degree of freedom, so the trajectory in phase space is defined by the voltage alone, and the only external parameter is the constant current . So the variation of the ”trajectory-dependent” entropy during a time is :

(12) |

Fluctuation relations for the injected work and the dissipated heat (or entropy change in medium) in this system have been reported in [15]. Let us recall the experimental results for the dissipated heat , for several values of the integration time. Its average value is equal to the average of injected work and linear in . The PDFs of are plotted in figure 1a) for four values of . They are not Gaussian for small times and extreme events have an exponential distribution. We now describe new results in this system. The PDF of the ”trajectory-dependent” entropy is plotted in figure 1b) ; we have superposed to it the PDF of at equilibrium ( A). These two PDFs are independent of the integration time. The two curves match perfectly within experimental errors. Therefore the ”trajectory-dependent” entropy is equal in this case to the fluctuations of the entropy exchanged with the thermal bath at equilibrium. The average value of this ”trajectory-dependent” entropy is zero within experimental errors ; so the total entropy production has the same average value than the entropy . The PDFs of the total entropy , computed by adding to , are plotted in figure 1c) for different values of ; they are all Gaussian.

In figure 1d), we have plotted the symmetry functions of the dissipated heat () together with those of the total entropy. is a non linear function of . The linearity is recovered for . The slope tends to for large integration time. Entropy change in medium satisfies relation (1) [15]. On the contrary, the symmetry functions for the total entropy are linear with for all integration times and for all values of : . The slope is equal to for all integration times within experimental errors. Measurements can be done for other values of injected current and we find the same results. Thus total entropy satisfies relation (2).

This experimental result can be explained using a first order Langevin equation and noting that fluctuations of the voltage , when a current is applied, are identical to those at equilibrium [15]. Thus the voltage has a Gaussian distribution with mean and variance , whereas its autocorrelation function is the same out of equilibrium and at equilibrium:

(13) |

So we can compute the expression of the ”trajectory-dependent” entropy from eq. (12) and we find:

(14) |

Fluctuations of the voltage are identical to those at equilibrium, thus ”trajectory-dependent” entropy is equal to the variation of internal energy divided by at equilibrium and to the opposite of the entropy variation in the system at equilibrium. Using eq. (7), (10) and (14), the expression of the total entropy is :

(15) |

We experimentally see that the PDF of is Gaussian, so fully characterized by its mean value and its variance. Its average value is linear in () and equals the mean injected work divided by the temperature . Its variance is computed using eq. (13) and we obtain . For a Gaussian distribution, the symmetry function of is linear with , that is . The slope is related to the mean and the variance of the total entropy : . Experimentally, we have normalized the total entropy by , and the slope is equal to for any as shown in fig. 1d).

We now consider the second experimental system. It is a torsion pendulum in a viscous fluid which acts as a thermal bath at temperature . The system is driven out of equilibrium by an external deterministic time dependent torque . All the details of the experimental setup can be found in [3]. The torsional stiffness of the oscillator is N.m.rad, its viscous damping , its total moment of inertia , its resonant frequency Hz and its relaxation time ms. The angular motion of the oscillator obeys a second order Langevin equation :

(16) |

where is the thermal noise, delta-correlated in time of variance . The work injected into the system between and is :

(17) |

The dissipated heat is computed according to eq. (3) where, in this case, the internal energy is :

(18) |

We investigate a periodic forcing : ( pN.m and Hz). The integration time is chosen to be a multiple of the period of the forcing : . The average responses of the system and are periodic function of the pulsation and the system is in a steady state. Results for injected work and dissipated heat in this case are reported in [17, 3].

The ”trajectory-dependent” entropy is not as simple as in the case of the resistance. The system has two independent degrees of freedom ( and ) and its expression is :

(19) |

The DFT (eq. (2)) is valid for each fixed starting phase [21]. For computing correctly the total entropy, we have to calculate the PDFs of the angular position and the angular velocity for each initial phase . Then we compute the ”trajectory-dependent” entropy. As fluctuations of and are independent of [3]. These distributions correspond to the equilibrium fluctuations of and around the mean trajectory defined by and . As a consequence, we can average over which improves a lot the statistical accuracy. We stress that it is not equivalent to calculate first the PDFs over all values of — which would correspond here to the convolution of the PDF of the fluctuations with the PDF of a periodic signal — and then compute the trajectory dependent entropy.

In figure 2a), we recall the main results for the dissipated heat . Its average value is linear in and equal to the injected work. The PDFs of are not Gaussian and extreme events have an exponential distribution. Let us now describe new results in this system. The PDF of the ”trajectory-dependent” entropy is plotted in fig. 2b); it is independent of . We superpose to it the PDF of the variation of internal energy divided by at equilibrium : the two curves match perfectly within experimental errors, so the ”trajectory-dependent” entropy can again be considered as the entropy exchanged with the thermostat if the system is at equilibrium. The average value of is zero, so the average value of the total entropy is equal to the average of injected power divided by . In fig. 2c), we plot the PDFs of the normalized total entropy for four typical values of integration time. We find that the PDFs are Gaussian for any time.

The symmetry functions of the dissipated heat and the total entropy are plotted in fig. 2d). For the dissipated heat, the symmetry function is a non linear function of and we observe a linear behavior for with a slope that tends to for large time. For the normalized total entropy, the symmetry functions are linear with for all values of and the slope is equal to for all values of . Note that it is not exactly the case for the first values of because these are the times over which the statistical errors are the largest and the error in the slope is large.

In ref. [3], we have already shown that, when a torque is applied, the fluctuations around have the same statistics and the same dynamics as fluctuations at equilibrium. Using the expression of the distribution of the angular position and the angular velocity, we can compute the ”trajectory-dependent” entropy from eq. (19):

(20) | |||||

where and are the fluctuations around the mean trajectory : and . The ”trajectory-dependent” entropy is equivalent to the variation of internal energy for the system at equilibrium divided by the temperature of the bath. The total entropy is :

(21) | |||||

Experimentally, we observe that the PDF of the total entropy is Gaussian. We can calculate the mean value and the variance of the total entropy for any . We find that is equal to the injected work. Using the first law of thermodynamics and the equation of motion, we write the dissipated heat as the difference between the viscous dissipation and the work of the thermal noise :

(22) |

This expression holds at equilibrium as well as out of equilibrium. The only difference is that when out of equilibrium and . After some algebra the total entropy is :

(23) | |||||

The average value of the total entropy is and its variance is :

(24) | |||||

(25) |

The first term in the function is the autocorrelation function of the angular velocity. This function is symmetric around . The second term is the correlation function of the angular velocity with the noise. Due to the causality principle, this term vanishes if . Changing variables to and , eq. (24) can be rewritten :

(26) | |||

(27) |

After some algebra we can show that the correlation function is two times the autocorrelation function , therefore . Thus we obtain that the variance of the total entropy is equal to . The Fluctuation Relation for the total entropy is : for all times , for all values of and for any kind of stationary forcing.

For our two experimental systems, we have obtained that the ”trajectory-dependent” entropy can be considered as the entropy variation in the system in a time that one would have if the system was at equilibrium. Therefore the total entropy is the additional entropy due to the presence of the external forcing : this is the part of entropy which is created due to the non-equilibrium stationary process. The derivation we gave for a second order Langevin equation can be extended to a first order Langevin equation : total entropy (or excess entropy) satisfies the Fluctuation Theorem for all times and for all kind of stationary intensity injected in the circuit or all kind of stationary external torque. The ratio between the average value of the total entropy at (relaxation time) and the variance of fluctuations the entropy variation at equilibrium characterizes the distance from equilibrium :

(28) |

where is the number of degrees of freedom. For the second equality, we use the Gaussianity of , i.e. and the variance of of the fluctuation of entropy variation at equilibrium in terms of , i.e. . It turns out that this expression for is the same that was defined in [3] with a completely different approach. Eq. (28) indicates that, when the system is driven far from equilibrium, becomes negligible. As a consequence the fluctuations of the total entropy become equal to the fluctuations of the entropy variation in the system in a time . In other words, the PDFs of the dissipated heat far from equilibrium are Gaussian.

In conclusion, we have studied the total entropy when the system is driven in a non-equilibrium steady state. We have shown that the Fluctuation Theorem for the total entropy is valid not only in the limit of large times, as it is the case for injected work and dissipated heat, but also for all integration times and all fluctuation amplitudes. In the two examples we have discussed, the total entropy corresponds to the difference between the entropy change in medium out of equilibrium and at equilibrium.

We thank U. Seifert and K. Gawedzki for useful discussions. This work has been partially supported by ANR-05-BLAN-0105-01.

### References

- \NameK. Sekimoto \ReviewProgress of Theoretical Phys. supplement \Vol130 \Page17 \Year1998
- \NameV. Blickle, T. Speck, L. Helden, U. Seifert, C. Bechinger \ReviewPhys. Rev. Lett. \Vol96 \Page070603 \Year2006
- \NameS. Joubaud, N.B. Garnier S. Ciliberto \ReviewJ. Stat. Mech.: Theory and Experiment \PageP09018 \Year2007
- \NameD.J. Evans, E.G.D. Cohen G.P. Morriss \ReviewPhys. Rev. Lett. \Vol71 \Page2401 \Year1993
- \NameG. Gallavotti E.G.D. Cohen \ReviewPhys. Rev. Lett. \Vol74 \Page2694 \Year1995; \NameG. Gallavotti E.G.D. Cohen \ReviewJ. Stat. Phys. \Vol80(5-6) \Page931 \Year1995
- \NameD.J. Evans D.J. Searles \ReviewPhys. Rev. E \Vol50 \Page1645 \Year1994; \NameD.J. Evans D.J. Searles \ReviewAdvances in Physics \Vol51(7) \Page1529 \Year2002; \NameD.J. Evans, D.J. Searles L. Rondoni \ReviewPhys. Rev. E \Vol71(5) \Page056120 \Year2005
- \NameJ. Kurchan \ReviewJ. Phys. A : Math. Gen. \Vol31 \Page3719 \Year1998
- \NameJ.L. Lebowitz and H. Spohn \ReviewJ. Stat. Phys. \Vol95 \Page333 \Year1999
- \NameR.J. Harris G.M. Schütz \ReviewJ. Stat. Mech. Theory and Experiment \PageP07020 \Year2007
- \NameR. Chetrite K. Gawedzki \Reviewcond-mat \PagearXiv:0707.2725 \Year2007
- \NameJ. Farago \ReviewJ. Stat. Phys. \Vol107 \Page781 \Year2002; \ReviewPhysica A \Vol331 \Page69 \Year2004
- \NameR. van Zon E.G.D. Cohen \ReviewPhys. Rev. Lett. \Vol91(11) \Page110601 \Year2003; \NameR. van Zon E.G.D. Cohen \ReviewPhys. Rev. E \Vol67 \Page046102 \Year2003; \NameR. van Zon, S. Ciliberto E.G.D. Cohen \ReviewPhys. Rev. Lett. \Vol92(13) \Page130601 \Year2004
- \NameR. van Zon E.G.D. Cohen \ReviewPhys. Rev. E \Vol69 \Page056121 \Year2004;
- \NameG.M. Wang, E.M. Sevick, E. Mittag, D.J. Searles D.J. Evans \ReviewPhys. Rev. Lett. \Vol89 \Page050601 \Year2002; \NameG.M. Wang, J.C. Reid, D.M. Carberry, D.R.M. Williams, E.M. Sevick D.J. Evans \ReviewPhys. Rev. E \Vol71 \Page046142 \Year2005
- \NameN. Garnier and S. Ciliberto \ReviewPhys. Rev. E \Vol71 \Page060101(R) \Year2005
- \NameA. Imparato, L. Peliti, G. Pesce, G. Rusciano A. Sasso \Reviewcond-mat \PagearXiv:0706.0439 \Year2007; \NameA. Imparato L. Peliti \ReviewEurophys. Lett. \Vol70 \Page740-746 \Year2005
- \NameF. Douarche, S. Joubaud, N. Garnier, A. Petrosyan and S. Ciliberto \REVIEWPhys. Rev. Lett.971406032006
- \NameT. Taniguchi and E.G.D. Cohen \ReviewJ. Stat. Phys. \Vol127 \Page1-41 \Year2007; \NameT. Taniguchi and E.G.D. Cohen \Reviewcond-mat \PagearXiv:0708.2940 \Year2007
- \NameU. Seifert \ReviewPhys. Rev. Lett. \Vol95 \Page040602 \Year2005
- \NameT. Speck and U. Seifert \ReviewJ. Phys. A : Math. Gen. \Vol38 \PageL581-L588 \Year2005
- \NameU. Seifert \Reviewcond-mat \PagearXiv:0710.1187 \Year2007
- \NameY. Oono and M. Paniconi \ReviewProg. Theor. Phys. Supp. \Vol130 \Page29 \Year1998
- \NameT. Hatano S.-I. Sasa \ReviewPhys. Rev. Lett. \Vol86 \Page3463 \Year2001
- \NameE.H. Trepagnier, C. Jarzynski, F. Ritort, G.E. Crooks, C.J. Bustamante and J. Liphardt \ReviewProc. Natl. Acad. Sci. U.S.A. \Vol101 \Page15038 \Year2004
- \NameD. Andrieux, P. Gaspard, S. Ciliberto, N. Garnier, S. Joubaud A. Petrosyan \ReviewPhys. Rev. Lett. \Vol98 \Page150601 \Year2007
- \NameB. Cleuren, C. Van Den Broeck R. Kawai \ReviewPhys. Rev. E \Vol74 \Page021117 \Year2006
- \NameC. Tietz, S. Schuler, T. Speck, U. Seifert J. Wrachtrup \ReviewPhys. Rev. Lett. \Vol97 \Page050602 \Year2006.
- \NameA. Imparato L. Peliti \ReviewJ. Stat. Mech.: Theory and Experiment \PageL02001 \Year2007
- \NameA. Gomez-Marin I. Pagonabarraga \ReviewPhys. Rev. E \Vol74 \Page061113 \Year2006
- \NameT. Speck, V. Blickle, C. Bechinger and U. Seifert \ReviewEurophys. Lett. \Vol79 \Page30002 \Year2007
- \NameC. Jarzynski \ReviewPhys. Rev. Lett. \Vol78(14) \Page2690 \Year1997; \ReviewJ. Stat. Phys. \Vol98(1/2) \Page77 \Year2000
- \NameG.E. Crooks \ReviewPhys. Rev. E \Vol60(3) \Page2721 \Year1999
- \NameF. Douarche, S. Ciliberto, A. Petrosyan \ReviewJ. Stat. Mech.: Theory and Experiment \Pagep09011 \Year2005
- \NameD. Collin, F. Ritort, C. Jarzynski, S.B. Smith, I. Tinoco Jr. C. Bustamante \ReviewNature \Vol437 \Page231 \Year2005
- \NameF. Ritort, C. Bustamante I. Tinoco Jr. \ReviewPNAS \Vol99 \Page13544 \Year2002
- \NameG. Hummer A. Szabo \ReviewAcc. Chem. Res. \Vol38 \Page504-513 \Year2005
- \NameS. Park K. Schulten \ReviewJ. Chem. Phys. \Vol120 \Page5946 \Year2004
- \NameA. Puglisi, L. Rondoni A. Vulpiani \ReviewJ. Stat. Mech.: Theory and Experiment \PageP08010 \Year2006