Bluff Your Way in the Second Law of Thermodynamics

https://doi.org/10.1016/S1355-2198(01)00016-8Get rights and content

Abstract

The aim of this article is to analyse the relation between the second law of thermodynamics and the so-called arrow of time. For this purpose, a number of different aspects in this arrow of time are distinguished, in particular those of time-reversal (non-)invariance and of (ir)reversibility. Next I review versions of the second law in the work of Carnot, Clausius, Kelvin, Planck, Gibbs, Carathéodory and Lieb and Yngvason, and investigate their connection with these aspects of the arrow of time. It is shown that this connection varies a great deal along with these formulations of the second law. According to the famous formulation by Planck, the second law expresses the irreversibility of natural processes. But in many other formulations irreversibility or even time-reversal non-invariance plays no role. I therefore argue for the view that the second law has nothing to do with the arrow of time.

Introduction

There is a famous lecture by the British physicist/novelist C. P. Snow about the cultural abyss between two types of intellectuals: those who have been educated in literary arts and those in the exact sciences. This lecture, The Two Cultures (Snow, 1959), characterises the lack of mutual respect between them in a passage:

A good many times I have been present at gatherings of people who, by the standards of the traditional culture, are thought highly educated and who have with considerable gusto been expressing their incredulity at the illiteracy of scientists. Once or twice I have been provoked and have asked the company how many of them could describe the Second Law of Thermodynamics. The response was cold: it was also negative. Yet I was asking something which is about the equivalent of: have you read a work of Shakespeare?


Snow stands up for the view that exact science is, in its own right, an essential part of civilisation, and should not merely be valued for its technological applications. Anyone who does not know the Second Law of Thermodynamics, and is proud of it too, exposes oneself as a philistine.

Snow's plea will strike a chord with every physicist who has ever attended a birthday party. But his call for cultural recognition creates obligations too. Before one can claim that acquaintance with the Second Law is as indispensable to a cultural education as Macbeth or Hamlet, it should obviously be clear what this law states. This question is surprisingly difficult.

The Second Law made its appearance in physics around 1850, but half a century later it was already surrounded by so much confusion that the British Association for the Advancement of Science decided to appoint a special committee with the task of providing clarity about the meaning of this law. However, its final report (Bryan, 1891) did not settle the issue. Half a century later, the physicist/philosopher Bridgman still complained that there are almost as many formulations of the Second Law as there have been discussions of it (Bridgman, 1941, p. 116). And even today, the Second Law remains so obscure that it continues to attract new efforts at clarification. A recent example is the work of Lieb and Yngvason (1999).

This manifest inability of the physical community to reach consensus about the formulation and meaning of a respectable physical law is truly remarkable. If Snow's question had been: ‘Can you describe the Second Law of Newtonian Mechanics?’, physicists would not have any problem in producing a unanimous answer. The idea of installing a committee for this purpose would be just ridiculous.

A common and preliminary description of the Second Law is that it guarantees that all physical systems in thermal equilibrium can be characterised by a quantity called entropy, and that this entropy cannot decrease in any process in which the system remains adiabatically isolated, i.e. shielded from heat exchange with its environment. But the law has many faces and interpretations; the comparison to a work of Shakespeare is, in this respect, not inappropriate.1 One of the most frequently discussed aspects of the Second Law is its relation with the ‘arrow of time’. In fact, in many texts in philosophy of physics the Second Law figures as an emblem of this arrow. The idea is, roughly, that typical thermodynamical processes are irreversible, i.e. they can occur in one sense only, and that this is relevant for the distinction between past and future.

At first sight, the Second Law is indeed relevant for this arrow. If the entropy can only increase during a thermodynamical process, then obviously, a reversal of this process is not possible. Many authors believe this is a crucial feature, if not the very essence of the Second Law. Planck, for example, claimed that, were it not for the existence of irreversible processes, ‘the entire edifice of the second law would crumble […] and theoretical work would have to start from the beginning’ (Planck, 1897, § 113), and viewed entropy increase as a ‘universal measure of irreversibility’ (ibid., § 134). A similar view is expressed by Sklar in his recent book on the foundations of statistical mechanics (1993, p. 21): ‘The crucial fact needed to justify the introduction of […] a definite entropy value is the irreversibility of physical processes’.

In this respect, thermodynamics seems to stand in sharp contrast with the rest of classical physics, in particular with mechanics which, at least in Hamilton's formulation, is invariant under time reversal. The problem of reconciling this thermodynamical arrow of time with a mechanical world picture is usually seen as the most profound problem in the foundations of thermal and statistical physics; see Davies (1974), Mackey (1992), Zeh (1992), Sklar (1993) and Price (1996).

However, this is only one of many problems awaiting a student of the Second Law. There are also authors expressing the opposite view. Bridgman writes:

It is almost always emphasized that thermodynamics is concerned with reversible processes and equilibrium states and that it can have nothing to do with irreversible processes or systems out of equilibrium (Bridgman, 1941, p. 133).

It is not easy to square this view—and the fact that Bridgman presents it as prevailing among thermodynamicists—with the idea that irreversibility is essential to the Second Law.

Indeed, one can find other authors maintaining that the Second Law has little to do with irreversibility or the arrow of time; in particular Ehrenfest-Afanassjewa 1925, Ehrenfest-Afanassjewa 1956, Ehrenfest-Afanassjewa 1959, Landsberg (1956) and Jauch 1972, Jauch 1975. For them, the conflict between the irreversibility of thermodynamics and the reversible character of the rest of physics is merely illusory, due to a careless confusion of the meaning of terms. For example, Landsberg remarks that the meaning of the term ‘reversible’ in thermodynamics has nothing to do with the meaning of this term in classical mechanics. However, a fundamental and consistent discussion of the meaning of these concepts is rare.

Another problem is that there are indeed many aspects and formulations of the Second Law, which differ more or less from the preliminary circumscription offered above. For example, consider the so-called ‘approach to equilibrium’. It is a basic assumption of thermodynamics that all systems which are left to themselves, i.e. isolated from all external influences, eventually evolve towards a state of equilibrium, where no further changes occur. One often regards this behaviour as a consequence of the Second Law. This view is also suggested by the well-known fact that equilibrium states can be characterised by an entropy maximum. However, this view is problematic. In thermodynamics, entropy is not defined for arbitrary states out of equilibrium. So how can the assumption that such states evolve towards equilibrium be a consequence of this law?

Even deliberate attempts at careful formulation of the Second Law sometimes end up in a paradox. One sometimes finds a formulation which admits that thermodynamics aims only at the description of systems in equilibrium states, and that, strictly speaking, a system does not always have an entropy during a process. The Second Law, in this view, refers to processes of an isolated system that begin and end in equilibrium states and says that the entropy of the final state is never less than that of the initial state (Sklar, 1974, p. 381). The problem here is that, by definition, states of equilibrium remain unchanged in the course of time, unless the system is acted upon. Thus, an increase of entropy occurs only if the system is disturbed, i.e. when it is not isolated.

It appears then that it is not unanimously established what the Second Law actually says and what kind of relationship it has with the arrow of time. The aim of the present paper is to chart this amazing and confusing multifariousness of the Second Law; if only to help prevent embarrassment when, at a birthday party, the reader is faced with the obvious counter-question by literary companions. Or, if the reader wishes to be counted as a person of literary culture, and guard against arrogant physicists, one can also read this article as a guide to how to bluff your way in the Second Law of Thermodynamics.

The organisation of the article is as follows. In Section 2, I will describe a few general characteristics of thermodynamics, and its status within physics. Section 3 is devoted to the distinction between several meanings one can attribute to the arrow of time. Next, in 4 The Prehistory of Thermodynamics: Carnot, 5 Clausius and Kelvin: The Introduction of the Second Law, 6 From the Steam Engine to the Universe (and Back Again), I will trace the historical development of the orthodox versions of the Second Law, focusing at each stage on its relation to the arrow of time. This historical development finds its climax in the intricate arguments of Planck, which I review in Section 7.

Then I address two less orthodox but perhaps more vital versions of the Second Law, due to Gibbs (Section 8) and Carathéodory (Section 9). I will argue that these versions do not carry implications for an arrow of time (with a slight qualification for Carathéodory). In Section 10, I discuss the debate in the 1920's between Born, Planck and Ehrenfest-Afanassjewa, which was triggered by the work of Carathéodory.

Despite a number of original defects, the approach pioneered by Carathéodory has in recent years turned out to be the most promising route to obtain a clear formulation of the Second Law. Section 11 is devoted to the work of Lieb and Yngvason, which forms the most recent major contribution to this approach. Finally, in Section 12, I will discuss some conclusions. In particular, I will discuss the prospects of giving up the idea that the arrow of time is crucially related to the Second Law.

Section snippets

The Status of Thermodynamics

Classical thermodynamics can be described as the study of phenomena involved in the production of work by means of heat; or, more abstractly, of the interplay of thermal and mechanical energy transformations. The theory is characterised by a purely empirical (often called ‘phenomenological’) approach. It avoids speculative assumptions about the microscopic constitution or dynamics of the considered systems. Instead, a physical system is regarded as a ‘black box’ and one starts from a number of

Possibility, Irreversibility, Time-Reversal Non-Invariance, Arrows and Ravages

In order to investigate the second law in more detail, it is necessary to get a tighter grip on some of the philosophical issues involved, in particular the topic of the arrow of time itself. But first there is an even more general issue which needs spelling out. As we have seen, the basis of the second law is a claim that certain processes are impossible. But there are various senses in which one can understand the term ‘possible’ or related dispositional terms. At least three of these are

The Prehistory of Thermodynamics: Carnot

Sadi Carnot's Réflexions sur la puissance motrice du feu appeared in 1824. It was this work which eventually led to the birth of thermodynamics. Still, Carnot's memoir itself does not belong to what we presently understand as thermodynamics. It was written from the point of view that heat is an indestructible substance, the so-called calorique. This assumption proved to be in conflict with empirical evidence.12

Clausius and Kelvin: The Introduction of the Second Law

The main contributions towards the development of thermodynamics are those by Kelvin (W. Thomson) and Clausius.19 Kelvin had noted in 1848 that Carnot's theorem allows

Universal dissipation

After the original introduction in 1850/1851 by Clausius and Kelvin the second law underwent a number of transformations before it was given the form in which we recognise it today, i.e. as the entropy principle. A development which, indeed, is no less impressive than the psychological development of Macbeth, where the loyal and rather credulous general evolves into a suspicious and cruel tyrant. Here too, the metamorphosis starts with the prophecy of a foul future.

In 1852 Kelvin proposed the

The Attempt at Clarification by Planck

If someone can be said to have codified the second law, and given it its definitive classical formulation, then it is Max Planck. His Vorlesungen über Thermodynamik went through eleven successive editions between 1897 and 1966 and represent the authoritative exposition of thermodynamics par excellence for the first half of this century.41

Gibbs

The work of Gibbs in thermodynamics (written in the years 1873–1878) is very different from that of his European colleagues. Where Clausius, Kelvin and Planck were primarily concerned with processes, Gibbs concentrates his efforts on a description of equilibrium states. He assumes that these states are completely characterised by a finite number of state variables like temperature, energy, pressure, volume, entropy, chemical potentials etc. He makes no effort to prove the existence or

Carathéodory

Constantin Carathéodory was the first mathematician to work on thermodynamics and to pursue its rigorous formalisation. For this purpose he developed a new version of the second law in 1909. Apparently, he had no revolutionary intentions in doing so. He emphasised that his purpose was merely to elucidate the mathematical structure of the theory, but that the physical content of his version of the second law was intimately related to the formulation by Planck. However, as we shall see, his

The Debate Between Born, Ehrenfest-Afanassjewa and Planck

Carathéodory's work did not immediately have much impact on the physics community. Only twelve years later, when Born (1921) formulated a popularised version of this work and explicitly presented it as a critique of the traditional formulation of thermodynamics, did physicists begin to pay attention.

I first mention some of the simplifications introduced in this paper. In the first place, Born's formulation of Carathéodory's principle is different:

Carathéodory's Principle (Born's version): In

Lieb and Yngvason

It goes without saying that I cannot treat all the numerous reformulations of the second law that have been attempted in the past 75 years. But this article would remain incomplete if I did not deal with a very recent contribution by Lieb and Yngvason (1999). These authors provide a new attempt to clarify the mathematical formulation and physical content of the second law. However, I cannot do justice to this important work in the context of this article: the paper is 96 pages long and employs

Summary and Moral

What is the relation between the second law of thermodynamics and the arrow of time? The deeper we go into this question, the more remote a clear-cut relation appears to be. Nevertheless, I think we can summarise this study by drawing several conclusions. Moreover, I argue below that it may be more fruitful to abandon the idea that time-reversal non-invariance or irreversibility is essential to the second law.

First of all, we have seen that a distinction should be made between time-reversal

Acknowledgements

I have benefited a great deal from discussions with and comments by Co Broeder, Craig Callender, Elliott Lieb, Janneke van Lith, John Norton, Henk de Regt, Jakob Yngvason and two anonymous referees. Thanks, all of you.

References (112)

  • Arnold, V. (1990) ‘Contact Geometry: The Geometrical Method of Gibbs’ Thermodynamics’, in D. Caldi and G. Mostow (eds),...
  • Becker, R. (1967) Theorie der Wärme (Berlin:...
  • P. Bergmann et al.

    New Approach to Non-Equilibrium Processes

    Physical Review

    (1955)
  • B. Bernstein

    Proof of Carathéodory's Local Theorem and its Global Application to Thermostatics

    Journal of Mathematical Physics

    (1960)
  • Bertrand, J. (1887) Thermodynamique (Paris:...
  • Boltzmann, L. (1872) ‘Weitere Studien über das Wärmegleichgewicht unter Gasmolekülen’, in F. Hasenöhrl (ed.),...
  • Born, M. (1921) ‘Kritische Betrachtungen zur traditionellen Darstellung der Thermodynamik’, Physikalische Zeitschrift...
  • J. Boyling

    Carathéodory's Principle and the Existence of Global Integrating Factors

    Communications in Mathematical Physics

    (1968)
  • Boyling, J. (1972) ‘An Axiomatic Approach to Classical Thermodynamics’, Proceedings of the Royal Society of London 329,...
  • Bridgman, P. (1941) The Nature of Thermodynamics (Cambridge, MA: Harvard University Press). Reprinted (Gloucester, MA:...
  • Brush, S. (1976) The Kind of Motion We Call Heat (Amsterdam:...
  • G. Bryan

    Report of a Committee, Consisting of Messrs J. Larmor and G. H. Bryan, on the Present State of Our Knowledge of Thermodynamics, Especially With Regard to the Second Law

    Report of the British Association for the Advancement of Science

    (1891)
  • Bryan, G. (1904) ‘The Law of Degradation of Energy as the Fundamental Principle of Thermodynamics’, in S. Meyer (ed.),...
  • Buchdahl, H. (1966) The Concepts of Classical Thermodynamics (Cambridge: Cambridge University...
  • Callen, H. (1960) Thermodynamics (New York: John Wiley and...
  • Callendar, H. (1911) ‘The Caloric Theory of Heat and Carnot's Principle’, Proceedings of the Physical Society of London...
  • Carathéodory, C. (1909) ‘Untersuchungen über die Grundlagen der Thermodynamik’, Mathematische Annalen 67, 355–386....
  • Carathéodory, C. (1925) ‘Über die Bestimmung der Energie und der absoluten Temperatur mit Hilfe von reversiblen...
  • Clausius, R. (1850) ‘Ueber die bewegende Kraft der Wärme und die Gesetze die sich daraus für die Wärmelehre selbst...
  • Clausius, R. (1862) ‘Ueber die Anwendung des Satzes von der Aequivalenz der Verwandlungen auf die innere Arbeit’, in...
  • Clausius, R. (1864a) Abhandlungungen über die mechanische Wärmetheorie, Vol. 1 (Braunschweig: F....
  • Clausius, R. (1864b) ‘Ueber die Concentration von Wärme- und Lichtstrahlen und die Gränzen ihrer Wirkung’, in Clausius...
  • Clausius, R. (1865) ‘Ueber verschiedene für die Anwendung bequeme Formen der Hauptgleichungen der mechanischen...
  • Clausius, R. (1867) Abhandlungungen über die mechanische Wärmetheorie, Vol. 2 (Braunschweig: F....
  • Clausius, R. (1876) Die mechanische Wärmetheorie (Braunschweig: F....
  • Davies, E. B. (1976) Quantum Theory of Open Systems (London: Academic...
  • Davies, P. (1974) The Physics of Time Asymmetry (London: Surrey University...
  • de Groot, S. (1951) Thermodynamics of Irreversible Processes (Amsterdam:...
  • K. Denbigh

    The Many Faces of Irreversibility

    British Journal for Philosophy of Science

    (1989)
  • D. Dieks

    Special Relativity and the Flow of Time

    Philosophy of Science

    (1988)
  • J. Earman

    Irreversibility and Temporal Asymmetry

    Journal of Philosophy

    (1967)
  • Eddington, A. (1935) The Nature of the Physical World (London: J.M. Dent &...
  • Einstein, A. (1948) ‘Autobiographical Notes’, in P. A. Schilpp (ed.), Albert Einstein, Philosopher-Scientist (La Salle:...
  • Ehrenfest-Afanassjewa, T. (1925) ‘Zur Axiomatisierung des zweiten Hauptsatzes der Thermodynamik’, Zeitschrift für...
  • Ehrenfest-Afanassjewa, T. (1956) Grundlagen der Thermodynamik (Leiden: E. J....
  • Ehrenfest, P. (1916) ‘On Adiabatic Changes of a System in Connection with the Quantum Theory’, Proceedings of the...
  • Ehrenfest-Afanassjewa, T. (1959) ‘Preface to the Translation’, in P. Ehrenfest and T. Ehrenfest-Afanassjewa, The...
  • Falk, G. and Jung, H. (1959) ‘Axiomatik der Thermodynamik’, in S. Flügge (ed.), Handbuch der Physik, Vol. III/2...
  • Garber, E., Brush, S. G., and Everitt, C. W. F. (eds). (1995) Maxwell on Heat and Statistical Mechanics (Bethlehem:...
  • Gibbs, J. (1906) The Scientific Papers of J. Willard Gibbs. Vol. 1: Thermodynamics (London: Longmans). Reprinted...
  • Giles, R. (1964) Mathematical Foundations of Thermodynamics (Oxford:...
  • Grünbaum, A. (1967) ‘The Anisotropy of Time’, in T. Gold (ed.), The Nature of Time (Ithaca, NY: Cornell University...
  • Hatsopoulos, J., and Keenan, G. (1965) Principles of General Thermodynamics (New York: John...
  • Helmholtz, H. von (1847) Über die Erhaltung der Kraft (Berlin: G....
  • Hollinger, H. and Zenzen, M. (1985) The Nature of Irreversibility (Dordrecht: D....
  • Hornix, W. (1993) ‘Wat Stelt de Tweede Hoofdwet van de Thermodynamica?’ (unpublished...
  • Horwich, P. (1987) Asymmetries in Time (Cambridge MA: MIT...
  • K. Hutchison

    Der Ursprung der Entropiefunktion bei Rankine und Clausius

    Annals of Science

    (1973)
  • J. Jauch

    On a New Foundation of Equilibrium Thermodynamics

    Foundations of Physics

    (1972)
  • J. Jauch

    Analytical Thermodynamics. Part 1. Thermostatics—General Theory

    Foundations of Physics

    (1975)
  • Cited by (155)

    • An informal reconstruction of the free-energy framework, examining the conceptual problems that arise

      2022, Neuropsychologia
      Citation Excerpt :

      Physical systems that are orderly in structure and well separated from their environment are often found to behave in this convergent way. This gives rise to the second law of thermodynamics, which states that the entropy (homogeneity) of an isolated physical system will always evolve towards its maximum (Uffink, 2001). Since at least (Schroedinger, 1944), it has been noted that living things appear to violate this physical law (Gatlin, 1972).

    • The five problems of irreversibility

      2021, Studies in History and Philosophy of Science
    View all citing articles on Scopus
    View full text