Einstein originally introduced the constant in 1917 to counterbalance the effect of gravity and achieve a static universe, a notion which was the accepted view at the time. Einstein abandoned the constant in 1931 after Hubble's confirmation of the expanding universe. From the 1930s until the late 1990s, most physicists agreed with Einstein's retraction, assuming the cosmological constant to be equal to zero. That changed with the surprising discovery in 1998 that the expansion of the universe is accelerating, implying the possibility of a positive value for the cosmological constant.
Since the 1990s, studies have shown that around 68% of the mass–energy density of the universe can be attributed to so-called dark energy. The cosmological constant Λ is the simplest possible explanation for dark energy, and is used in the current standard model of cosmology known as the ΛCDM model.
According to quantum field theory (QFT) which underlies modern particle physics, empty space is defined by the vacuum state which is a collection of quantum fields. All these quantum fields exhibit fluctuations in their ground state (lowest energy density) arising from the zero-point energy present everywhere in space. These zero-point fluctuations should act as a contribution to the cosmological constant Λ, but when calculations are performed these fluctuations give rise to an enormous vacuum energy. The discrepancy between theorized vacuum energy from quantum field theory and observed vacuum energy from cosmology is a source of major contention, with the values predicted exceeding observation by some 120 orders of magnitude, a discrepancy that has been called "the worst theoretical prediction in the history of physics". This issue is called the cosmological constant problem and it is one of the greatest mysteries in science with many physicists believing that "the vacuum holds the key to a full understanding of nature".
Einstein included the cosmological constant as a term in his field equations for general relativity because he was dissatisfied that otherwise his equations did not allow, apparently, for a static universe: gravity would cause a universe that was initially at dynamic equilibrium to contract. To counteract this possibility, Einstein added the cosmological constant. However, soon after Einstein developed his static theory, observations by Edwin Hubble indicated that the universe appears to be expanding; this was consistent with a cosmological solution to the original general relativity equations that had been found by the mathematician Friedmann, working on the Einstein equations of general relativity. Einstein reportedly referred to his failure to accept the validation of his equations—when they had predicted the expansion of the universe in theory, before it was demonstrated in observation of the cosmological redshift—as his "biggest blunder".
In fact, adding the cosmological constant to Einstein's equations does not lead to a static universe at equilibrium because the equilibrium is unstable: if the universe expands slightly, then the expansion releases vacuum energy, which causes yet more expansion. Likewise, a universe that contracts slightly will continue contracting.
However, the cosmological constant remained a subject of theoretical and empirical interest. Empirically, the onslaught of cosmological data in recent decades strongly suggests that our universe has a positive cosmological constant. The explanation of this small but positive value is an outstanding theoretical challenge, the so-called cosmological constant problem.
In 1915 Einstein publishes his equations of General Relativity, without a cosmological constant Λ.
In 1917 Einstein adds the parameter Λ to his equations when he realizes that his theory implies a dynamic universe for which space is function of time. He then gives this constant a very particular value to force his Universe model to remain static and eternal (Einstein static universe), which he will later call "the greatest stupidity of his life".
In 1922 the Russian physicist Alexander Friedmann mathematically shows that Einstein's equations (whatever Λ) remain valid in a dynamic universe.
In 1927 the Belgian astrophysicist Georges Lemaître shows that the Universe is in expansion by combining General Relativity with some astronomical observations, those of Hubble in particular.
In 1931 Einstein finally accepts the theory of an expanding universe and proposes, in 1932 with the Dutch physicist and astronomer Willem de Sitter, a model of a continuously expanding Universe with zero cosmological constant (Einstein-de Sitter space-time).
In 1998 two teams of astrophysicists, one led by Saul Perlmutter, the other led by Brian Schmidt and Adam Riess, carried out measurements on distant supernovae which showed that the speed of galaxies' recession in relation to the Milky Way increases over time. The universe is in accelerated expansion, which requires having a strictly positive Λ. The universe would contain a mysterious dark energy producing a repulsive force that counterbalances the gravitational braking produced by the matter contained in the universe (see standard cosmological model).
For this work, Perlmutter (American), Schmidt (American-Australian), and Riess (American) jointly received the Nobel Prize in physics in 2011.
Estimated ratios of dark matter and dark energy (which may be the cosmological constant) in the universe. According to current theories of physics, dark energy now dominates as the largest source of energy of the universe, in contrast to earlier epochs when it was insignificant.
where the Ricci tensor/scalar R and the metric tensor g describe the structure of spacetime, the stress-energy tensor T describes the energy and momentum density and flux of the matter in that point in spacetime, and the universal constants of gravitation G and the speed of light c are conversion factors that arise when using traditional units of measurement. When Λ is zero, this reduces to the field equation of general relativity usually used in the 20th century. When T is zero, the field equation describes empty space (the vacuum).
The cosmological constant has the same effect as an intrinsic energy density of the vacuum, ρvac (and an associated pressure). In this context, it is commonly moved onto the right-hand side of the equation, and defined with a proportionality factor of 8π: Λ = 8 π ρvac , where unit conventions of general relativity are used (otherwise factors of G and c would also appear, i.e., Λ = 8 π ρvac G / c4 = κ ρvac , where κ is Einstein's rescaled version of the gravitational constant G). It is common to quote values of energy density directly, though still using the name "cosmological constant", using Planck units so that 8πG = 1. The true dimension of Λ is length−2.
Using the values known in 2018 and Planck units for ΩΛ = 0.6889±0.0056 and the Hubble constantH0 = 67.66±0.42 (km/s)/Mpc = (2.1927664±0.0136)×10−18 s−1,
Λ has the value of
where is the Planck length. A positive vacuum energy density resulting from a cosmological constant implies a negative pressure, and vice versa. If the energy density is positive, the associated negative pressure will drive an accelerated expansion of the universe, as observed. (See Dark energy and Cosmic inflation for details.)
ΩΛ (Omega sub Lambda)
Instead of the cosmological constant itself, cosmologists often refer to the ratio between the energy density due to the cosmological constant and the critical density of the universe, the tipping point for a sufficient density to stop the universe from expanding forever. This ratio is usually denoted by ΩΛ and is estimated to be 0.6889±0.0056, according to results published by the Planck Collaboration in 2018.
In a flat universe, ΩΛ is the fraction of the energy of the universe due to the cosmological constant, i.e., what we would intuitively call the fraction of the universe that is made up of dark energy. Note that this value changes over time: The critical density changes with cosmological time but the energy density due to the cosmological constant remains unchanged throughout the history of the universe, because the amount of dark energy increases as the universe grows but the amount of matter does not.
Equation of state
Another ratio that is used by scientists is the equation of state, usually denoted w, which is the ratio of pressure that dark energy puts on the universe to the energy per unit volume. This ratio is w = −1 for the cosmological constant used in the Einstein equations; alternative time-varying forms of vacuum energy such as quintessence generally use a different value. The value w = −1.028±0.032, measured by the Planck Collaboration (2018) is consistent with −1, assuming w does not change over cosmic time.
Lambda-CDM, accelerated expansion of the universe. The time-line in this schematic diagram extends from the Big Bang/inflation era 13.7 Byr ago to the present cosmological time.
Observations announced in 1998 of distance–redshift relation for Type Ia supernovae indicated that the expansion of the universe is accelerating. When combined with measurements of the cosmic microwave background radiation these implied a value of ΩΛ ≈ 0.7, a result which has been supported and refined by more recent measurements. There are other possible causes of an accelerating universe, such as quintessence, but the cosmological constant is in most respects the simplest solution. Thus, the current standard model of cosmology, the Lambda-CDM model, includes the cosmological constant, which is measured to be on the order of 10−52 m−2, in metric units. It is often expressed as 10−35 s−2 (by multiplication with c2, i.e. ≈1017 m2⋅s−2) or as 10−122ℓP−2 (in units of the square of the Planck length, i.e. ≈10−70 m2). The value is based on recent measurements of vacuum energy density, .
Such arguments are usually based on dimensional analysis and effective field theory. If the universe is described by an effective local quantum field theory down to the Planck scale, then we would expect a cosmological constant of the order of ( in reduced Planck units). As noted above, the measured cosmological constant is smaller than this by a factor of ~10120. This discrepancy has been called "the worst theoretical prediction in the history of physics!"
One possible explanation for the small but non-zero value was noted by Steven Weinberg in 1987 following the anthropic principle. Weinberg explains that if the vacuum energy took different values in different domains of the universe, then observers would necessarily measure values similar to that which is observed: the formation of life-supporting structures would be suppressed in domains where the vacuum energy is much larger. Specifically, if the vacuum energy is negative and its absolute value is substantially larger than it appears to be in the observed universe (say, a factor of 10 larger), holding all other variables (e.g. matter density) constant, that would mean that the universe is closed; furthermore, its lifetime would be shorter than the age of our universe, possibly too short for intelligent life to form. On the other hand, a universe with a large positive cosmological constant would expand too fast, preventing galaxy formation. According to Weinberg, domains where the vacuum energy is compatible with life would be comparatively rare. Using this argument, Weinberg predicted that the cosmological constant would have a value of less than a hundred times the currently accepted value. In 1992, Weinberg refined this prediction of the cosmological constant to 5 to 10 times the matter density.
This argument depends on a lack of a variation of the distribution (spatial or otherwise) in the vacuum energy density, as would be expected if dark energy were the cosmological constant. There is no evidence that the vacuum energy does vary, but it may be the case if, for example, the vacuum energy is (even in part) the potential of a scalar field such as the residual inflaton (also see quintessence). Another theoretical approach that deals with the issue is that of multiverse theories, which predict a large number of "parallel" universes with different laws of physics and/or values of fundamental constants. Again, the anthropic principle states that we can only live in one of the universes that is compatible with some form of intelligent life. Critics claim that these theories, when used as an explanation for fine-tuning, commit the inverse gambler's fallacy.
In 1995, Weinberg's argument was refined by Alexander Vilenkin to predict a value for the cosmological constant that was only ten times the matter density, i.e. about three times the current value since determined.
Failure to detect dark energy
An attempt to directly observe dark energy in a laboratory failed to detect a new force. Inferring the presence of dark energy through its interaction with baryons in the cosmic microwave background has also lead to a negative result, although the current analyses have been derived only at the linear perturbation regime.
^ abIt may well be that dark energy is explained by a static cosmological constant, or that this mysterious energy is not constant at all and has changed over time, as in the case with quintessence, see for example:
"Physics invites the idea that space contains energy whose gravitational effect approximates that of Einstein's cosmological constant, Λ; nowadays the concept is termed dark energy or quintessence." Peebles & Ratra (2003), p. 1
"It would then appear that the cosmological fluid is dominated by some sort of fantastic energy density, which has negative pressure, and has just begun to play an important role today. No convincing theory has yet been constructed to explain this state of affairs, although cosmological models based on a dark energy component, such as the cosmological constant (Λ) or quintessence (Q), are leading candidates." Caldwell (2002), p. 2
^On the Cosmological Constant being thought to have zero value see for example:
"Since the cosmological upper bound on was vastly less than any value expected from particle theory, most particle theorists simply assumed that for some unknown reason this quantity was zero." Weinberg (1989), p. 3
"Before 1998, there was no direct astronomical evidence for Λ and the observational upper bound was so strong ( Λ < 10−120 Planck units) that many particle physicists suspected that some fundamental principle must force its value to be precisely zero." Barrow & Shaw (2011), p. 1
"The only other natural value is Λ = 0. If Λ really is tiny but not zero, it adds a most stimulating though enigmatic clue to physics to be discovered." Peebles & Ratra (2003), p. 333
"This gives an answer about 120 orders of magnitude higher than the upper limits on Λ set by cosmological observations. This is probably the worst theoretical prediction in the history of physics!" Hobson, Efstathiou & Lasenby (2006), p. 187
"This, as we will see later, is approximately 120 orders of magnitude larger than what is allowed by observation." Carroll, Press & Turner (1992), p. 503
"Theoretical expectations for the cosmological constant exceed observational limits by some 120 orders of magnitude." Weinberg (1989), p. 1
"the vacuum holds the key to a full understanding of nature" Davies (1985), p. 104
"The theoretical problem of explaining the cosmological constant is one of the greatest challenges of theoretical physics. It is most likely that we require a fully developed theory of quantum gravity (perhaps superstring theory) before we can understand Λ." Hobson, Efstathiou & Lasenby (2006), p. 188
^There is some debate over whether Einstein labelled the cosmological constant his "biggest blunder", with all references being traced back to a single person: George Gamow. (See Gamow (1956, 1970).) For example:
"Astrophysicist and author Mario Livio can find no documentation that puts those words into Einstein's mouth (or, for that matter, his pen). Instead, all references eventually lead back to one man—physicist George Gamow—who reported Einstein's use of the phrase in two sources: His posthumously published autobiography My World Line (1970) and a Scientific American article from September 1956." Rosen (2013)
" We also find it quite plausible that Einstein made such a statement to Gamow in particular. We conclude that there is little doubt that Einstein came to view the introduction of the cosmological constant a serious error, and that it is very plausible that he labelled the term his "biggest blunder" on at least one occasion". O'Raifeartaigh & Mitton (2018), p. 1