Einstein originally introduced the constant in 1917 to counterbalance the effect of gravity and achieve a static universe, a notion that was the accepted view at the time. Einstein's cosmological constant was abandoned after the Hubble's confirmation that the universe was expanding. From the 1930s until the late 1990s, most physicists agreed with Einstein's choice of setting the cosmological constant to zero. That changed with the discovery in 1998 that the expansion of the universe is accelerating, implying that the cosmological constant may have a positive value.
Since the 1990s, studies have shown that, assuming the cosmological principle, around 68% of the mass–energy density of the universe can be attributed to so-called dark energy. The cosmological constant Λ is the simplest possible explanation for dark energy, and is used in the current standard model of cosmology known as the ΛCDM model.
According to quantum field theory (QFT), which underlies modern particle physics, empty space is defined by the vacuum state, which is composed of a collection of quantum fields. All these quantum fields exhibit fluctuations in their ground state (lowest energy density) arising from the zero-point energy present everywhere in space. These zero-point fluctuations should act as a contribution to the cosmological constant Λ, but when calculations are performed, these fluctuations give rise to an enormous vacuum energy. The discrepancy between theorized vacuum energy from quantum field theory and observed vacuum energy from cosmology is a source of major contention, with the values predicted exceeding observation by some 120 orders of magnitude, a discrepancy that has been called "the worst theoretical prediction in the history of physics". This issue is called the cosmological constant problem and it is one of the greatest mysteries in science with many physicists believing that "the vacuum holds the key to a full understanding of nature".
Einstein included the cosmological constant as a term in his field equations for general relativity because he was dissatisfied that otherwise his equations did not allow for a static universe: gravity would cause a universe that was initially non-expanding to contract. To counteract this possibility, Einstein added the cosmological constant. However, soon after Einstein developed his static theory, observations by Edwin Hubble indicated that the universe appears to be expanding; this was consistent with a cosmological solution to the original general relativity equations that had been found by the mathematician Friedmann, working on the Einstein equations of general relativity. Einstein reportedly referred to his failure to accept the validation of his equations—when they had predicted the expansion of the universe in theory, before it was demonstrated in observation of the cosmological redshift—as his "biggest blunder".
It transpired that adding the cosmological constant to Einstein's equations does not lead to a static universe at equilibrium because the equilibrium is unstable: if the universe expands slightly, then the expansion releases vacuum energy, which causes yet more expansion. Likewise, a universe that contracts slightly will continue contracting.
However, the cosmological constant remained a subject of theoretical and empirical interest. Empirically, the cosmological data of recent decades strongly suggests that our universe has a positive cosmological constant. The explanation of this small but positive value is a remaining theoretical challenge, the so-called cosmological constant problem.
In 1915, Einstein publishes his equations of general relativity, without a cosmological constant Λ.
In 1917, Einstein adds the parameter Λ to his equations when he realizes that his theory implies a dynamic universe for which space is function of time. He then gives this constant a value that makes his Universe model remain static and eternal (Einstein static universe).
In 1922, the Russian physicist Alexander Friedmann mathematically shows that Einstein's equations (whatever Λ) remain valid in a dynamic universe.
In 1927, the Belgian astrophysicist Georges Lemaître shows that the Universe is expanding by combining general relativity with astronomical observations, those of Hubble in particular.
In 1931, Einstein accepts the theory of an expanding universe and proposes, in 1932 with the Dutch physicist and astronomer Willem de Sitter, a model of a continuously expanding Universe with zero cosmological constant (Einstein–de Sitter spacetime).
In 1998, two teams of astrophysicists, one led by Saul Perlmutter, the other led by Brian Schmidt and Adam Riess, carried out measurements on distant supernovae which showed that the speed of galaxies' recession in relation to the Milky Way increases over time. The universe is in accelerated expansion, which requires having a strictly positive Λ. The universe would contain a mysterious dark energy producing a repulsive force that counterbalances the gravitational braking produced by the matter contained in the universe (see Standard cosmological model).
Estimated ratios of dark matter and dark energy (which may be the cosmological constant) in the universe. According to current theories of physics, dark energy now dominates as the largest source of energy of the universe, in contrast to earlier epochs when it was insignificant.
The cosmological constant has the same effect as an intrinsic energy density of the vacuum, ρvac (and an associated pressure). In this context, it is commonly moved to the right-hand side of the equation using Λ = κρvac. It is common to quote values of energy density directly, though still using the name "cosmological constant". The dimension of Λ is generally understood as length−2.
Using the values known in 2018 and Planck units for ΩΛ = 0.6889±0.0056 and the Hubble constantH0 = 67.66±0.42 (km/s)/Mpc = (2.1927664±0.0136)×10−18 s−1,
Λ has the value of
where is the Planck length. A positive vacuum energy density resulting from a cosmological constant implies a negative pressure, and vice versa. If the energy density is positive, the associated negative pressure will drive an accelerated expansion of the universe, as observed. (See Dark energy and Cosmic inflation for details.)
ΩΛ (Omega sub Lambda)
Instead of the cosmological constant itself, cosmologists often refer to the ratio between the energy density due to the cosmological constant and the critical density of the universe, the tipping point for a sufficient density to stop the universe from expanding forever. This ratio is usually denoted by ΩΛ and is estimated to be 0.6889±0.0056, according to results published by the Planck Collaboration in 2018.
In a flat universe, ΩΛ is the fraction of the energy of the universe due to the cosmological constant, i.e., what we would intuitively call the fraction of the universe that is made up of dark energy. Note that this value changes over time: The critical density changes with cosmological time but the energy density due to the cosmological constant remains unchanged throughout the history of the universe, because the amount of dark energy increases as the universe grows but the amount of matter does not.
Equation of state
Another ratio that is used by scientists is the equation of state, usually denoted w, which is the ratio of pressure that dark energy puts on the universe to the energy per unit volume. This ratio is w = −1 for the cosmological constant used in the Einstein equations; alternative time-varying forms of vacuum energy such as quintessence generally use a different value. The value w = −1.028±0.032, measured by the Planck Collaboration (2018) is consistent with −1, assuming w does not change over cosmic time.
Lambda-CDM, accelerated expansion of the universe. The time-line in this schematic diagram extends from the Big Bang/inflation era 13.7 Byr ago to the present cosmological time.
Observations announced in 1998 of distance–redshift relation for Type Ia supernovae indicated that the expansion of the universe is accelerating, if one assumes the cosmological principle. When combined with measurements of the cosmic microwave background radiation these implied a value of ΩΛ ≈ 0.7, a result which has been supported and refined by more recent measurements (as well as previous works). If one assumes the cosmological principle, as in the case for all models that use the Friedmann–Lemaître–Robertson–Walker metric, while there are other possible causes of an accelerating universe, such as quintessence, the cosmological constant is in most respects the simplest solution. Thus, the Lambda-CDM model, the current standard model of cosmology which uses the FLRW metric, includes the cosmological constant, which is measured to be on the order of 10−52 m−2. It may be expressed as 10−35 s−2 (by multiplication with c2, i.e. ≈1017 m⋅s−2) or as 10−122ℓP−2 (where ℓP is the Planck length). The value is based on recent measurements of vacuum energy density, ρvac = 5.96×10−27 kg/m3 ≘ 5.3566×10−10 J/m3 = 3.35 GeV/m3. However, due to the Hubble tension and the CMB dipole, recently it has been proposed that the cosmological principle is no longer true in the late universe and that the FLRW metric breaks down, so it is possible that observations usually attributed to an accelerating universe are simply a result of the cosmological principle not applying in the late universe.
Such arguments are usually based on dimensional analysis and effective field theory. If the universe is described by an effective local quantum field theory down to the Planck scale, then we would expect a cosmological constant of the order of ( in reduced Planck units). As noted above, the measured cosmological constant is smaller than this by a factor of ~10120. This discrepancy has been called "the worst theoretical prediction in the history of physics".
One possible explanation for the small but non-zero value was noted by Steven Weinberg in 1987 following the anthropic principle. Weinberg explains that if the vacuum energy took different values in different domains of the universe, then observers would necessarily measure values similar to that which is observed: the formation of life-supporting structures would be suppressed in domains where the vacuum energy is much larger. Specifically, if the vacuum energy is negative and its absolute value is substantially larger than it appears to be in the observed universe (say, a factor of 10 larger), holding all other variables (e.g. matter density) constant, that would mean that the universe is closed; furthermore, its lifetime would be shorter than the age of our universe, possibly too short for intelligent life to form. On the other hand, a universe with a large positive cosmological constant would expand too fast, preventing galaxy formation. According to Weinberg, domains where the vacuum energy is compatible with life would be comparatively rare. Using this argument, Weinberg predicted that the cosmological constant would have a value of less than a hundred times the currently accepted value. In 1992, Weinberg refined this prediction of the cosmological constant to 5 to 10 times the matter density.
This argument depends on the vacuum energy density being constant throughout spacetime, as would be expected if dark energy were the cosmological constant. There is no evidence that the vacuum energy does vary, but it may be the case if, for example, the vacuum energy is (even in part) the potential of a scalar field such as the residual inflaton (also see Quintessence). Another theoretical approach that deals with the issue is that of multiverse theories, which predict a large number of "parallel" universes with different laws of physics and/or values of fundamental constants. Again, the anthropic principle states that we can only live in one of the universes that is compatible with some form of intelligent life. Critics claim that these theories, when used as an explanation for fine-tuning, commit the inverse gambler's fallacy.
In 1995, Weinberg's argument was refined by Alexander Vilenkin to predict a value for the cosmological constant that was only ten times the matter density, i.e. about three times the current value since determined.
Failure to detect dark energy
An attempt to directly observe dark energy in a laboratory failed to detect a new force. Inferring the presence of dark energy through its interaction with baryons in the cosmic microwave background has also led to a negative result, although the current analyses have been derived only at the linear perturbation regime.
^ abIt may well be that dark energy is explained by a static cosmological constant, or that this mysterious energy is not constant at all and has changed over time, as in the case with quintessence, see for example:
"Physics invites the idea that space contains energy whose gravitational effect approximates that of Einstein's cosmological constant, Λ; nowadays the concept is termed dark energy or quintessence." Peebles & Ratra (2003), p. 1
"It would then appear that the cosmological fluid is dominated by some sort of fantastic energy density, which has negative pressure, and has just begun to play an important role today. No convincing theory has yet been constructed to explain this state of affairs, although cosmological models based on a dark energy component, such as the cosmological constant (Λ) or quintessence (Q), are leading candidates." Caldwell (2002), p. 2
^On the Cosmological Constant being thought to have zero value see for example:
"Since the cosmological upper bound on |⟨ρ⟩ + λ/8πG| was vastly less than any value expected from particle theory, most particle theorists simply assumed that for some unknown reason this quantity was zero." Weinberg (1989), p. 3
"Before 1998, there was no direct astronomical evidence for Λ and the observational upper bound was so strong (Λ < 10−120 Planck units) that many particle physicists suspected that some fundamental principle must force its value to be precisely zero." Barrow & Shaw (2011), p. 1
"The only other natural value is Λ = 0. If Λ really is tiny but not zero, it adds a most stimulating though enigmatic clue to physics to be discovered." Peebles & Ratra (2003), p. 333
"This gives an answer about 120 orders of magnitude higher than the upper limits on Λ set by cosmological observations. This is probably the worst theoretical prediction in the history of physics!" Hobson, Efstathiou & Lasenby (2006), p. 187
"This, as we will see later, is approximately 120 orders of magnitude larger than what is allowed by observation." Carroll, Press & Turner (1992), p. 503
"Theoretical expectations for the cosmological constant exceed observational limits by some 120 orders of magnitude." Weinberg (1989), p. 1
"the vacuum holds the key to a full understanding of nature" Davies (1985), p. 104
"The theoretical problem of explaining the cosmological constant is one of the greatest challenges of theoretical physics. It is most likely that we require a fully developed theory of quantum gravity (perhaps superstring theory) before we can understand Λ." Hobson, Efstathiou & Lasenby (2006), p. 188
^There is some debate over whether Einstein labelled the cosmological constant his "biggest blunder", with all references being traced back to a single person: George Gamow. (See Gamow (1956, 1970).) For example:
"Astrophysicist and author Mario Livio can find no documentation that puts those words into Einstein's mouth (or, for that matter, his pen). Instead, all references eventually lead back to one man—physicist George Gamow—who reported Einstein's use of the phrase in two sources: His posthumously published autobiography My World Line (1970) and a Scientific American article from September 1956." Rosen (2013)
" We also find it quite plausible that Einstein made such a statement to Gamow in particular. We conclude that there is little doubt that Einstein came to view the introduction of the cosmological constant a serious error, and that it is very plausible that he labelled the term his "biggest blunder" on at least one occasion". O'Raifeartaigh & Mitton (2018), p. 1