The De Bruijn-Newman constant is non-negative

What's new 2018-03-10

Brad Rodgers and I have uploaded to the arXiv our paper “The De Bruijn-Newman constant is non-negative“. This paper affirms a conjecture of Newman regarding to the extent to which the Riemann hypothesis, if true, is only “barely so”. To describe the conjecture, let us begin with the Riemann xi function

$\displaystyle \xi(s) := \frac{s(s-1)}{2} \pi^{-s/2} \Gamma(\frac{s}{2}) \zeta(s)$

where ${\Gamma(s) := \int_0^\infty e^{-t} t^{s-1}\ dt}$ is the Gamma function and ${\zeta(s) := \sum_{n=1}^\infty \frac{1}{n^s}}$ is the Riemann zeta function. Initially, this function is only defined for ${\mathrm{Re} s > 1}$ , but, as was already known to Riemann, we can manipulate it into a form that extends to the entire complex plane as follows. Firstly, in view of the standard identity ${s \Gamma(s) = \Gamma(s+1)}$ , we can write

$\displaystyle \frac{s(s-1)}{2} \Gamma(\frac{s}{2}) = 2 \Gamma(\frac{s+4}{2}) - 3 \Gamma( \frac{s+2}{2} )$

and hence

$\displaystyle \xi(s) = \sum_{n=1}^\infty 2 \pi^{-s/2} n^{-s} \int_0^\infty e^{-t} t^{\frac{s+4}{2}-1}\ dt - 3 \pi^{-s/2} n^{-s} \int_0^\infty e^{-t} t^{\frac{s+2}{2}-1}\ dt.$

By a rescaling, one may write

$\displaystyle \int_0^\infty e^{-t} t^{\frac{s+4}{2}-1}\ dt = (\pi n^2)^{\frac{s+4}{2}} \int_0^\infty e^{-\pi n^2 t} t^{\frac{s+4}{2}-1}\ dt$

and similarly

$\displaystyle \int_0^\infty e^{-t} t^{\frac{s+2}{2}-1}\ dt = (\pi n^2)^{\frac{s+2}{2}} \int_0^\infty e^{-\pi n^2 t} t^{\frac{s+2}{2}-1}\ dt$

and thus (after applying Fubini’s theorem)

$\displaystyle \xi(s) = \int_0^\infty \sum_{n=1}^\infty 2 \pi^2 n^4 e^{-\pi n^2 t} t^{\frac{s+4}{2}-1} - 3 \pi n^2 e^{-\pi n^2 t} t^{\frac{s+2}{2}-1}\ dt.$

We’ll make the change of variables ${t = e^{4u}}$ to obtain

$\displaystyle \xi(s) = 4 \int_{\bf R} \sum_{n=1}^\infty (2 \pi^2 n^4 e^{8u} - 3 \pi n^2 e^{4u}) \exp( 2su - \pi n^2 e^{4u} )\ du.$

If we introduce the mild renormalisation

$\displaystyle H_0(z) := \frac{1}{8} \xi( \frac{1}{2} + \frac{iz}{2} )$

of ${\xi}$ , we then conclude (at least for ${\mathrm{Im} z > 1}$ ) that

$\displaystyle H_0(z) = \frac{1}{2} \int_{\bf R} \Phi(u)\exp(izu)\ du \ \ \ \ \ (1)$

where ${\Phi: {\bf R} \rightarrow {\bf C}}$ is the function

$\displaystyle \Phi(u) := \sum_{n=1}^\infty (2 \pi^2 n^4 e^{9u} - 3 \pi n^2 e^{5u}) \exp( - \pi n^2 e^{4u} ), \ \ \ \ \ (2)$

which one can verify to be rapidly decreasing both as ${u \rightarrow +\infty}$ and as ${u \rightarrow -\infty}$ , with the decrease as ${u \rightarrow +\infty}$ faster than any exponential. In particular ${H_0}$ extends holomorphically to the upper half plane.

If we normalize the Fourier transform ${{\mathcal F} f(\xi)}$ of a (Schwartz) function ${f(x)}$ as ${{\mathcal F} f(\xi) := \int_{\bf R} f(x) e^{-2\pi i \xi x}\ dx}$ , it is well known that the Gaussian ${x \mapsto e^{-\pi x^2}}$ is its own Fourier transform. The creation operator ${2\pi x - \frac{d}{dx}}$ interacts with the Fourier transform by the identity

$\displaystyle {\mathcal F} (( 2\pi x - \frac{d}{dx} ) f) (\xi) = -i (2 \pi \xi - \frac{d}{d\xi} ) {\mathcal F} f(\xi).$

Since ${(-i)^4 = 1}$ , this implies that the function

$\displaystyle x \mapsto (2\pi x - \frac{d}{dx})^4 e^{-\pi x^2} = 128 \pi^2 (2 \pi^2 x^4 - 3 \pi x^2) e^{-\pi x^2} + 48 \pi^2 e^{-\pi x^2}$

is its own Fourier transform. (One can view the polynomial ${128 \pi^2 (2\pi^2 x^4 - 3 \pi x^2) + 48 \pi^2}$ as a renormalised version of the fourth Hermite polynomial.) Taking a suitable linear combination of this with ${x \mapsto e^{-\pi x^2}}$ , we conclude that

$\displaystyle x \mapsto (2 \pi^2 x^4 - 3 \pi x^2) e^{-\pi x^2}$

is also its own Fourier transform. Rescaling ${x}$ by ${e^{2u}}$ and then multiplying by ${e^u}$ , we conclude that the Fourier transform of

$\displaystyle x \mapsto (2 \pi^2 x^4 e^{9u} - 3 \pi x^2 e^{5u}) \exp( - \pi x^2 e^{4u} )$

$\displaystyle x \mapsto (2 \pi^2 x^4 e^{-9u} - 3 \pi x^2 e^{-5u}) \exp( - \pi x^2 e^{-4u} ),$

and hence by the Poisson summation formula (using symmetry and vanishing at ${n=0}$ to unfold the ${n}$ summation in (2) to the integers rather than the natural numbers) we obtain the functional equation

$\displaystyle \Phi(-u) = \Phi(u),$

which implies that ${\Phi}$ and ${H_0}$ are even functions (in particular, ${H_0}$ now extends to an entire function). From this symmetry we can also rewrite (1) as

$\displaystyle H_0(z) = \int_0^\infty \Phi(u) \cos(zu)\ du,$

which now gives a convergent expression for the entire function ${H_0(z)}$ for all complex ${z}$ . As ${\Phi}$ is even and real-valued on ${{\bf R}}$ , ${H_0(z)}$ is even and also obeys the functional equation ${H_0(\overline{z}) = \overline{H_0(z)}}$ , which is equivalent to the usual functional equation for the Riemann zeta function. The Riemann hypothesis is equivalent to the claim that all the zeroes of ${H_0}$ are real.

De Bruijn introduced the family ${H_t: {\bf C} \rightarrow {\bf C}}$ of deformations of ${H_0: {\bf C} \rightarrow {\bf C}}$ , defined for all ${t \in {\bf R}}$ and ${z \in {\bf C}}$ by the formula

$\displaystyle H_t(z) := \int_0^\infty e^{tu^2} \Phi(u) \cos(zu)\ du.$

From a PDE perspective, one can view ${H_t}$ as the evolution of ${H_0}$ under the backwards heat equation ${\partial_t H_t(z) = - \partial_{zz} H_t(z)}$ . As with ${H_0}$ , the ${H_t}$ are all even entire functions that obey the functional equation ${H_t(\overline{z}) = \overline{H_t(z)}}$ , and one can ask an analogue of the Riemann hypothesis for each such ${H_t}$ , namely whether all the zeroes of ${H_t}$ are real. De Bruijn showed that these hypotheses were monotone in ${t}$ : if ${H_t}$ had all real zeroes for some ${t}$ , then ${H_{t'}}$ would also have all zeroes real for any ${t' \geq t}$ . Newman later sharpened this claim by showing the existence of a finite number ${\Lambda \leq 1/2}$ , now known as the de Bruijn-Newman constant, with the property that ${H_t}$ had all zeroes real if and only if ${t \geq \Lambda}$ . Thus, the Riemann hypothesis is equivalent to the inequality ${\Lambda \leq 0}$ . Newman then conjectured the complementary bound ${\Lambda \geq 0}$ ; in his words, this conjecture asserted that if the Riemann hypothesis is true, then it is only “barely so”, in that the reality of all the zeroes is destroyed by applying heat flow for even an arbitrarily small amount of time. Over time, a significant amount of evidence was established in favour of this conjecture; most recently, in 2011, Saouter, Gourdon, and Demichel showed that ${\Lambda \geq -1.15 \times 10^{-11}}$ .

In this paper we finish off the proof of Newman’s conjecture, that is we show that ${\Lambda \geq 0}$ . The proof is by contradiction, assuming that ${\Lambda < 0}$ (which among other things, implies the truth of the Riemann hypothesis), and using the properties of backwards heat evolution to reach a contradiction.

Very roughly, the argument proceeds as follows. As observed by Csordas, Smith, and Varga (and also discussed in this previous blog post, the backwards heat evolution of the ${H_t}$ introduces a nice ODE dynamics on the zeroes ${x_j(t)}$ of ${H_t}$ , namely that they solve the ODE

$\displaystyle \frac{d}{dt} x_j(t) = -2 \sum_{j \neq k} \frac{1}{x_k(t) - x_j(t)} \ \ \ \ \ (3)$

for all ${j}$ (one has to interpret the sum in a principal value sense as it is not absolutely convergent, but let us ignore this technicality for the current discussion). Intuitively, this ODE is asserting that the zeroes ${x_j(t)}$ repel each other, somewhat like positively charged particles (but note that the dynamics is first-order, as opposed to the second-order laws of Newtonian mechanics). Formally, a steady state (or equilibrium) of this dynamics is reached when the ${x_k(t)}$ are arranged in an arithmetic progression. (Note for instance that for any positive ${u}$ , the functions ${z \mapsto e^{tu^2} \cos(uz)}$ obey the same backwards heat equation as ${H_t}$ , and their zeroes are on a fixed arithmetic progression ${\{ \frac{2\pi (k+\tfrac{1}{2})}{u}: k \in {\bf Z} \}}$ .) The strategy is to then show that the dynamics from time ${-\Lambda}$ to time ${0}$ creates a convergence to local equilibrium, in which the zeroes ${x_k(t)}$ locally resemble an arithmetic progression at time ${t=0}$ . This will be in contradiction with known results on pair correlation of zeroes (or on related statistics, such as the fluctuations on gaps between zeroes), such as the results of Montgomery (actually for technical reasons it is slightly more convenient for us to use related results of Conrey, Ghosh, Goldston, Gonek, and Heath-Brown). Another way of thinking about this is that even very slight deviations from local equilibrium (such as a small number of gaps that are slightly smaller than the average spacing) will almost immediately lead to zeroes colliding with each other and leaving the real line as one evolves backwards in time (i.e., under the forward heat flow). This is a refinement of the strategy used in previous lower bounds on ${\Lambda}$ , in which “Lehmer pairs” (pairs of zeroes of the zeta function that were unusually close to each other) were used to limit the extent to which the evolution continued backwards in time while keeping all zeroes real.

How does one obtain this convergence to local equilibrium? We proceed by broad analogy with the “local relaxation flow” method of Erdos, Schlein, and Yau in random matrix theory, in which one combines some initial control on zeroes (which, in the case of the Erdos-Schlein-Yau method, is referred to with terms such as “local semicircular law”) with convexity properties of a relevant Hamiltonian that can be used to force the zeroes towards equilibrium.

We first discuss the initial control on zeroes. For ${H_0}$ , we have the classical Riemann-von Mangoldt formula, which asserts that the number of zeroes in the interval ${[0,T]}$ is ${\frac{T}{4\pi} \log \frac{T}{4\pi} - \frac{T}{4\pi} + O(\log T)}$ as ${T \rightarrow \infty}$ . (We have a factor of ${4\pi}$ here instead of the more familiar ${2\pi}$ due to the way ${H_0}$ is normalised.) This implies for instance that for a fixed ${\alpha}$ , the number of zeroes in the interval ${[T, T+\alpha]}$ is ${\frac{\alpha}{4\pi} \log T + O(\log T)}$ . Actually, because we get to assume the Riemann hypothesis, we can sharpen this to ${\frac{\alpha}{4\pi} \log T + o(\log T)}$ , a result of Littlewood (see this previous blog post for a proof). Ideally, we would like to obtain similar control for the other ${H_t}$ , ${\Lambda \leq t < 0}$ , as well. Unfortunately we were only able to obtain the weaker claims that the number of zeroes of ${H_t}$ in ${[0,T]}$ is ${\frac{T}{4\pi} \log \frac{T}{4\pi} - \frac{T}{4\pi} + O(\log^2 T)}$ , and that the number of zeroes in ${[T, T+\alpha \log T]}$ is ${\frac{\alpha}{4 \pi} \log^2 T + o(\log^2 T)}$ , that is to say we only get good control on the distribution of zeroes at scales ${\gg \log T}$ rather than at scales ${\gg 1}$ . Ultimately this is because we were only able to get control (and in particular, lower bounds) on ${|H_t(x-iy)|}$ with high precision when ${y \gg \log x}$ (whereas ${|H_0(x-iy)|}$ has good estimates as soon as ${y}$ is larger than (say) ${2}$ ). This control is obtained by the expressing ${H_t(x-iy)}$ in terms of some contour integrals and using the method of steepest descent (actually it is slightly simpler to rely instead on the Stirling approximation for the Gamma function, which can be proven in turn by steepest descent methods). Fortunately, it turns out that this weaker control is still (barely) enough for the rest of our argument to go through.

Once one has the initial control on zeroes, we now need to force convergence to local equilibrium by exploiting convexity of a Hamiltonian. Here, the relevant Hamiltonian is

$\displaystyle H(t) := \sum_{j,k: j \neq k} \log \frac{1}{|x_j(t) - x_k(t)|},$

ignoring for now the rather important technical issue that this sum is not actually absolutely convergent. (Because of this, we will need to truncate and renormalise the Hamiltonian in a number of ways which we will not detail here.) The ODE (3) is formally the gradient flow for this Hamiltonian. Furthermore, this Hamiltonian is a convex function of the ${x_j}$ (because ${t \mapsto \log \frac{1}{t}}$ is a convex function on ${(0,+\infty)}$ ). We therefore expect the Hamiltonian to be a decreasing function of time, and that the derivative should be an increasing function of time. As time passes, the derivative of the Hamiltonian would then be expected to converge to zero, which should imply convergence to local equilibrium.

Formally, the derivative of the above Hamiltonian is

$\displaystyle \partial_t H(t) = -4 E(t), \ \ \ \ \ (4)$

where ${E(t)}$ is the “energy”

$\displaystyle E(t) := \sum_{j,k: j \neq k} \frac{1}{|x_j(t) - x_k(t)|^2}.$

Again, there is the important technical issue that this quantity is infinite; but it turns out that if we renormalise the Hamiltonian appropriately, then the energy will also become suitably renormalised, and in particular will vanish when the ${x_j}$ are arranged in an arithmetic progression, and be positive otherwise. One can also formally calculate the derivative of ${E(t)}$ to be a somewhat complicated but manifestly non-negative quantity (a sum of squares); see this previous blog post for analogous computations in the case of heat flow on polynomials. After flowing from time ${\Lambda}$ to time ${0}$ , and using some crude initial bounds on ${H(t)}$ and ${E(t)}$ in this region (coming from the Riemann-von Mangoldt type formulae mentioned above and some further manipulations), we can eventually show that the (renormalisation of the) energy ${E(0)}$ at time zero is small, which forces the ${x_j}$ to locally resemble an arithmetic progression, which gives the required convergence to local equilibrium.

There are a number of technicalities involved in making the above sketch of argument rigorous (for instance, justifying interchanges of derivatives and infinite sums turns out to be a little bit delicate). I will highlight here one particular technical point. One of the ways in which we make expressions such as the energy ${E(t)}$ finite is to truncate the indices ${j,k}$ to an interval ${I}$ to create a truncated energy ${E_I(t)}$ . In typical situations, we would then expect ${E_I(t)}$ to be decreasing, which will greatly help in bounding ${E_I(0)}$ (in particular it would allow one to control ${E_I(0)}$ by time-averaged quantities such as ${\int_{\Lambda/2}^0 E_I(t)\ dt}$ , which can in turn be controlled using variants of (4)). However, there are boundary effects at both ends of ${I}$ that could in principle add a large amount of energy into ${E_I}$ , which is bad news as it could conceivably make ${E_I(0)}$ undesirably large even if integrated energies such as ${\int_{\Lambda/2}^0 E_I(t)\ dt}$ remain adequately controlled. As it turns out, such boundary effects are negligible as long as there is a large gap between adjacent zeroes at boundary of ${I}$ – it is only narrow gaps that can rapidly transmit energy across the boundary of ${I}$ . Now, narrow gaps can certainly exist (indeed, the GUE hypothesis predicts these happen a positive fraction of the time); but the pigeonhole principle (together with the Riemann-von Mangoldt formula) can allow us to pick the endpoints of the interval ${I}$ so that no narrow gaps appear at the boundary of ${I}$ for any given time ${t}$ . However, there was a technical problem: this argument did not allow one to find a single interval ${I}$ that avoided gaps for all times ${\Lambda/2 \leq t \leq 0}$ simultaneously – the pigeonhole principle could produce a different interval ${I}$ for each time ${t}$ ! Since the number of times was uncountable, this was a serious issue. (In physical terms, the problem was that there might be very fast “longitudinal waves” in the dynamics that, at each time, cause some gaps between zeroes to be highly compressed, but the specific gap that was narrow changed very rapidly with time. Such waves could, in principle, import a huge amount of energy into ${E_I}$ by time ${0}$ .) To resolve this, we borrowed a PDE trick of Bourgain’s, in which the pigeonhole principle was coupled with local conservation laws. More specifically, we use the phenomenon that very narrow gaps ${g_i = x_{i+1}-x_i}$ take a nontrivial amount of time to expand back to a reasonable size (this can be seen by comparing the evolution of this gap with solutions of the scalar ODE ${\partial_t g = \frac{4}{g^2}}$ , which represents the fastest at which a gap such as ${g_i}$ can expand). Thus, if a gap ${g_i}$ is reasonably large at some time ${t_0}$ , it will also stay reasonably large at slightly earlier times ${t \in [t_0-\delta, t_0]}$ for some moderately small ${\delta>0}$ . This lets one locate an interval ${I}$ that has manageable boundary effects during the times in ${[t_0-\delta, t_0]}$ , so in particular ${E_I}$ is basically non-increasing in this time interval. Unfortunately, this interval is a little bit too short to cover all of ${[\Lambda/2,0]}$ ; however it turns out that one can iterate the above construction and find a nested sequence of intervals ${I_k}$ , with each ${E_{I_k}}$ non-increasing in a different time interval ${[t_k - \delta, t_k]}$ , and with all of the time intervals covering ${[\Lambda/2,0]}$ . This turns out to be enough (together with the obvious fact that ${E_I}$ is monotone in ${I}$ ) to still control ${E_I(0)}$ for some reasonably sized interval ${I}$ , as required for the rest of the arguments.

ADDED LATER: the following analogy (involving functions with just two zeroes, rather than an infinite number of zeroes) may help clarify the relation between this result and the Riemann hypothesis (and in particular why this result does not make the Riemann hypothesis any easier to prove, in fact it confirms the delicate nature of that hypothesis). Suppose one had a quadratic polynomial ${P}$ of the form ${P(z) = z^2 + \Lambda}$ , where ${\Lambda}$ was an unknown real constant. Suppose that one was for some reason interested in the analogue of the “Riemann hypothesis” for ${P}$ , namely that all the zeroes of ${P}$ are real. A priori, there are three scenarios:

(Riemann hypothesis false) ${\Lambda > 0}$ , and ${P}$ has zeroes ${\pm i |\Lambda|^{1/2}}$ off the real axis.
(Riemann hypothesis true, but barely so) ${\Lambda = 0}$ , and both zeroes of ${P}$ are on the real axis; however, any slight perturbation of ${\Lambda}$ in the positive direction would move zeroes off the real axis.
(Riemann hypothesis true, with room to spare) ${\Lambda < 0}$ , and both zeroes of ${P}$ are on the real axis. Furthermore, any slight perturbation of ${P}$ will also have both zeroes on the real axis.

The analogue of our result in this case is that ${\Lambda \geq 0}$ , thus ruling out the third of the three scenarios here. In this simple example in which only two zeroes are involved, one can think of the inequality ${\Lambda \geq 0}$ as asserting that if the zeroes of ${P}$ are real, then they must be repeated. In our result (in which there are an infinity of zeroes, that become increasingly dense near infinity), and in view of the convergence to local equilibrium properties of (3), the analogous assertion is that if the zeroes of ${H_0}$ are real, then they do not behave locally as if they were in arithmetic progression.