Keywords: Hilbert basis · Fourier series · Parseval's identity · Bessel's inequality · best approximation · infinite dimension
Exercise 1 : Fourier basis and Parseval's identity
Consider the Hilbert space L2(−π,π) of square-integrable functions on [−π,π], equipped with the inner product ⟨f,g⟩=∫−ππf(x)∗g(x)dx, and the family of functions
en(x)=2π1einx,n∈Z.
Assume that this family is total, that is, its finite linear combinations are dense in L2(−π,π).
Question 1
Show that the family (en)n∈Z is orthonormal. Deduce that it is a Hilbert basis of L2(−π,π).
Solution
We calculate
⟨em,en⟩=2π1∫−ππe−imxeinxdx=2π1∫−ππei(n−m)xdx.
If n=m, the integrand is 1 and the result is 1. If n=m, an antiderivative of ei(n−m)x is i(n−m)ei(n−m)x, which takes the same value at ±π because ei(n−m)π=e−i(n−m)π=(−1)n−m; the integral vanishes. The family is therefore orthonormal, and since it is total, it is a Hilbert basis: every f∈L2(−π,π) can be written f=∑n∈Zcnen, with cn=⟨en,f⟩, where the series converges in the L2 norm.
Question 2
Calculate the coefficients cn=⟨en,f⟩ of the function f(x)=x.
Solution
We have cn=2π1∫−ππxe−inxdx. For n=0, the integrand is odd and c0=0. For n=0, integrate by parts, differentiating x and integrating e−inx:∫−ππxe−inxdx=[−inxe−inx]−ππ+in1∫−ππe−inxdx=−inπ(−1)n+π(−1)n+0=n2πi(−1)n,
where we used e∓inπ=(−1)n and −i1=i. Thus
cn=2πni(−1)n,∣cn∣2=n22π(n=0).
Question 3
Write Parseval's identity for this function. Deduce the value of ∑n≥1n21.
Solution
Parseval's identity states that ∥f∥2=∑n∈Z∣cn∣2. On the one hand, ∥f∥2=∫−ππx2dx=32π3. On the other hand, each integer n≥1 appears twice, for n and −n, and
n∈Z∑∣cn∣2=2n≥1∑n22π=4πn≥1∑n21.
Equating the two expressions gives
n≥1∑n21=32π3⋅4π1=6π2.
This is the celebrated Basel problem, solved by Euler in 1735, obtained here as a consequence of the Pythagorean theorem in infinite dimensions.
Question 4
Let fN=∑∣n∣≤Ncnen be the partial sum of order N. Show that fN is the best approximation to f by a linear combination of e−N,...,eN, and calculate the error ∥f−fN∥2. How does it behave for large N?
Solution
The function fN is the orthogonal projection of f onto the finite-dimensional subspace FN spanned by e−N,...,eN, since the projector onto this subspace is ∑∣n∣≤N∣en⟩⟨en∣. By the best-approximation result established by the Pythagorean theorem, fN is the element of FN closest to f. The error is the norm of the orthogonal component, which is again calculated from the remaining coefficients using Parseval's identity:
∥f−fN∥2=∣n∣>N∑∣cn∣2=4πn>N∑n21.
Comparison with the integral ∫N∞x2dx=N1 gives ∥f−fN∥2≃N4π for large N: the error tends to zero, but slowly. The slow 1/n decay of the coefficients arises because the periodic extension of the function f(x)=x is discontinuous at ±π. As with the Fourier transform on the real line, the smoother a function is, the faster its Fourier coefficients decay.