Functional Analysis – Introduction. Part II
by Orr Shalit
In a previous post we discussed some of the history of functional analysis and we also said some vague things about its role in mathematics. In this second part of the introduction we will see an example of the spirit of functional analysis in action, by taking a close look at the Stone-Weierstrass approximation theorem.
1. The Weierstrass approximation theorem
In 1885 Karl Weierstrass proved the following theorem:
Weierstrass Theorem: Let be a continuous function. Then for every there exists a polynomial (with real coefficients) such that for all ,
The theorem can be phrased differently, by saying that the polynomials are dense in the space of continuous functions with respect to the topology of uniform convergence. I think that this is a remarkable theorem. You see, only thirteen years before Weierstrass proved this theorem he broke the news that continuous functions can be much crazier then anyone ever thought, by constructing his famous Weierstrass function – a continuous function that is nowhere differentiable. But now, in 1885, Weierstrass actually showed that for many purposes, in practice (well, at least theoretically), continuous functions could be taken to be polynomials. We will see the usefulness of this theorem, directly and indirectly, at least at two points in the lectures.
2. The Stone-Weierstrass theorem – real version
Given a topological space , the question whether or not a family of functions can approximate uniformly to any given precision any continuous function on is interesting and important. In a few lectures, when we will study Fourier series, we will need to use the following theorem:
Theorem (trigonometric approximation theorem): Let be a continuous, –periodic function. Then for every there exists a trigonometric polynomial such that for all ,
Two explanations are in order. A –periodic function is a function such that for all and . A trigonometric polynomial is a function of the form
(a finite sum). As it happens many times in mathematics, it turns out that the nicest way to obtain this theorem is to a consider a vastly more general problem. The solution of this more general problem is the Stone-Weierstrass Theorem, which we shall presently state and prove. Before doing so let us describe the setting for this theorem.
Let be a compact Hausdorff space. We will denote by the space of continuous, real-valued functions on , and by the space of continuous, complex-valued functions on . On both of these space we define the sup-norm of a function to be
The quantity is considered to be distance between the two functions and . This distance makes both and into complete metric spaces. Both these spaces are vector spaces over the appropriate field, in fact they are algebras, with the usual operations of pointwise addition and multiplication. If is a subspace of or of then it is said to be a subalgebra if for all , is also in . A subalgebra is said to separate points if for all there exists some such that . A subalgebra is said to be closed if it is a closed subset with respect to the metric.
Stone-Weierstrass Theorem (real version): Let be a closed subalgebra of which contains the constant functions and separates points. Then .
To obtain the theorem above regarding approximation using trigonometric polynomials, you first note that, due to standard trigonometric identities, the trigonometric polynmials form an algebra. Next, you think about and realize that the -periodic functions on can be identified with the continuous functions on the -torus . You then put , and take to be the norm closure of the trigonometric polynomials in , noting that the norm closure of an algebra is an algebra. To apply the Stone-Weierstrass theorem it suffices now to show that the trigonometric polynomials separate points, and this is elementary. That concludes the proof of the theorem on approximation by trigonometric polynomials.
3. Proof of the Stone-Weierstrass Theorem
Let us isolate three lemmas before we reach the main argument of the proof.
Lemma 1: For every pair of distinct points , and every , there exists a function such that and .
Lemma 2: If then the function is also in .
Here denotes the function that sends every to .
Proof: Let be given. We will find a function such that . Since is closed and since is arbitrary, this will show that .
Let . By the Weierstrass Theorem there exists a polynomials such that . Put . Since is an algebra and is a polynomial, . Thus
Lemma 3: If , then the functions and are also in .
Here denotes the function that sends every to , and denotes the function that sends every to .
Proof: This follows immediately from Lemma 2 together with the formulas and , which hold true for all real and .
Completion of the proof of the Stone-Weierstrass Theorem. Let . We must show that . It suffices, for every , to find such that .
We start by constructing, for every , a function such that and . This is possible thanks to Lemma 1.
Next we produce, for every , a function such that and for all . This is done as follows. For every , let be a neighborhood of in which . The compactness of ensures that there are finitely many of these neighborhoods, say , that cover . Then (which is in , thanks to Lemma 3) does the job.
Finally, we find such that for all . For every let be a neighborhood of where . Again we find a finite cover and then define . This function lies between and , so it satisfies for all , and the proof is complete.
Remark: In the proof, we never used the assumption that is Hausdorff. But from the way the theorem is stated it seems like it only expects to be invoked in the compact Hausdorff case. Can you figure out why the theorem is stated with this assumption?
4. The Stone-Weierstrass theorem – complex version
Often, one finds it more convenient to study or to use the algebra of complex valued functions. It turns out that it is much harder for a sub-algebra of functions to be dense in . Consider for example which is defined to be the closure of polynomials in (here denotes the open unit disc in , and denotes its closure). Certainly, is a complex algebra which contains the constants and separates points. However, every element of is holomorphic in , so this algebra is quite far from being the entire algebra . To make the Stone-Weierstrass Theorem work in the complex valued case one needs to add another assumption, which is very simple, but turns out to be deeper than it seems at first.
Definition: A subspace is said to be self-adjoint if for every , the complex conjugate is also in .
Stone-Weierstrass Theorem (complex version): Let be a closed and self-adjoint subalgebra of which contains the constant functions and separates points. Then .
Proof: From the assumptions that is a subspace that separates points it follows that , the space of all functions of the form , , is a real subspace that separates points. From the self-adjointness assumption it follows that , and from closedness of is follows now that is closed. Thus is a closed real algebra that contains the constants and separates points. By the (real) Stone-Weierstrass Theorem, . It follows that every real valued continuous function on is in . Symmetrically, every imaginary valued continuous function on is in , so .
5. Concluding remarks
The Stone-Weierstrass Theorem and the way that we have applied it up serve as a baby example of functional analysis at work. We had a concrete approximation problem, which was solved, as it happens often in mathematics, by considering a vastly more general approximation problem. Considering a more general problem serves two purposes. First, after we have proved the result we have a ready-to-use tool that will be applicable in many situations. Second, by generalizing the problem we strip it away of the irrelevant details (for examples the particular nature of the functions we are trying to approximate with or the particular nature of the space on which they live) and we are left with the essence of the problem. Sometimes this leads to a very elegant proof (like above), and sometimes not.
To prove the theorem it was convenient to employ the language of functional analysis, namely, to introduce a norm and to consider the problem inside an algebra which is also a metric space. It was convenient to consider a closed algebra , even though there was no closed algebra in the original problem (the trigonometric approximation theorem), and even though this closed algebra turned out to be the entire space of continuous functions. The student might wish to review the proof to see how this streamlined the argument.
Note that we did not obtain a new and “abstract” proof of the Weierstrass Theorem – in fact, the Weierstrass Theorem was used in the proof of the Stone-Weierstrass Theorem. This is not at all surprising, as it is an instance of the following guiding principle that I have come to believe in (please take this with a grain of salt):
There is no analysis without hard analysis.
What I mean by this is that you will never get an interesting theorem of substance, which applies to concrete cases in analysis, that does not involve some kind of hard analysis, some epsilonaustics, some sweat. In our example, the hard analysis comes in the proof of the Weierstrass Theorem. The Stone-Weierstrass Theorem, which has a very soft proof, then spares us the use of hard techniques when it gives us the trigonometric approximation theorem for free. But the hard analysis cannot be eliminated entirely.
I know of a different proof of the Stone-Weierstrass Theorem that does not use the Weierstrass Theorem, which relies on the Hahn-Banach and Krein-Milman theorems, but that proof uses the structure of the dual of , and that I consider another bit of hard analysis.
When we moved from the setting of the trigonometric approximation theorem to the setting of the Stone-Weierstrass Theorem we abstracted away the topological space on which the functions live, and we only cared that we have continuous functions on some compact space. In the next lecture, and in most of the rest of the course, we will abstract away everything, and we will consider abstract spaces satisfying certain axioms, and we will not care usually what the points of these spaces are.
We will begin with Hilbert spaces.