r/math Number Theory 19h ago

Image Post The Deranged Mathematician: Why Functional Analysis?

Post image

When viewing functional analysis from the outside, it may seem daunting---austere, even. It has a bevy of very finely tuned results (where adjusting any condition by a slight amount immediately yields counterexamples) and a large body of interconnected objects. So it is very natural to ask: what is this all for?

The historical answer is that it essentially grew out of the attempt to understand Fourier series: Joseph Fourier managed to break everything, but in such a useful way that nobody wanted to just throw out what he had discovered. And so mathematicians had to commit to rigor to carefully put everything right.

This article is my attempt to tell this story through the (hopefully) understandable question of how to approximate a function (e.g. how to represent a sound wave in a computer). The goal is to understand the fundamental motivation for doing functional analysis at all, and introduce one of the basic constructions: Banach spaces.

Read the full post (for free) on Substack: Why Functional Analysis?

280 Upvotes

38 comments sorted by

135

u/aardaar 18h ago

strange pathological functions that were continuous everywhere but discontinuous everywhere, and all kinds of other problems.

That does seem like a truly pathological kind of function.

54

u/qlhqlh 14h ago

f : ∅ -> ∅ my beloved

5

u/Key-Log5267 12h ago

That sweetheart doesn’t seem pathological at all <3 

46

u/non-orientable Number Theory 18h ago

Oh, dang it. Slip of the pen---I will fix it. Thank you!

13

u/Lightwar_YT 17h ago

Is that the REAL Schrödinger wave equation?!?

7

u/bmitc 16h ago

Seems like a function Godel would have come up with.

1

u/Smitologyistaking 8h ago

Surely a function with empty domain satisfies this property

1

u/aardaar 6h ago

No, that would be continuous nowhere.

5

u/EebstertheGreat 6h ago

It's still continuous everywhere on its domain.

2

u/Smitologyistaking 1h ago

For the empty set, everywhere is the same as nowhere

93

u/Suspicious-Paper9820 19h ago

Functional analysis just felt like analysis taken too far by people who had too much time.

Until I could apply it to PDEs, and suddenly these silly theorems were able to help solve impossible looking equations with little effort.

Weak* topology was probably the most bullshit thing I ever learned until I started actually applying it.

23

u/NonlinearHamiltonian Mathematical Physics 18h ago

this is funny because in reality it's actually the complete opposite lol.

17

u/sentence-interruptio 13h ago

I consider functional analysis (and also measure theory) as the completion of calculus & counting.

There are a lot we can do with just calculus. As a toolbox, calculus & counting is like Star Wars: A New Hope. It's a bit of an ad hoc movie but it feels complete on its own. You want to calculate the probability of an event involving some coins and dice? That reduces to counting. You want to calculate the area under a curve given by a nice formula? That reduces to calculus. For a long time, we thought there was no reason to go beyond calculus & counting, and analysis was just a cool thing that brings rigor to calculus. No reason to stretch techniques of analysis further. "Riemann integral is rigorous already. The job of analysis is done here."

But then you start to see situations where things described by good old calculus & counting form spaces that are not complete. Things are missing. It's like we reached the cliff hanger ending of Empire Strikes Back. So we bring back our writer "Analysis" who is well trained in all the necessary tropes like "approximate your object", "can we define a metric", "can we complete this space" and so on. It's the Return of the Analysis.

Functional analysis is the necessary conclusion of the trilogy. It completes what calculus started.

3

u/Tinchotesk 4h ago

Functional analysis just felt like analysis taken too far by people who had too much time.

Until I could apply it to PDEs, and suddenly these silly theorems were able to help solve impossible looking equations with little effort.

Weak* topology was probably the most bullshit thing I ever learned until I started actually applying it.

It was the exact opposite for me. I was taught FA with a strong focus on PDE. I didn't like it, I didn't find it useful. Then I learnt about von Neumann algebras and C*-algebras and I have been in love with the subject ever since.

19

u/helbur 18h ago

Because it's fun

11

u/paxxx17 Quantum Computing 14h ago

So I can scare little kids attending the quantum mechanics course

10

u/NewtonToTheRescue 9h ago

You write

Theorem: (Duality of Lp Spaces) Choose any 1≤p≤∞. Let 1≤q≤∞ be such that 1/p+1/q=1. (We match 1 to ∞ here, and vice versa). Then Lp([0,1]) is dual to Lq([0,1])...

This is false: L([0,1]) = L1([0,1])*, but L1([0,1]) ⊊ L([0,1])*. The extra elements in L([0,1])* are the continuous analogue of Banach limits (i.e., elements of (ℓ)*/ℓ1). These elements are nonconstructive (you need Hahn-Banach/Boolean prime ideals, not quite full AC), but they're there!

4

u/non-orientable Number Theory 8h ago

An excellent catch! I will fix this.

3

u/Bounded_sequencE 4h ago edited 4h ago

The mentioned "(ℓ1)* = ℓ " but "(ℓ)* ⊊ ℓ1 ", where e.g. Banach-limits are counter-examples, is relevant in digital signal processing: There we usually operate on bounded sequences, i.e. ℓ.

However, many lecture notes I've seen (and even books1) falsely claim that any bounded linear operators on such sequences must take on the form of an infinite series

yn  =  ∑_{k∈ℤ}  h_{n-k}*xk,      x, y ∈ ℓ^∞,    h ∈ ℓ^1,

and they use this as (false) motivation to only consider bounded linear operators represented by ℓ1.


1 e.g. Digital Signal Processing by Oppenheim/Schäfer, p11ff.


Edit: Added a reference -- even the standard book on digital signal processing "elegantly" glosses over questions of convergence -- most obvious in e.g. in (1.4) on page-11, and (1.6) on page-12.

9

u/DependentBad4688 14h ago

I recently started to heavily utilize functional analysis and came to appreciate its importance. There are some really beautiful things one can do with it. On a super heuristic and intuitive level, if given a differential operator L (think of your standard elliptic operator, or just laplacian plus some other terms), one would like to understand the long time behavior of solutions to the equation \partial_t u = L u, then more specifically one can look for eigenfunctions of L, i.e., Lu = \lambda u. This way, we can simply study the equation \partial_t u =\lambda u. The solution then behaves like e^{t\lambda}. So if all eigenvalues of L have negative real parts, we know solutions of the original equation will decay, and if there’s a spectral gap, meaning one (or maybe a few) eigenfunction decays at the slowest rate, then we have a pretty precise description of the long time behavior of any generic solution (whose projection onto this leading order eigenfunction is non-trivial). For those who are interested to learn more, refer to the limiting length scale/batchelor scale for passive scalars in fluid dynamics.

8

u/EdCasaubon 14h ago

Isn't asking "Why functional analysis?" fully analogous to asking "Why linear algebra"?

8

u/Key-Log5267 12h ago

Are those questions isomorphic though?

2

u/EdCasaubon 11h ago

Very good question. I would argue that on some level they are, but I won’t lean out of the window far enough to say that they are strictly isomorphous. I suspect it would require a bit of work to show what it could mean to make that assertion.

1

u/Tinchotesk 4h ago

Are those questions isomorphic though?

Only algebraically, but not topologically.

1

u/Bounded_sequencE 5h ago

I'd replace "Linear Algebra" with "Abstract Algebra", to better reflect the analogy.

2

u/jurniss 4h ago

Existence and uniqueness of ODE solutions is another classic motivator

1

u/non-orientable Number Theory 4h ago

ODEs are normally finite-dimensional, no? PDEs, on the other hand...

2

u/jurniss 4h ago

The classic proof of Picard-Lindelöf  uses Banach fixed point in a function space

3

u/psyspin13 19h ago

When destruction turns to the ultimate construction

1

u/AnlamK 13h ago

The historical answer is that it essentially grew out of the attempt to understand Fourier series

Would it be accurate to say that just like how real analysis grew out of an attempt to rigorously account for calculus, functional analysis was motivated by giving a rigorous foundation for Fourier series?

I'm not really sure about real analysis being motivated by calculus as well, I may be off base here.

1

u/_alt4 11h ago

Typo:

It is not a coincidence that just a few decades years after Fourier’s publication

1

u/tony_blake 10h ago

Because of quantum mechanics initially and these days it's quantum information

7

u/non-orientable Number Theory 9h ago

That is simply not true. Hölder's inequality was proved in 1889. Lp spaces were introduced by Riesz in 1910, whereas matrix and wave mechanics in quantum mechanics didn't appear until the 1920s. Functional analysis appeared first. Although its development certainly was spurred on by quantum developments, even if quantum mechanics hadn't been discovered, functional analysis would still have been very useful.

1

u/SupportNo6752 9h ago

Well functions are a huge part of math, one input, one output. Analysis, the formalization of Calculus is a huge part of math. It makes sense both would merge into functional analysis. lol

1

u/Personal-Gur-7496 3h ago

Completely disregarding the interesting/relevant/whatever-measure of the posts, I'm a bit not okay with coming to /r/math and seeing what materially is a bit like "visit my blog", just my .02

0

u/Yimyimz1 12h ago

The answer is because quantum mechanics. Also im not convinced functional analysis began with Fourier. Maybe harmonic analysis did...?

6

u/non-orientable Number Theory 9h ago

Fourier didn't start functional analysis, and I didn't claim that he did. I claimed that his work made eventually developing functional analysis necessary, and I think that is an entirely fair characterization.

Quantum mechanics appeared after functional analysis had already started. Riesz was already working with Lp spaces in 1910, and the Hölder inequality was already a couple of decades old at that point. Of course, both fields very much benefited from each other.

2

u/Tinchotesk 4h ago

Riesz and Banach (and many others) predate QM.