Fourier's method of analyzing differential equations has inspired so many ideas in other areas of mathematics that the name has become seemingly ubiquitous — in harmonic analysis, representation theory, number theory, and so on. In this talk I'll motivate one perspective on Fourier series through basic linear algebra. From only the most minimal theory (e.g., basic calculus), I'll explain a couple things that Fourier series reveal.