10
$\begingroup$

How can we break down the complexity of eigenvalues/vectors to something that is more intuitive for students. I feel like the proofy way isn't a good intuitive representation of the mechanism that eigenvalues/vectors represent. What are the best reasons as to why a student might need to understand eigenvalues, and the tangible real world applications for eigenvalues, and eigenvectors?

Teaching this to all ages, high school, through college.

Can assume students have a foundation in calculus (differentiation ~ multivariable)

Improve this question
$\endgroup$
  • 3
    $\begingroup$ might look at matheducators.stackexchange.com/q/520/128 $\endgroup$ – James S. Cook Jul 14 '14 at 0:37
  • $\begingroup$ @JamesS.Cook I looked and the intuition, at least for me, was lacking. I understand eigenvecs/values, but getting to this point was a nightmare. And the applications in the post you mentioned weren't as connected to real world problems as I'd like. But thank you! $\endgroup$ – David BasedMathematician Coven Jul 14 '14 at 0:40
  • $\begingroup$ Perhaps you should elaborate on what you mean by "real world problems". The thread I linked includes answers using Markov chains and physics. Those are pretty real-world in my book. $\endgroup$ – James S. Cook Jul 14 '14 at 18:04
  • $\begingroup$ @JamesS.Cook Good point. Lol. Those are very real world, I'll edit in a little to specify more direct applicability for the average young adult. $\endgroup$ – David BasedMathematician Coven Jul 14 '14 at 20:02
  • $\begingroup$ I think the Markov chain is a good approach. You can talk about a town with sick and healthy people... the eigenvector is the steady state solution. It has to be explained so it's not optimal for the attention span of the typical highschooler, but it's pretty basic to follow. $\endgroup$ – James S. Cook Jul 15 '14 at 4:46

11 Answers 11

Active Oldest Votes
6
$\begingroup$

Here's an example I use for myself. I don't teach this topic in regular class but I have used this example in private conversations with advanced students.

Think of an object (perhaps a globe) that is stretched on one or more directions then rotated in various ways and perhaps reflected. We can show that at least one line through the object is either still pointing the same direction or pointing the opposite direction. The vector for this direction is an eigenvector. The amount of stretching in that direction is the eigenvalue for that eigenvector. If the direction is opposite the original direction, the Eigenvalue is negative.

This works since one-directional stretching, rotating, and reflecting are linear functions, and 3-dimensional space requires at least one real eigenvalue.

Improve this answer
$\endgroup$
  • $\begingroup$ This is a very nice explanation of what eigenvectors / eigenvalues are (which was the question title), but the body of the question asked something slightly different, namely, which was: Why are they important? $\endgroup$ – mweiss Jul 15 '14 at 2:48
5
$\begingroup$

Although the following quantum-ish-physics-y "explanation" begs-the-question in several ways, it is genuine, and may convey something to students: given a linear operator (a.k.a. "matrix"), an eigenvector is "a pure state" (of what, we don't quite ask), meaning that the operator acts on it in an especially simple fashion. In good situations, a general "state" is a "superposition" (a.k.a. "linear combination") of pure states.

Although one might dismiss such half-explanations as too vague, the "hook" of "quantum ..." can instill belief that the thing is serious and "big-time".

Improve this answer
$\endgroup$
  • $\begingroup$ I like this. While I would like more detail as to the intuition behind how you would introduce eigenvalues, I can definitely find plenty to introduce the idea of super position as a linear combination, and this eigenvectors. How might this play a role in quantum physics? I know about superpositon, when talking about vector addition in engineering practices. But not quantum. I like the quantum hook! $\endgroup$ – David BasedMathematician Coven Jul 16 '14 at 22:17
  • $\begingroup$ There's a dictionary to translate classical mechanical viewpoints into quantum, and to mathematicize quantum stuff. Whole books... But, for starters, "an observable" is a self-adjoint operator on a Hilbert space... Googling around should find a great variety of similar talk, so you should be able to find something that strikes your fancy. (My own experience is in application to number theory of insights from this and other bits of physics... so I cannot speak competently about the actual physics. It is hilarious to me that a "particle" and "irreducible representation" could be the same...) $\endgroup$ – paul garrett Jul 16 '14 at 22:24
5
$\begingroup$

I think a good motivation is the idea of dynamical systems and stability a la Markov chains. If we have a system which can be modelled by taking a vector of data $v(0)$ and then some matrix $A$ we have $v(t) = Av(t-1)$. Observe that such a system is in some sense stable, and will undergo consistent exponential growth if it is a eigenvector. Even more, one can actually data and see that often the maximal or minimal eigenvalue will dominate. This can be motivated by supply/demand/competition in a marketplace, discrete models of populations with predator prey populations, or many other things.

Improve this answer
$\endgroup$
4
$\begingroup$

To be perfectly honest, the applications of eigenvalues tends to be much more complex than the actual theory of finding eigenvalues itself.

The first time I found a practical application of them was in Differential Equations, particularly solving the problems of

$$y' = Ax$$

whereas $A$ is a constant matrix $y$ is a vector function of $x$ which itself is a vector.

To some high school/very bright middle school students that have seen calculus this may be worth exploring but obviously this example isn't the best application for a wide-spread audience.

Another perhaps more primitive understanding is "eigenvalues" and "eigenvectors" are curious objects that satisfy the equation

$$Ax = \lambda x$$

which in itself is an interesting problem (for reasons mentioned above particularly @Rory Daulton and her stretching/rotating analogy)

And it just so happens these things can also be used to do a hell of a lot more for example factoring matrices, etc...

See here: http://en.wikipedia.org/wiki/Eigendecomposition_of_a_matrix#Practical_implications.5B1.5D

Improve this answer
$\endgroup$
  • $\begingroup$ This doesn't seem very satisfying but it is my gut response to this question. For you are essentially attempting to solve a problem such as explaining "what is the product rule in calculus good for" before your audience has learned calculus. $\endgroup$ – frogeyedpeas Jul 15 '14 at 1:50
  • 1
    $\begingroup$ I see what you mean, however if we can't grasp higher level math through the lens that will motivate our students to learn then surely we will have to hope. I can 100% give examples and an intuition to students about using the product rule giving real world examples, and understanding using their bases of knowledge without them being masters of calculus. Even Einstein said, if we can't explain it simply then we don't know it well enough. I want to break the concepts into understandable and enjoyable pieces. $\endgroup$ – David BasedMathematician Coven Jul 16 '14 at 14:24
1
$\begingroup$

Eigenvectors are vectors that map onto themselves. (Eigen= "oneself" in German.)

To accomplish this, they are defined by vectors of eigenvalues that "solve" the so-called "characteristic equation" (which defines them) for the value zero.

This equation is derived from: $A v = \lambda v$, where A is the "transformation matrix, v is the eigenvector, and $\lambda$ is a vector to be solved for. If you subtract $\lambda v$ from both sides, you get zero on the right hand side.

By factoring out the v, and through matrix operations on the left hand side, you get a polynomial equation that can be solved for $\lambda$.

Improve this answer
$\endgroup$
  • 2
    $\begingroup$ I understand what both eigenvalues and eigenvectors are. My question pertains to non abstract reasons as to why a student might need to understand eigenvalues, and the real world applications for eigenvalues, and eigenvectors. I do not need mathematical formulations. But thank you for an answer. $\endgroup$ – David BasedMathematician Coven Jul 14 '14 at 16:32
1
$\begingroup$

As illustrated by other answers, Markov processes and linear ODE systems are the foremost applications. I like to mess a little with students explaining that the "only" thing that Google machines do all day is compute one large eigenvector over and over agin.

But to get a feeling for why are eigenvectors useful, think simply of base changes: Let's say there is no issue with multiplicity, so our transformation $A:\mathbb{R}^n \longrightarrow \mathbb{R}^n$ has $n$ distinct eigenvectors. Then the basis of eigenvectors is the most natural one since it is invariant (up to scale). How does an object transform under $A$? It stretches by eigenvalue #$1$ in the first direction, by eigenvalue #$2$ in the second direction, and so on. It is the convenience of this description that makes eigenstuff useful...

Improve this answer
$\endgroup$
1
$\begingroup$

Familiar, everyday applications of eigenpairs abound:

for young musicians: the natural frequencies of a musical instrument string are eigenvalues (actually they're the squares, but, for teaching purposes...). The vibration modes are the eigenvectors. The lowest eigenvalue for the string is the fundamental frequency, the higher values are harmonics. When plucked, the string will vibrate at a superposition of the fundamental and several harmonics - if you want the fundamental to be dominant, pluck the string at the mid-point.

for destructive teenagers: the compressive force at which something like a plastic ruler or a thin sword-blade buckles is an eigenvalue, the shape into which it buckles is an eigenvector (usually only the lowest value is seen).

for undergraduate engineers: principal stresses are the eigenvalues of the stress state, principal directions are the eigenvectors.

Improve this answer
$\endgroup$
  • $\begingroup$ Students may wonder about the first example: "What is the matrix or linear operator that these are the eigenvalues and eigenfunctions of?" The Laplace operator on an infinite dimensional function space can be a lot to swallow, and making sense of an eigenbasis is not trivial. The example is good and does actually motivate functional analysis, but it may be too complicated. Not only the eigenthings but also the operator itself should be understandable. $\endgroup$ – Joonas Ilmavirta Aug 28 '15 at 17:02
  • $\begingroup$ @Joonas: the matrix is stiffness/mass. However, I start by modelling the string as a 1-degree-of-freedom mass-spring system (1 eigenpair)then go on to an N-d.o.f model (N eigenpairs). I then point out that the behaviour of a real system can't possibly depend on how we model it and so the only logical conclusion is that the real string has an infinite number of d's.o.f. $\endgroup$ – rdt2 Aug 30 '15 at 12:48
0
$\begingroup$

Say you have 3 cities A, B, C and for each of them you know the percentage of people each year remain in the city or move to one of the two other cities. Given the population distribution at time 0 how will people distribute in the long run?

Say you have 3 car rental X,Y,Z and for each of them you know the percentage of rented car that are returned in the same place or to one of the two others. Given the car distribution at time 0 how will car distribute in the long run?

What if in the first model I add the percentage of dying and newborns? An in the second one I add lost cars and new cars?

These are simple real life examples (where of course the 3 can be easily changed into N) where eiganvalues and eigenvectors come into play into a Markov chain form, as commented before. The question you consider is easily motivated (I'm running the car rental and I want to know if in 2-3 years I will have to pay someone to bring back cars to their original disposition or not) and the answer easily understood.

Improve this answer
$\endgroup$
0
$\begingroup$

See these two posts: eigshow: week 1, eigshow: week 2 written by C. Moler about illustrating eigenvalue in MATLAB software.

Improve this answer
$\endgroup$
  • 1
    $\begingroup$ Can you explain why you think these are the best approach, and elaborate on what type of approach it is? Also: welcome to the site. $\endgroup$ – JPBurke Oct 29 '14 at 8:00
0
$\begingroup$

For students of all ages, I would go the “dynamical system road” with pictures (never tried it though, mostly by lack of opportunity).

Introduce a problem that is in fact a simple recursive vector-valued sequence (such as the evolution of a population with youngsters and olds, in which at each step a given proportion of youngster grows old while the other die, and every old gets a given number of young children and then die), and then show pictures of the possible evolutions given different starting points (you may want to choose another model to allow for negative values).

Typically, if you choose an hyperbolic $2\times 2$ matrix (i.e. two positive eigenvalues, one $<1$ and the other $>1$), you will have interesting pictures. Some very particular trajectories are going to zero or diverge linearly, with most trajectories starting close to the first type then close to the second type.

After showing pictures for different starting values, and then for different systems, you can easily introduce eigenvectors at the observed special directions, eigenvalues as rate of dilation/contraction, etc. It also gives a nice illustration of why decomposing a vector on a non-canonical basis is meaningful. Student will have a mental picture, which they usually lack even after many years of mathematical studies.

Improve this answer
$\endgroup$
0
$\begingroup$

Many other answers mentioned ODE, but the discrete version seems simpler to introduce at an early stage. One could use system of sequences to show a magic trick and then explain it with eigenvectors, it might give both intuition and motivation. Let me be more specific.

Example problem

Suppose we have two sequences $(u_n)$ and $(v_n)$ such that for all $n\ge0$: $$\begin{cases} u_{n+1}=3 u_n+v_n \\ v_{n+1} = 2u_n+2 v_n\end{cases}$$ ( if needed insert any modelling motivation, such as evolution of a population of insects with young ones and adults, and adjust the parameters to make it somewhat realistic.)

How does the sequences $(u_n)$ and $(v_n)$ evolve? Can we give exact expressions for them?

Side note: before going on, at this point I would discuss what can easily be said without computing anything: if $u_0$ and $v_0$ are positive then the sequences are increasing and tend to $\infty$ for example.

Magic trick

Let us define for all $n\in\mathbb{N}$: $a_n=2 u_n+v_n$ and $b_n=u_n-v_n$. Then observe that $$a_{n+1} = 2 u_{n+1} + v_{n+1} = 8 u_n+4 v_n = 4 a_n$$ and similarly $b_{n+1}=b_n$. So, $a_n=4^n (2u_0+v_0)$ and $b_n=u_0-v_0$. The two recursions have been decoupled! Then by solving a system we get $$\begin{cases} u_n = 4^n(\frac23 u_0+\frac13 v_0) + \frac13(u_0-v_0)\\ v_n = 4^n(\frac23 u_0+\frac13 v_0) -\frac23(u_0-v_0) \end{cases}$$

We can now answer far more questions on the system easily (for which values of $u_0,v_0$ does $u_n$ go to infinity? Does $u_n$ grow much faster than $v_n$? etc. - one can ask this questions beforehand for more impact) But to students it should look like a magic trick: how could one think of introducing precisely $(a_n)$ and $(b_n)$ as above?

To the matter

Then one should be in a good shape to explain eigenvectors and eigenvalues, by rewriting the system as a vectorial sequence with a recursive property of the form $U_{n+1} = A U_n$ where $A$ is a matrix. The case of diagonal matrices is easy, the whole point of eigenvector being (at this point) to diagonalize a matrix. Alternatively, one can dissect the trick, and look at how one should choose the coefficients in $(a_n)$ and $(b_n)$ to make it work. Then eigenvectors and eigenvalues show up (but one has to introduce things in matrix form at some point, of course).

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.