Here are some clever figures explaining PCA from the paper "The Tasseled Cap De-Mystified" by E. P. Crist and R. J. Kauth. The titular "tasseled cap" refers to the time trace of a wheat field in reflectance space.

Graphical explanation of PCA/diagonalization