PCA tries to preserve linear structure, MDS tries to preserve global geometry, and t-SNE tries to preserve topology (neighborhood structure) https://colah.github.io/posts/2014-10-Visualizing-MNIST/