It's worth pointing out that the same consideration of distance that data must move applies to cross-node interconnects as well, within a single HPC system. The effects this can have are pretty wide-ranging, and sometimes quite substantial. For instance, here's a pile of recent papers address the issue: http://ppl.cs.illinois.edu/research/topology