> A heirarchy of GPUs, outputs wired to inputs, mirroring the heirarchy of deep nets would be useful for real time robots & cars, NVIDIA's other big market.

Isn't that exactly what they're doing with NVLink?

https://devblogs.nvidia.com/parallelforall/inside-pascal (NVLink High Speed Interconnect section)