I think the 'depending on the resolution' is key. Its not really a matter of software to me, its whether or not the hardware can deliver the necessary resolution to replace a monitor that's typically 1.5ft from your face. If you can break the dam by executing on the hardware the software will flow. (I wonder how Hololens compares to Magic Leap's technology.)
I think it would be very cool to just have 3 tripods on your desk (a ball on a stick) that represent 3 screen spaces. You could reach out and move them around, telescope them up and down in the physical world and the headset could use them for triangulation to render an accurate monitor on each. You'd still have a keyboard and mouse in the first iteration and then slowly overtime give way to other forms of input.
Thinking about how our eyes really work - you don't need the same resolution. You only need proper eye tracking and the right amount of resolution in the center of your vision (or wherever). You only need it to render what you are looking at - I'm sitting about 2 feet away from a 27 inch screen.... I'm never looking at the entire thing in such a way that I need all that detail at every point. Sure, I need it to be there when my eyes dart around... but as long as that's done, it will look just as real.
Given something more adaptive, there's no reason you couldn't have a ginormous holographic wraparound workspace... or whatever your imagination can come up with.
I think it would be very cool to just have 3 tripods on your desk (a ball on a stick) that represent 3 screen spaces. You could reach out and move them around, telescope them up and down in the physical world and the headset could use them for triangulation to render an accurate monitor on each. You'd still have a keyboard and mouse in the first iteration and then slowly overtime give way to other forms of input.