It will be similar to how tony stark and jarvis interact to create things, able to grab objects, form terrain, adjust physics, move camera, etc in 3d space. Could even use a bci to communicate abstract ideas or visualizations and see them in front of you in real time. But before then, will probably be text or advanced game engine on a desktop