Something I was thinking about earlier, was having a game use both analog sticks for the camera. Each dimension is important just like all the others.Yes exactly.
On your 2d tv, you'd get your 3d representation of a 4d space.
It could probably work somewhat decently in VR. Put you in a virtual "control" room with a volumetric 3D display ie:
Then you'd also be able to use the VR controllers to each act like a 3D analogue stick and control the game in a "relatively" easy to understand way.
Hmm I like this idea a bit too much. After cube royale I might try making a prototype and see how realistic it is for me to make. 4D graphics could be done with raycasting and signed distance fields. Adding another dimension would only be a minor change. Getting it running at a smooth 60fps would be the hard part. Could either make the volumetric display only 124*124*124 voxels or try to do something dynamic based off camera position.