Yes. but in order to build it, you need to do it part by part.
Start small, then grow it item by item.
That interface you described is something you can start on!
If you like Lucid, build one hand of it.
Then build that interface you just described in Unity.
You can export it to work on Google Cardboard VR…
So all you need are $11 for one hand of Lucid and your phone…
And you can begin the project.