AR Solar Hands // My virtual planetarium experience // Meta Quest 3
My son has been obsessed with planets and the solar system for years, so I decided to build him an AR/VR planetarium experience.
The initial implementation used accurate relative scaling of planet size and orbital rotations and velocity, but it proved less exciting to watch, so I took some artistic liberties to improve the experience.
Developed using Unity and implementing calls to ChatGPT for the answers to the questions and random planet facts.
Currently set up as:
Oculus Voice API for Speech to Text to ChatGPT API to ElevenLabs Text to Speech API
I originally used the Oculus Voice SDK for the text to speech but found the British voices a bit lacking. It also took a while to get the delay down when streaming from ChatGPT and then to wit.ai and found ElevenLabs’ Streaming API a bit quicker.
Has anyone had any experience with other Text to Speech implementations in Unity?
. .
Recorded via a Meta Quest 3 casting to the Meta Developer Hub.
* The music that plays once the planets are in the correct order was redubbed for this video because it sounded bad with the cuts.
#vr #virtualreality #virtualrealitye #education #learningdesign
Пікірлер: 5
It looks really great! I’d like to show this to my kids. Are you planning to open source the code?
@TheVRLearningDesigner-mh1df
3 ай бұрын
Hi there, I don't really think it's in any state to be open sourced, but I've created a build that you are welcome to try. I've just commented out the calls to GPT and Eleven Labs. Here is the .apk file that you can drop onto a Meta Quest device: drive.google.com/file/d/1yjkPkRVORD1JfESIuKdpPePg1TcfxW0t/view?usp=sharing
@SinteZcs
3 ай бұрын
@@TheVRLearningDesigner-mh1df oh man, thank you a lot! Going to try this out tonight
what's this game called
@TheVRLearningDesigner-mh1df
5 ай бұрын
Hi - sorry, it's not a game. It's an AR experience I built in Unity for my son. Details are in the video description.