Apple Vision Pro UI Interactions with Unity PolySpatial | Keyboard and Voice Inputs

Hi XR Developers! In this video we will look at how to use the visionOS system keyboard for our Unity UI and how to achieve speech to text input using AI (Whisper from OpenAI)!

Resources:
🔗 Unity PolySpatial 1.1 Documentation: https://docs.unity3d.com/Packages/com...
🔗 Play to Device: https://docs.unity3d.com/Packages/com...
🔗 Input Documentation: https://docs.unity3d.com/Packages/com...
🔗 Whisper for Unity: https://github.com/Macoron/whisper.un...
🔗 Whisper Models: https://huggingface.co/ggerganov/whis...

Other Videos:
📹 Create and Manage SwiftUI windows with Unity PolySpatial for Apple visionOS:    • Create and Manage SwiftUI windows with Uni...  
📹 Apple Vision Pro Input & Object Manipulation with Unity PolySpatial:    • Apple Vision Pro Input & Object Manipulati...  
📹 Develop for Apple Vision Pro with Unity’s PolySpatial:    • Develop for Apple Vision Pro with Unity’s ...  
📹 How to become an Apple XR Developer with Unity for visionOS:    • Apple Vision Pro - How to become an Apple ...  

Join the Discord!
👾   / discord  

Support the Channel:
🫂 Patreon:   / xrdevrob  
🐦 Twitter:   / xrdevrob  

🤝 Join this channel to get access to perks:
   / @xrdevrob  

Need professional XR & Multiplayer development for your project?
👨‍💻 Get in touch with us: https://bento.me/blackwhale

Chapters:
0:00 Intro
0:39 Setup Scene with TMP Input Field
2:03 Testing the Keyboard Input
2:25 Set up Whisper AI in Unity
4:06 Whisper Scene Setup
5:44 Whisper Voice Input Script
7:09 Testing Whisper AI
8:08 Outro