What
The Peninsula Team have requested an application that will allow medical professionals to ‘watch through the eyes of another’ as they perform home visits, likely for podiatry purposes. This is for AR-based guidance for health training and real-time assistance.
The team desire:
Quest 3-based livestreaming with a third-person POV view.
Remote assistance/training features to be explored.
Real-time vs alternative solutions to be assessed.
Demo the product with 1 Headset
Timeline
N/A Right now, Ideally by Week 14 As this shouldnt need to take longer than that
Tools
Quest 3
Networking tools:
Considering this https://github.com/MirrorNetworking/Mirror#made-with-mirror
Based on this https://www.reddit.com/r/Unity3D/comments/zqpr0c/whats_the_best_networking_solution_for_unity_unet/
Features
As a AR doctor, I want to be able to write down notes
As an AR doctor, I would want to have a clear instruction from the PC not from words but through signs
AR headset could detect feet
As a patient, I want to receive the prescription or analysis from what the doctor has discovered. (Send them to my device
As a PC doc, I want to be able to send readable text notes to my colleague in AR
Connect Bluetooth device for tracking heat rates, and sending that data over
As AR doc, I want to speak to the PC doc
Doc on PC can view AR headset detect quality
PC doc can verbally chat to AR doc
As a PC doc, I want to send images and pdfs to the AR headset so the doctor can consult help manuals
An AR application, built for the Quest 3 that will:
Display medical documents from
Out of Scope
The app is just for one pc to connect to one Quest 3, while the team would love to use something closer to smart glasses there are no viables alternatives on the market right now, although Metas Orion or Snapchats Lenses should release by 2026/27