Immersive learning Pilot
Immersive Ward Simulation
A browser-based, touch-interactive 270° clinical simulation for a three-wall projection room, built for nursing education.
- Three.js
- WebGL
- Vite
- TypeScript
- Azure App Service
- Azure AI Foundry
- GitHub Actions
Students stand in a three-wall immersive projection room and work through a clinical scenario — without a real ward and without a game engine.
The approach
- One browser, three walls. A fullscreen Chrome surface renders a WebGL scene across the room, working alongside the room’s existing projection warp and blend.
- AI-generated sets. Looping video plates of clinical spaces are generated with AI, with interactive props layered on top.
- Touch to learn. Students tap, drag, pinch and rotate superimposed props to complete observation tasks; the system handles mouse, touch and pen input.
- Facilitator in control. A movable toolbox lets the facilitator annotate with pen, line and shape tools, reset the scene and drive the lesson.
- Set builder. Sets — walls and props — can be authored and loaded as collections, so new scenarios don’t need new code.
Where it’s heading
Scenario-based learning grounded in specific learning areas, and AI talking avatars that students can speak with.