The resulting experience is a real-time interactive exploration of data executed through a browser based platform using P5.js and the ML5 library, poseNet, a pre-built model that can detect multiple people in front of the camera, and track and visualize keypoints on bodies.
When people or sounds are picked up within the range of the webcam and microphone, different shapes inspired by Mr Spocks pin, appear on the screen in various sizes, colors, and positions, and respond to human interaction, as much as humans respond to seeing this reflected back.
Click on the IDIC symbol to enter the system space.