Interactive Experiences
Allison Berkoy and Students of ENT 3320
YOU ARE PREPARED is an absurd interactive performance in the guise of a webinar, unfolding in real-time between a human participant and their computer. Set up as an online research and development lab, this Spring 2021 course focused on three key areas of the project: a series of body-controlled interactive experiences using a standard web browser, webcam and microphone; opportunities for screen-based human-computer interaction beyond a mouse and keyboard interface; and integration of code-driven interactive audiovisuals within the browser.
Students explored ml5.js, a machine-learning library which interfaces with TensorFlow.js, enabling the tracking of skeleton data through the browser in real-time.
This work builds upon YAP’s first technical prototype, developed in Spring/Summer 2020 by Professor Berkoy in collaboration with MTEC students; which featured an augmented reality toilet paper hoarding game, voice-controlled audiovisuals, and additional technical usability tests. YAP Prototype V.2 integrates code-driven animated audiovisual templates, original music and sound effects, and new body-controlled experiences: the “wellness flow” and “selfie certificate.”
To experience YOU ARE PREPARED Prototype V.2 firsthand, or for more information about this work in development, contact Professor Berkoy at aberkoy@citytech.cuny.edu.