Concept:
In the realm of artistic expression, wearable technologies offer a novel dimension, extending our capabilities to convey the more nuanced facets of art communication. This project is rooted in the idea of exploring new forms of communication between art performer and audiences , leveraging technology to add extra dimensions to the performing experience. The wearable MIDI mask embodies this concept, serving as a dynamic tool for visual manipulation in live performances. Utilizing the Adafruit Circuit Playground BLE as its microcontroller, which is programmed with a MIDI library, and integrating with TouchDesigner for visualizations, this device enables real-time, Bluetooth-enabled control over generative visuals. This Midi Mask not only facilitates communication through art but empowers performers to directly influence their visual surroundings through intuitive gestures. The MIDI controller, functioning via the MIDI mapper protocol within TouchDesigner, allows performers to seamlessly transition between various generative visuals, adding a layer of live, responsive visual flair to their performances.
Inspiration:
The genesis of this project can be traced to the pioneering works of artists like Björk, renowned for her innovative use of masks and wearables in performances. The concept of generating visuals in tandem with musical or performance art was a key motivator. This endeavour aims to encapsulate the essence of such artistic exploration, pushing the boundaries of how performers interact with and influence their visual environment.
Left to Right: 1. https://www.thefader.com/2023/11/06/bjork-cornucopia-new-album 2. https://www.manofthehourmag.com/entertainment/headphones-bjork-creates-wonderful-new-worlds-with-flutes
E-Textile Design:
At the heart of this piece are two DIY switches, crafted from snail shells, conductive bead thread, and crystals. These switches are designed to control a series of LilyPad single LEDs. Furthermore, the Circuit Playground is intricately programmed to function as a MIDI controller, manipulating live visuals within the TouchDesigner platform. It achieves this by converting its embedded accelerometer values into MIDI messages, which are then relayed to TouchDesigner, creating a generative live visual experience.
Physical Electronic Circuit:
The circuitry of this wearable considered both aesthetics and functionality. Crafted with lace, sculpting wire, conductive thread, LilyPad single LEDs, glass beads, and crystals, it not only serves its electronic functionality but it is tried aesthetics to be considered as well. The wire forms a fluid, 3D structure reminiscent of an orchid flower, with the lace chosen for its transparency, contributing to the mask’s ,lightweight appearance. This intricate lace and soft circuit assembly is encased on a clear plastic mask, ensuring comfort and safety for the wearer by preventing direct skin contact.
Touch Designer network:
Challenges Encountered in the MIDI Mask Controller Project
Challenge 1: Material Selection and Nature’s Surprises
My deep fascination with nature, its ingenious design, and its role as a primary source of inspiration led me to initially focus on using natural materials for their inherent conductive properties and unique qualities. The initial concept was to employ moss as a natural switch, leveraging its conductivity to facilitate value changes, similar to what is observed with other green plants and fruits. However, a surprising discovery was made: unlike typical plants whose conductive nature stems from their vascular systems filled with water and minerals, mosses exhibited a starkly different behavior. Their cellular systems are isolated, with each cell operating independently, resulting in a lack of overall conductivity. This biological distinction posed a unique challenge but also highlighted the creative diversity in nature. Consequently, I pivoted to an alternative approach, crafting a DIY switch from a snail shell, conductive metal bead, and conductive thread, which aligned more closely with the project requirements.
Challenge 2: Visual Manipulation and Technical Integration
The core idea of manipulating visuals through TouchDesigner necessitated the development of a custom Arduino code for the Circuit Playground and the creation of a corresponding network within TouchDesigner. Establishing a seamless communication channel between these two components through codes and protocols was a formidable challenge. To enhance the interactive experience, I integrated accelerometer sensors into the Circuit Playground. These sensors wirelessly transmit data to TouchDesigner, allowing performers to manipulate visuals through head movements. This approach not only added a layer of dynamic interaction but also afforded the performer the freedom to move and improvise with the visuals, supported by a reliable Bluetooth connection. The integration of these technologies required meticulous coding and calibration to ensure a harmonious and responsive system.
Link to the Ada fruit circuit playground code:
https://create.arduino.cc/editor/niloofar22/7f811b9a-8d27-4487-a8de-90b79376bc7d/preview
Link to the video of the work in use:
https://vimeo.com/manage/videos/893528146/privacy
Cited Work:
-This work was shaped with the help and inspiration of the following resources:
https://learn.adafruit.com/adafruit-circuit-playground-bluefruit/circuitpython-cap-touch
https://makeabilitylab.github.io/physcomp/cpx/
https://www.nps.gov/arch/learn/nature/mossesandliverworts.htm