Description
MossPillow is a biodesign installation that can help people deep breathing and regulate their memory and emotions. By detecting experiencer’s different movements and blinking, the music will automatically change to provide a better interaction for people to breathe deeply. In this project, I want people to temporarily put down their phones and feel the positive impact of breathing.
Machine Learning Part
Using PoseNet to detect the cross finger gesture → play music from Plantwave library
Using FaceMesh to detect the open or close eyes → play natural sounds
Using Webcam to capture user’s facial expressions and hand movements
