Interactive Systems based on Electrical Muscle Stimulation (PhD Topic)
This new way of interaction is especially suitable for wearables because it uses only our own body for both input and output and is eyes-free. It is based on the user’s proprioceptive sense, i.e., rather than seeing, hearing, or feeling an outside stimulus, users feel the pose of their own body. To pose the users body (output) our devices use electrical muscle stimulation, as it allows us to actuate with a minimal hardware footprint (mobile & wearable). For controlling the interaction users input by posing their body, which we read with different tracking methods (optical, accelerometer, etc). Here’s some examples of the work I have done on proprioceptive interaction / interactive EMS-based systems:
Publications (First-author, CHI & UIST)
- Providing Haptics to Walls and Other Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation, Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki and Patrick Baudisch CHI’17, Denver, USA. // paper // video
- Muscle-Plotter: an Interactive System based on Electrical Muscle Stimulation that Produces Spatial Output, Pedro Lopes, Doğa Yüksel, François Guimbretière and Patrick Baudisch, UIST’16, Tokyo, Japan. // paper // video // UIST Talk video
- Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation [best talk nominee], Pedro Lopes, Alexandra Ion and Patrick Baudisch UIST’15, Charlotte, USA. // paper // video // UIST Talk video
- Affordance++: allowing objects to communicate dynamic use [best paper award], Pedro Lopes, Patrik Jonell and Patrick Baudisch CHI’15, Seoul, Korea. // paper // video // CHI Talk video
- Proprioceptive Interaction [best talk award #3], Pedro Lopes, Alexandra Ion, Willie Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch CHI’15, Seoul, Korea. // paper // video // CHI Talk video
- Muscle-propelled force feedback: bringing force feedback to mobile devices, Pedro Lopes, and Patrick Baudisch CHI’13, Paris, France. // paper // video // CHI talk video
invited talks & keynotes
- Affordance++ & Proprioceptive Interaction
at University of Tokyo, Japan.
- Proprioceptive Interaction: interfaces that read & write to the body
at NODE15 [talk & panel], Frankfurt, Germany.
- Turns out that the next wearable interface is your own body!
at Tech Open Air 2015, Berlin.
- Wearables that read & write to the body
at Re:publica 15, Berlin, Germany.
- Playing games through our bodies
at MuseumsQuartier SUBOTRON, Vienna, Austria
- Biohacking and Brain Computer interfaces: the future of Human Computer Interaction
at Campus Party 2012, Berlin, Germany. // video
- Exploring Mobile Force-Feedback based on Electrical Muscle Stimulation
at Technical University of Berlin’s Quality and Usability Lab Research Colloquium hosted by Katrin Wolf, Berlin, Germany.
- Towards Bio-Interfaces: New Input/Output technologies for Human Computer Interaction
at Jortec 2013, Lisbon, Portugal.
- Body & mind controlled, “Artists & scientists: Push Boundaries!”
at LEAP (Laboratory for Experimental Art and Performance), Berlin, Germany.
- Muscle-propelled interfaces: interfaces that move you!
at Academy Solitude, Stuttgart, Germany.
- UIST 2017 Program Committee Member
- CHI 2017 Session chair (“Haptic Feedback” session)
- UIST 2017 Student Innovation Contest Chair
- TEI 2017 Student Design Challenge Chair
- DIS 2017 Program Committee Member (technological innovation subcommittee)
- DeSForM 2017 Program Committee Member (interactive technologies subcommittee)
- UIST 2016 Student Innovation Contest Chair (hardware was the openEMSstim board)
- UIST 2013 Proceedings Chair
Editor, community, etc
HCI lectures (teaching)
interactive sketching & fabrication (co-authored)
- Metamaterial Mechanisms, Alex Ion, Frohnhofen, J., Alistar, M., Wall, L., Kovacs, R., Lindsay, J., Lopes, P., Chen, H.-T., and Baudisch, P., UIST’16, Tokyo, Japan. paper // video
- Interactive Construction: interactive fabrication of functional mechanical devices, Stefanie Mueller, Pedro Lopes, and Patrick Baudisch UIST’12, Boston, USA. paper // video // video of talk
- Combining bimanual manipulation and pen-based input for 3D modelling, Pedro Lopes, Daniel Mendes, Bruno de Araújo, Joaquim Jorge, SBIM’11: Sketch-based Interface and Modelling, in cooperation with ACM SIGGRAPH and EUROGRAPHICS. paper // video
- Hands-on interactive tabletop LEGO application, Daniel Mendes, Pedro Lopes, and Alfredo Ferreira, 2011, ACE ’11: Proceedings of the 2010 ACM SIGCHI international conference on Advances in Computer Entertainment Technology, paper // video
Force Feedback Haptic Interfaces (co-authored)
- Gesture Output: Eyes-Free Output Using a Force Feedback Touch Surface, Anne Roudaut, Christoff Sterz, Andreas Rau, Max Plauth, Pedro Lopes and Patrick Baudisch, CHI’13 // paper // video
- Haptic Turk: a motion platform based on people, Lung-Pan Cheng, Patrick Lühne, Pedro Lopes and Patrick Baudisch, CHI’14 // paper // video
touch acoustics & music
- Augmenting touch interaction through acoustic sensing, Pedro Lopes, Ricardo Jota, Joaquim Jorge, ITS’11: Interactive Tabletops and Surfaces, Kobe, Japan. paper // video
- Let’s Kick it: How to Stop Wasting the Bottom Third of Your Large Scale Display , Ricardo Jota, Pedro Lopes, Joaquim Jorge, and Daniel Wigdor, to appear at CHI’14.
- Battle of the DJs: An HCI perspective on Traditional, Virtual, Hybrid and Multitouch DJing, Pedro Lopes, Alfredo Ferreira, Joao M Pereira, NIME’11: Proceedings of the 11th International Conference on New Interfaces for Musical Expression. paper // video // talk at the conference (video)
- Multitouch Djing Surface, Pedro Lopes, Alfredo Ferreira, Joao M Pereira, 2010, ACE ’10: Proceedings of the 2010 ACM SIGCHI international conference on Advances in Computer Entertainment Technology, paper // video // BibTeX
software tools and algorithms
- Dynamic Time Warping for Pure Data, Pedro Lopes, Joaquim Jorge, 2011, PdCon’11: The 4th Conference on Pure Data // video
- Click Tracker: Performance/composition tool for metrically complex scores, João Pais, Pedro Lopes, 2011, PdCon’11: The 4th Conference on Pure Data. Try the software.
- Trainable DTW-based classifier for recognizing feet-gestures, Pedro Lopes, Guilherme Fernandes, Joaquim Jorge, 2010, RecPad: 16th Portuguese Conference on Pattern Recognition // video // paper// BibTeX
demos at HCI conferences
- Muscle-Propelled Force Feedback: bringing force feedback to mobile devices (demo), Pedro Lopes and Patrick Baudisch // video
at CHI’13 + WH’13 (IEEE World Haptics Conference) + AH’13 (Augmented Human)
- Gesture Output: Eyes-Free Output Using a Force Feedback Touch Surface (demo), Anne Roudaut, Christoff Sterz, Andreas Rau, Max Plauth, Pedro Lopes and Patrick Baudisch, at CHI’13 // video
- Constructable: interactive construction of functional mechanical devices (demo), Stefanie Mueller, Pedro Lopes, Konstantin Kaefer,
Bastian Kruck, and Patrick Baudisch
at CHI’13 + TEI 2013, Barcelona, Spain.// video
articles on artistic practice
PhD & MsC Thesis
CV [download, pdf]