proprioceptive interaction & I/O muscle-interfaces (PhD Topic)

what is proprioceptive interaction?

proprioceptive interaction diagram

This new way of  interaction is especially suitable for wearables because it uses only our own body for both input and output and is eyes-free. It is based on the user’s proprioceptive sense, i.e., rather than seeing, hearing, or feeling an outside stimulus, users feel the pose of their own body. To pose the users body (output) our devices use electrical muscle stimulation, as it allows us to actuate with a minimal hardware footprint (mobile & wearable). For controlling the interaction users input by posing their body, which we read with different tracking methods (optical, accelerometer, etc). Here’s some examples of the work I have done on proprioceptive interaction:


Publications at CHI & UIST
  • openEMSstim: the UIST Student Competition on Eletrical Muscle Stimulation  Pedro Lopes, UIST’16Tokyo, Japan. // code


invited talks & keynotes

  • Proprioceptive Interaction: interfaces that read & write to the body
    at NODE15 [talk & panel], Frankfurt, Germany.
  • Turns out that the next wearable interface is your own body!
    at Tech Open Air 2015, Berlin.
  • Wearables that read & write to the body
    at Re:publica 15, Berlin, Germany.
  • Biohacking and Brain Computer interfaces: the future of Human Computer Interaction
    at Campus Party 2012, Berlin, Germany. // video
  • Towards Bio-Interfaces: New Input/Output technologies for Human Computer Interaction 
    at Jortec 2013, Lisbon, Portugal.
  • Body & mind controlled, “Artists & scientists: Push Boundaries!”
    at LEAP (Laboratory for Experimental Art and Performance), Berlin, Germany.
  • Muscle-propelled interfaces: interfaces that move you!
    at Academy Solitude, Stuttgart, Germany.

interactive sketching & fabrication

  • Combining bimanual manipulation and pen-based input for 3D modelling,  Pedro Lopes,  Daniel Mendes, Bruno de AraújoJoaquim JorgeSBIM’11: Sketch-based Interface and Modelling, in cooperation with ACM SIGGRAPH and EUROGRAPHICS. paper // video
  • Hands-on interactive tabletop LEGO application, Daniel Mendes, Pedro Lopes, and  Alfredo Ferreira, 2011, ACE ’11: Proceedings of the 2010 ACM SIGCHI international conference on Advances in Computer Entertainment Technology, paper // video 

demos at HCI conferences

  • Muscle-Propelled Force Feedback: bringing force feedback to mobile devices (demo), Pedro Lopes and Patrick Baudisch // video 
    at CHI’13 + WH’13  (IEEE World Haptics Conference) + AH’13 (Augmented Human)
  • Constructable: interactive construction of functional mechanical devices (demo),  Stefanie Mueller, Pedro Lopes, Konstantin Kaefer,
    Bastian Kruck, and Patrick Baudisch
    at CHI’13 + TEI 2013, Barcelona, Spain.// video

touch acoustics & music

  • Let’s Kick it: How to Stop Wasting the Bottom Third of Your Large Scale Display , Ricardo Jota, Pedro Lopes, Joaquim Jorge, and Daniel Wigdor, to appear at CHI’14.
  • Multitouch Djing SurfacePedro Lopes,  Alfredo FerreiraJoao M Pereira, 2010, ACE ’10: Proceedings of the 2010 ACM SIGCHI international conference on Advances in Computer Entertainment Technology, paper // video // BibTeX

conferences, teaching, community

  • Special edition on Virtual reality, ACM XRDS Magazine, Feature Editor
  • Student Volunteer at CHI2012 and Interact 2011 .

software tools and algorithms

  • Dynamic Time Warping for Pure Data,  Pedro Lopes,  Joaquim Jorge2011, PdCon’11: The 4th Conference on Pure Data // video
  • Click Tracker: Performance/composition tool for metrically complex scores, João Pais, Pedro Lopes, 2011, PdCon’11: The 4th Conference on Pure Data. Try the software. 
  • Trainable DTW-based classifier for recognizing feet-gesturesPedro Lopes, Guilherme Fernandes, Joaquim Jorge, 2010, RecPad: 16th Portuguese Conference on Pattern Recognition // video // paper// BibTeX

articles on artistic practice

  • TranshumancePedro Lopes, 2010, Future Places – Digital Media and Local Cultures // proceedings  (pg. 169) // BibTeX
  • Pedro Lopes & Jef Chippewa  interview  bio-artists Marco Donnarumma, Peter Kirn & Claudia Robles @ LEAPCEC’ 2013 //  read it

PhD & MsC Thesis

  • PhD coming soon.
  • Mt-DJing: Multitouch DJing TablePedro Lopes, 2010, MSc Thesis, Instituto Superior Técnico, Lisboa, Portugal // paper// BibTeX

CV [download, pdf]