proprioceptive interaction & I/O muscle-interfaces (PhD Topic)
This new way of interaction is especially suitable for wearables because it uses only our own body for both input and output and is eyes-free. It is based on the user’s proprioceptive sense, i.e., rather than seeing, hearing, or feeling an outside stimulus, users feel the pose of their own body. To pose the users body (output) our devices use electrical muscle stimulation, as it allows us to actuate with a minimal hardware footprint (mobile & wearable). For controlling the interaction users input by posing their body, which we read with different tracking methods (optical, accelerometer, etc). Here’s some examples of the work I have done on proprioceptive interaction:
Publications at CHI & UIST
- Muscle-Plotter: an Interactive System based on Electrical Muscle Stimulation that Produces Spatial Output, Pedro Lopes, Doğa Yüksel, François Guimbretière and Patrick Baudisch, UIST’16, Tokyo, Japan. // paper // video // UIST Talk video
- openEMSstim: the UIST Student Competition on Eletrical Muscle Stimulation Pedro Lopes, UIST’16, Tokyo, Japan. // code
- Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation [best talk nominee], Pedro Lopes, Alexandra Ion and Patrick Baudisch UIST’15, Charlotte, USA. // paper // video // UIST Talk video
- Affordance++: allowing objects to communicate dynamic use [best paper award], Pedro Lopes, Patrik Jonell and Patrick Baudisch CHI’15, Seoul, Korea. // paper // video // CHI Talk video
- Proprioceptive Interaction [best talk award #3], Pedro Lopes, Alexandra Ion, Willie Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch CHI’15, Seoul, Korea. // paper // video // CHI Talk video
- Muscle-propelled force feedback: bringing force feedback to mobile devices, Pedro Lopes, and Patrick Baudisch CHI’13, Paris, France. // paper // video // CHI talk video
invited talks & keynotes
- Proprioceptive Interaction: interfaces that read & write to the body
at NODE15 [talk & panel], Frankfurt, Germany.
- Affordance++ & Proprioceptive Interaction
at University of Tokyo, Japan.
- Turns out that the next wearable interface is your own body!
at Tech Open Air 2015, Berlin.
- Wearables that read & write to the body
at Re:publica 15, Berlin, Germany.
- Playing games through our bodies
at MuseumsQuartier SUBOTRON, Vienna, Austria
- Biohacking and Brain Computer interfaces: the future of Human Computer Interaction
at Campus Party 2012, Berlin, Germany. // video
- Exploring Mobile Force-Feedback based on Electrical Muscle Stimulation
at Technical University of Berlin’s Quality and Usability Lab Research Colloquium hosted by Katrin Wolf, Berlin, Germany.
- Towards Bio-Interfaces: New Input/Output technologies for Human Computer Interaction
at Jortec 2013, Lisbon, Portugal.
- Body & mind controlled, “Artists & scientists: Push Boundaries!”
at LEAP (Laboratory for Experimental Art and Performance), Berlin, Germany.
- Muscle-propelled interfaces: interfaces that move you!
at Academy Solitude, Stuttgart, Germany.
interactive sketching & fabrication
- Metamaterial Mechanisms, Alex Ion, Frohnhofen, J., Alistar, M., Wall, L., Kovacs, R., Lindsay, J., Lopes, P., Chen, H.-T., and Baudisch, P., UIST’16, Tokyo, Japan. paper // video
- Interactive Construction: interactive fabrication of functional mechanical devices, Stefanie Mueller, Pedro Lopes, and Patrick Baudisch UIST’12, Boston, USA. paper // video // video of talk
- Combining bimanual manipulation and pen-based input for 3D modelling, Pedro Lopes, Daniel Mendes, Bruno de Araújo, Joaquim Jorge, SBIM’11: Sketch-based Interface and Modelling, in cooperation with ACM SIGGRAPH and EUROGRAPHICS. paper // video
demos at HCI conferences
- Muscle-Propelled Force Feedback: bringing force feedback to mobile devices (demo), Pedro Lopes and Patrick Baudisch // video
at CHI’13 + WH’13 (IEEE World Haptics Conference) + AH’13 (Augmented Human)
- Gesture Output: Eyes-Free Output Using a Force Feedback Touch Surface (demo), Anne Roudaut, Christoff Sterz, Andreas Rau, Max Plauth, Pedro Lopes and Patrick Baudisch, at CHI’13 // video
touch acoustics & music
- Augmenting touch interaction through acoustic sensing, Pedro Lopes, Ricardo Jota, Joaquim Jorge, ITS’11: Interactive Tabletops and Surfaces, Kobe, Japan. paper // video
- Let’s Kick it: How to Stop Wasting the Bottom Third of Your Large Scale Display , Ricardo Jota, Pedro Lopes, Joaquim Jorge, and Daniel Wigdor, to appear at CHI’14.
- Battle of the DJs: An HCI perspective on Traditional, Virtual, Hybrid and Multitouch DJing, Pedro Lopes, Alfredo Ferreira, Joao M Pereira, NIME’11: Proceedings of the 11th International Conference on New Interfaces for Musical Expression. paper // video // talk at the conference (video)
conferences, teaching, community
- UIST 2013 Proceedings, proceedings chair of the UIST conference
- Special edition on Virtual reality, ACM XRDS Magazine, Feature Editor
- Editor at ACM XRDS, Digital Content.
- Student Volunteer at CHI2012 and Interact 2011 .
software tools and algorithms
- Dynamic Time Warping for Pure Data, Pedro Lopes, Joaquim Jorge, 2011, PdCon’11: The 4th Conference on Pure Data // video
- Click Tracker: Performance/composition tool for metrically complex scores, João Pais, Pedro Lopes, 2011, PdCon’11: The 4th Conference on Pure Data. Try the software.
articles on artistic practice
- Transhumance, Pedro Lopes, 2010, Future Places – Digital Media and Local Cultures // proceedings (pg. 169) // BibTeX
- Pedro Lopes & Jef Chippewa interview bio-artists Marco Donnarumma, Peter Kirn & Claudia Robles @ LEAP, CEC’ 2013 // read it
PhD & MsC Thesis
CV [download, pdf]