SensorMov, Native Library for Tangible Interactions with Android Devices
Abstract
The study presented in this paper aimed to contribute to the Spanish-speaking mobile developer community with a set of free programming tools, documentation, and examples to create tangible user interfaces with smartphones. These interfaces allow diversifying interactions with mobiles, prioritizing alternative uses of their sensors. The development of this set of tools occurred within the framework of a research project that sought to promote the dialogue of knowledge between engineering and traditional textile knowledge. The project used a participatory design methodology that involved diverse actors in different stages: self-recognition and mutual recognition, ideation, prototyping, and experimentation. As a result, we present a review of references on mobile devices and tangible interfaces, highlighting those mobile interactions that use physical objects and gestural actions; a technical description of SensorMov: its architecture and the specific design and, finally, its preliminary evaluation through a case study and an academic project. The library understands the tangible as the mobile itself or passive physical objects that do not require electrical power, such as magnets. In this sense, the documented version of SensorMov allowed working with raw data from the sensors, identifying objects and positions according to the static magnetic field of physical objects, and identifying and positioning physical objects on the mobile screen. The main challenge for the future is to enable appropriation spaces that facilitate and extend the library's use and functionalities, creating a community around it.
References
B. Myers, «A Brief History of Human Computer Interaction Technology», Interactions, vol. 5, pp. 44-54, mar. 1998, https://doi.org/10.1145/274430.274436
H. Ishii, «The Tangible User Interface and Its Evolution», Commun. ACM, vol. 51, n.o 6, pp. 32-36, jun. 2008, https://doi.org/10.1145/1349026.1349034
L. R. Ramos Aguiar y F. J. Álvarez Rodríguez, «Methodology for Designing Systems Based on Tangible User Interfaces and Gamification Techniques for Blind People», Appl. Sci., vol. 11, n.o 12, n.o 12, ene. 2021, https://doi.org/10.3390/app11125676
L. E. Holmquist, O. Zuckerman, R. Ballagas, H. Ishii, K. Ryokai, y H. Zhang, «The Future of Tangible User Interfaces», en Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow Scotland Uk, may 2019, pp. 1-6. https://doi.org/10.1145/3290607.3311741
Editorial La República, «Uso de smartphones incrementó 4,5% en Colombia, según reporte de We are social y Hootsuite», Diario La República. https://www.larepublica.co/internet-economy/uso-de-smartphones-incremento-4-5-en-colombia-segun-reporte-de-we-are-social-y-hootsuite-3241151 (accedido 14 de junio de 2022)
P. M. Vera, R. A. Rodríguez, y M. R. Martínez, «Interfaces tangibles - una nueva forma de interactuar con los smartphones», En XX Workshop de Investigadores en Ciencias de la Computación (WICC 2018, Universidad Nacional del Nordeste)., 2018. Accedido: 29 de junio de 2022. [En línea]. Disponible en: http://sedici.unlp.edu.ar/handle/10915/67966
V. Cheung y A. Girouard, «Tangible Around-Devices Interaction Using Rotatory Gestures with a Magnetic Ring», En Proc. 21st Int. Conf. Hum.-Comput. Interact. Mob. Devices Serv., 2019, https://doi.org/10.1145/3338286.3340137
S. Mayer, L. Lischke, A. Lanksweirt, H. Viet Le, y N. Henze, «How to communicate new input techniques», En Proc. 10th Nord. Conf. Hum.-Comput. Interact., 2018, https://doi.org/10.1145/3240167.3240176
P. Guiraud, El lenguaje del cuerpo. Fondo de Cultura Económica, 1993
J. M. Carroll, M. B. Rosson, y J. M. Carroll, «Participatory design in community informatics», Des. Stud., vol. 28, n.o. 3, pp. 243-261, May. 2007, https://doi.org/10.1016/j.destud.2007.02.007
I. Koskinen, J. Zimmerman, T. Binder, J. Redström, y S. Wensveen, «Constructive Design Research», en Design Research Through Practice, Boston: Morgan Kaufmann, 2012, pp. 1-13. https://doi.org/10.1016/B978-0-12-385502-2.00001-8
L. Cortés-Rico y G. Piedrahita-Solórzano, «Participatory Design in Practice», en Human-Computer Interaction – INTERACT 2015, sep. 2015, pp. 518-525. https://doi.org/10.1007/978-3-319-22698-9_35
S. Gallagher, «Phenomenology», en The Encyclopedia of Human-Computer Interaction, 2014. [En línea]. Disponible en: https://www.interaction-design.org/literature/book/the-encyclopedia-of-human-computer-interaction-2nd-ed/phenomenology
M. Merleau-Ponty, Phenomenology of Perception. Routledge, 2012
T. Pérez-Bustos y M. Franco-Avellaneda, «Embroidering Self-knowledge: Systematization of Experiences and Participatory Design of Weaving As a Caring Practice in Cartago, Valle, Colombia», en Proceedings of the 13th Participatory Design Conference: Short Papers, Industry Cases, Workshop Descriptions, Doctoral Consortium Papers, and Keynote Abstracts – Vol. 2, New York, NY, USA, 2014, pp. 99-102. https://doi.org/10.1145/2662155.2662173
L. Cortés-Rico, «ApTUI - Framework para el diseño participativo de interacciones tangibles», Pontificia Universidad Javeriana, Bogotá, 2015. [En línea]. Disponible en: https://docplayer.es/35500910-Pi-aptui-framework-para-el-diseno-participativo-de-interacciones-tangibles.html
D. K. Rosner y K. Ryokai, «Spyn: Augmenting the Creative and Communicative Potential of Craft», en Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, NY, USA, 2010, pp. 2407-2416. https://doi.org/10.1145/1753326.1753691
I. Posch y E. Kurbak, «CRAFTED LOGIC Towards Hand-Crafting a Computer», en Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, New York, NY, USA, 2016, pp. 3881-3884 https://doi.org/10.1145/2851581.2891101
I. Poupyrev, N.-W. Gong, S. Fukuhara, M. E. Karagozler, C. Schwesig, y K. E. Robinson, «Project Jacquard: Interactive Digital Textiles at Scale», en Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, New York, NY, USA, 2016, pp. 4216-4227. https://doi.org/10.1145/2858036.2858176
T. Pérez - Bustos, «Hilvanar tecnologías digitales y procesos de tejido o costura artesanal: una revisión crítica de prácticas», Signo Pensam., vol. 36, n.o 70, p. 14, jul. 2017, https://doi.org/10.11144//Javeriana.syp36-70.htdp
S. Kratz, T. Westermann, M. Rohs, y G. Essl, «CapWidgets: Tangile Widgets Versus Multi-touch Controls on Mobile Devices», en CHI ’11 Extended Abstracts on Human Factors in Computing Systems, New York, NY, USA, 2011, pp. 1351-1356. https://doi.org/10.1145/1979742.1979773
L. Chan, S. Müller, A. Roudaut, y P. Baudisch, «CapStones and ZebraWidgets: Sensing Stacks of Building Blocks, Dials and Sliders on Capacitive Touch Screens», en Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, NY, USA, 2012, pp. 2189-2192. https://doi.org/10.1145/2207676.2208371
K. Wolf et al., “TUIs in the Large,” en Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, New York, NY, USA, Apr. 2015, pp. 1579–1584. https://doi.org/10.1145/2702613.2732863
F. Strada and A. Bottino, “ToMMI - A Software Library for Multiplatform Tangible Mobile Interaction,” en Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Porto, Portugal, 2017, pp. 100–107. https://doi.org/10.5220/0006141401000107
H. V. Le, S. Mayer, y N. Henze, «InfiniTouch: Finger-Aware Interaction on Fully Touch Sensitive Smartphones», en Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, New York, NY, USA, oct. 2018, pp. 779-792. https://doi.org/10.1145/3242587.3242605
M. Kaltenbrunner, «reacTIVision and TUIO: a tangible tabletop toolkit», en ACM Internationa Conference on Interactive Tabletops and Surfaces, ITS, 2009, p. 9. https://doi.org/10.1145/1731903.1731906
M. Fetter, C. Beckmann, and T. Gross, “MagnetiCode,” en Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction, Munich, Germany, Feb. 2014, pp. 205–212. https://doi.org/10.1145/2540930.2540963
R. Xiao, S. Mayer, y C. Harrison, «VibroComm: Using Commodity Gyroscopes for Vibroacoustic Data Reception», en 22nd Int. Conf. Hum.-Comput. Interact. Mob. Devices Serv., n.o 5, pp. 1-9, 2020
S Z. Zhou, J. Xu, A. Balasubramanian, y D. E. Porter, «A Survey of Patterns for Adapting Smartphone App UIs to Smart Watches», en 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services, New York, NY, USA: Association for Computing Machinery, 2020, pp. 1-11. Accedido: 6 de julio de 2022. [En línea]. Disponible en: http://doi.org/10.1145/3379503.3403564
J. Normann Larsen, T. Højgaard Jacobsen, S. Boring, J. Bergström, y H. Pohl, «The Influence of Hand Size on Touch Accuracy», en Proc. 21st Int. Conf. Hum.-Comput. Interact. Mob. Devices Serv., n.o 4, pp. 1-11, 2019, http://doi.org/10.1145/3338286.3340115
H. Viet Le, S. Mayer, B. Steuerlein, y N. Henze, «Investigating Unintended Inputs for One-Handed Touch Interaction Beyond the Touchscreen», en Proc. 21st Int. Conf. Hum.-Comput. Interact. Mob. Devices Serv., n.o 34, pp. 1-14, 2019
R. Bhargava y C. D´Ignazio, «Data sculptures as a playful and low-tech introduction to work with data», 2017, Accedido: 22 de junio de 2022. [En línea]. Disponible en: https://www.media.mit.edu/publications/data-sculptures-as-a-playful-and-low-tech-introduction-to-working-with-data/
Y. Jansen et al., «Opportunities and Challenges for Data Physicalization», en Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, New York, NY, USA, 2015, pp. 3227-3236. https://doi.org/10.1145/2702123.2702180
S. Bae, R. Yang, P. Gyory, J. Uhr, D. A. Szafir, and E. Y.-L. Do, “Touching Information with DIY Paper Charts & AR Markers,” en Interaction Design and Children, Athens, Greece, Jun. 2021, pp. 433–438. https://doi.org/10.1145/3459990.3465191
C. Sanz, G. Gorga, P. M. Pesado, y V. Artola, «Diseño de un juego basado en Interacción Tangible para la enseñanza de Programación», Accedido: 27 de febrero de 2023. [En línea]. Disponible en: https://core.ac.uk/display/153566495?utm_source=pdf&utm_medium=banner&utm_campaign=pdf-decoration-v1
H. Zeng, X. He, y H. Pan, «FunPianoAR: A Novel AR Application for Piano Learning Considering Paired Play Based on Multi-Marker Tracking», J. Phys. Conf. Ser., vol. 1229, n.o 1, p. 012072, may 2019, https://doi.org/10.1088/1742-6596/1229/1/012072
H. K. H. Suzuki, «Algoblock: a tangible programming language, a tool for collaborative learning», 1993.
P. Marshall, «Do tangible interfaces enhance learning?», en Proceedings of the 1st international conference on Tangible and embedded interaction, New York, NY, USA, 2007, pp. 163-170. https://doi.org/10.1145/1226969.1227004
Tiggly, «Tiggly», https://www.tiggly.com/ (accedido 23 de abril de 2018)
J. Rodríguez-Almanza, «Desarrollo de una biblioteca que permita la programación de aplicaciones móviles que utilicen interfaces físcas artesanales». M.S. tesis, Universidad Militar Nueva Granada, Bogotá, Colombia, 2020. [En línea]. Disponible en: http://hdl.handle.net/10654/36921
L. Cortes-Rico y J. Rodriguez Almanza, «SensorMov, mobile devices as/for tangible user interfaces», en X Latin American Conference on Human Computer Interaction, New York, NY, USA, nov. 2021, pp. 1-3. https://doi.org/10.1145/3488392.3488409
M. S. Horn, E. T. Solovey, y R. J. K. Jacob, «Tangible programming and informal science learning: making TUIs work for museums», en Proceedings of the 7th international conference on Interaction design and children, New York, NY, USA, jun. 2008, pp. 194-201. https://doi.org/10.1145/1463689.1463756
J. Ma, L. Sindorf, I. Liao, y J. Frazier, «Using a Tangible Versus a Multi-touch Graphical User Interface to Support Data Exploration at a Museum Exhibit», en Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction, New York, NY, USA, ene. 2015, pp. 33-40. https://doi.org/10.1145/2677199.2680555
Downloads
Copyright (c) 2022 TecnoLógicas
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Altmetric
Funding data
-
Universidad Militar Nueva Granada
Grant numbers INV-ING-2981
