Real-Time Human Cognition of Nearby Vibrations Using Augmented Reality Elijah Wyckoff, Marlan Ball, and Fernando Moreu Abstract Human-computer interaction is an important part of structural monitoring and the research community is interested in amplifying human cognition of structural response. Augmenting feedback closes the loop between reality and human, where normally the human would need to check a computer or other separate screen for information on the real-time structural response. The research proposes using an Augmented Reality (AR) application to provide inspectors with realtime information about structural responses, to allow the user to perceive real-time changes. The proposed research seeks to validate the AR application as a useful tool in the field. This paper presents the results of an experiment that show how AR can provide a channel for direct sensor feedback. The application displays a live graph of accelerometer data with a low delay close to real time. The results of the reported experiment prove the usefulness of the AR application in the field by comparing feedback delay over a local area network versus a mobile WiFi hotspot. Keywords Wireless sensor · Structural response · Vibration · Augmented reality · Real time 1 Introduction It is important to researchers to monitor vibrations to ensure the safety of the nearby environment. Researchers need to track vibration levels to prevent damage to sensitive machines, but current technology does not allow for a researcher to work freely without having to check a computer monitor or use their hands [1]. Development of machine learning and deep learning algorithms in conjunction with smart sensors enables automated predictive maintenance [2]. This is enabled by IoT technology which is used for wireless sensor networks for environmental sensing and healthcare monitoring [3]. New framework has not been developed for the direct augmentation of data into the user’s vision. Researchers have also examined the time delay associated with network communication by analyzing Internet communication features. They propose a control structure to overcome the transmission delay [4]. Fu demonstrates the reliability of a proposed time-delay estimation method through Internet time-delay estimation experiments [5]. This research seeks to investigate the delay in local network and a mobile hotspot for use in the field. Researchers depend on sensors to inform on critical events especially in structural health monitoring (SHM). Smart Infrastructure wireless sensors are useful for their reliability, low-cost, low power, and fast deployment characteristics [6]. Wireless sensor networks are used for monitoring and assessing vibration risk in historical buildings and cultural sites [7]. Forming a network of wireless sensors supports the gathering of data and decision-making before, during, and after a crisis event. A wireless sensor network in Torre Aquila proved the system is an effective tool for assessing the tower stability while delivering data with loss ratios <0.01% with an estimated lifetime over 1 year [8]. Researchers developed an ad hoc wireless sensor deployment for indoor environmental quality monitoring in office buildings consisting of 19 sensor devices continuously measuring vibration and other levels [9]. Researchers reported installations of wireless sensor networks in a suspension bridge, slab bridge, rail tunnel, and water supply pipeline to manage infrastructure in a way that ensures safe and E.Wyckoff Department of Mechanical Engineering, University of New Mexico, Albuquerque, NM, USA e-mail: ewyckoff13@unm.edu M. Ball · F. Moreu ( ) Department of Civil, Construction, and Environmental Engineering, University of New Mexico, Albuquerque, NM, USA e-mail: mball15@unm.edu; fmoreu@unm.edu © The Society for Experimental Mechanics, Inc. 2022 K. Grimmelsman (ed.), Dynamics of Civil Structures, Volume 2, Conference Proceedings of the Society for Experimental Mechanics Series, https://doi.org/10.1007/978-3-030-77143-0_14 139
RkJQdWJsaXNoZXIy MTMzNzEzMQ==