TY - JOUR

T1 - Deep encoder–decoder network based data-driven method for impact feedback rendering on head during earthquake

AU - Joolee, Joolekha Bibi

AU - Hashem, Mohammad Shadman

AU - Hassan, Waseem

AU - Jeon, Seokhee

N1 - Funding Information: This research was funded by the Preventive Safety Service Technology Development Program funded by the Korean Ministry of Interior and Safety under Grant 2019-MOIS34-001. Publisher Copyright: © 2024, The Author(s).

PY - 2024/3

Y1 - 2024/3

N2 - In safety training simulators, realistic haptic feedback is essential to make people construct accurate situation awareness through experiencing. In this regard, this paper presents a new and innovative system that provides the haptic experience of falling objects on user’s head during an earthquake. Special focus was on the accurate reproduction of impact feedback when various objects fall on the head. To this end, we propose a novel data-driven approach. This approach first collects 3-axis acceleration signals during real collision under several impact velocities. Afterward, 3D acceleration data is abstracted to a 1D acceleration profile using our novel max–min extraction approach. The impact signal for an arbitrary velocity is interpolated using a deep convolutional bidirectional long short-term memory encoder–decoder model. Rendering hardware is also implemented using high performance voice-coil vibrotactile actuator. Numerical and subjective evaluations are carried out to evaluate the performance of the proposed approach.Kindly check and confirm the edit made in the title.I confirm the edit is okay.Please confirm if the author names are presented accurately and in the correct sequence (given name, middle name/initial, family name). Authors Given name: [Joolekha Bibi] Last name: [Joolee], Given name: [Mohammad Shadman] Last name: [Hashem]. Also, kindly confirm the details in the metadata are correct.Yes, the author names are presented accurately and in the correct sequence.

AB - In safety training simulators, realistic haptic feedback is essential to make people construct accurate situation awareness through experiencing. In this regard, this paper presents a new and innovative system that provides the haptic experience of falling objects on user’s head during an earthquake. Special focus was on the accurate reproduction of impact feedback when various objects fall on the head. To this end, we propose a novel data-driven approach. This approach first collects 3-axis acceleration signals during real collision under several impact velocities. Afterward, 3D acceleration data is abstracted to a 1D acceleration profile using our novel max–min extraction approach. The impact signal for an arbitrary velocity is interpolated using a deep convolutional bidirectional long short-term memory encoder–decoder model. Rendering hardware is also implemented using high performance voice-coil vibrotactile actuator. Numerical and subjective evaluations are carried out to evaluate the performance of the proposed approach.Kindly check and confirm the edit made in the title.I confirm the edit is okay.Please confirm if the author names are presented accurately and in the correct sequence (given name, middle name/initial, family name). Authors Given name: [Joolekha Bibi] Last name: [Joolee], Given name: [Mohammad Shadman] Last name: [Hashem]. Also, kindly confirm the details in the metadata are correct.Yes, the author names are presented accurately and in the correct sequence.

KW - Convolutional bidirectional long short-term memory encoder–decoder

KW - Data-driven approach

KW - Impact feedback

KW - Max–min extraction

UR - http://www.scopus.com/inward/record.url?scp=85182683846&partnerID=8YFLogxK

U2 - 10.1007/s10055-023-00906-9

DO - 10.1007/s10055-023-00906-9

M3 - Journal article

AN - SCOPUS:85182683846

VL - 28

JO - Virtual Reality

JF - Virtual Reality

SN - 1359-4338

IS - 1

M1 - 23

ER -