Synchronizing audio-visual film stimuli in unity (version 5.5.1f1): Game engines as a tool for research
Research output: Working paper › Research
Standard
Synchronizing audio-visual film stimuli in unity (version 5.5.1f1): Game engines as a tool for research. / Sanz, Javier; Wulff-Abramsson, Andreas; Bruni, Luis Emilio; Aguilar, Carlos; Sánchez, Lydia.
arXiv.org, 2019. p. 1-13.Research output: Working paper › Research
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - UNPB
T1 - Synchronizing audio-visual film stimuli in unity (version 5.5.1f1): Game engines as a tool for research
AU - Sanz, Javier
AU - Wulff-Abramsson, Andreas
AU - Bruni, Luis Emilio
AU - Aguilar, Carlos
AU - Sánchez, Lydia
PY - 2019
Y1 - 2019
N2 - Unity is a software specifically designed for the development of video games. However, due to its programming possibilities and the polyvalence of its architecture, it can prove to be a versatile tool for stimuli presentation in research experiments. Nevertheless, it also has some limitations and conditions that need to be taken into account to ensure optimal performance in particular experimental situations. Such is the case if we want to use it in an experimental design that includes the acquisition of biometric signals synchronized with the broadcasting of video and audio in real time. In the present paper, we analyse how Unity (version 5.5.1f1) reacts in one such experimental design that requires the execution of audio-visual material. From the analysis of an experimental procedure in which the video was executed following the standard software specifications, we have detected the following problems desynchronization between the emission of the video and the audio; desynchronization between the temporary counter and the video; a delay in the execution of the screenshot; and depending on the encoding of the video a bad fluency in the video playback, which even though it maintains the total playback time, it causes Unity to freeze frames and proceed to compensate with little temporary jumps in the video. Finally, having detected all the problems, a compensation and verification process is designed to be able to work with audio-visual material in Unity (version 5.5.1f1) in an accurate way. We present a protocol for checks and compensations that allows solving these problems to ensure the execution of robust experiments in terms of reliability.
AB - Unity is a software specifically designed for the development of video games. However, due to its programming possibilities and the polyvalence of its architecture, it can prove to be a versatile tool for stimuli presentation in research experiments. Nevertheless, it also has some limitations and conditions that need to be taken into account to ensure optimal performance in particular experimental situations. Such is the case if we want to use it in an experimental design that includes the acquisition of biometric signals synchronized with the broadcasting of video and audio in real time. In the present paper, we analyse how Unity (version 5.5.1f1) reacts in one such experimental design that requires the execution of audio-visual material. From the analysis of an experimental procedure in which the video was executed following the standard software specifications, we have detected the following problems desynchronization between the emission of the video and the audio; desynchronization between the temporary counter and the video; a delay in the execution of the screenshot; and depending on the encoding of the video a bad fluency in the video playback, which even though it maintains the total playback time, it causes Unity to freeze frames and proceed to compensate with little temporary jumps in the video. Finally, having detected all the problems, a compensation and verification process is designed to be able to work with audio-visual material in Unity (version 5.5.1f1) in an accurate way. We present a protocol for checks and compensations that allows solving these problems to ensure the execution of robust experiments in terms of reliability.
KW - Faculty of Science
KW - Unity
KW - Video
KW - Delay
KW - Movie texture
KW - Experimental design
KW - Methodology
UR - http://www.scopus.com/inward/record.url?eid=2-s2.0-85094238228&partnerID=MN8TOARS
U2 - 10.48550/arXiv.1907.04926
DO - 10.48550/arXiv.1907.04926
M3 - Working paper
SP - 1
EP - 13
BT - Synchronizing audio-visual film stimuli in unity (version 5.5.1f1): Game engines as a tool for research
PB - arXiv.org
ER -
ID: 315541648