Health and performance questionnaire in esports from the coaches' point of viewdesign and validation using the Delphi method

  1. Manuel Sanz-Matesanz
  2. Gemma María Gea García
  3. Luis Manuel Martínez-Aranda
Revista:
Retos: nuevas tendencias en educación física, deporte y recreación

ISSN: 1579-1726 1988-2041

Año de publicación: 2024

Número: 56

Páginas: 408-418

Tipo: Artículo

Otras publicaciones en: Retos: nuevas tendencias en educación física, deporte y recreación

Resumen

Los deportes electrónicos están creciendo rápidamente en términos de impacto económico y social. Este crecimiento con-lleva la evolución de los clubes, que lleva al desarrollo profesional de sus jugadores y entrenadores. A pesar del protagonismo de los jugadores, los entrenadores desempeñan un papel crucial en el control de las variables de salud y rendimiento en los deportes electrónicos, lo que les confiere una gran relevancia. Sin embargo, la perspectiva de los entrenadores respecto a estas variables es actualmente desconocida. Por ello, esta investigación se propuso diseñar y validar, mediante el método Delphi, un cuestionario centrado en el punto de vista de los entrenadores sobre aspectos de salud y rendimiento en los deportes electrónicos. Se consultó a un grupo de8 expertos, los cuales cumplieron con los criterios de validez de la investigación. Posteriormente, se elaboró un cuestionario de 17 preguntas, dividido en las categorías de "Salud" y "Videojuego". El cuestionario procedió a validarse mediante el método Delphi a través de dos rondas de consulta. Se aplicó el coeficiente V de Aiken con un intervalo de confianza del 95% y, con un límite inferior de V de 0.75 y un mínimo de 0.7 para el límite inferior global. Los resultados mostraron que los 17 ítems cumplían los criterios establecidos (V≥0.75, Límite inferior > 0.7), lo que confirma su validez. Sobre la base de los datos obtenidos, este cuestionario representa una herramienta válida para conocer la perspectiva de los entrenadores sobre dos aspectos fundamentales en los deportes electrónicos: la salud y las claves de rendimiento. Además, se trata del primer cuestionario específicamente enfocado a este colectivo.

Referencias bibliográficas

  • Aiken, L. (1980). Content Validity and Reliability of Single Items or Questionnaire. Educational and Psychological Measurement 40, 955- 959. https://doi.org/10.1177/0013164480040004
  • Aiken, L. (1985). Three Coeficients for Analyzing the Reliability and Validity of Ralings. Educational and Psychologjcal Measurement, 45, 131-142. https://doi.org/10.1177/0013164485451
  • Almonacid-Fierro, A. Feu, S., y Vizuete, M. (2018). Validación de un cuestionario para medir el conocimiento didáctico del contenido en el profesorado de Educación Física. Retos, 34, 132-137.
  • Bányai, F., Griffiths, M. D., Király, O., & Demetrovics, Z. (2018). The Psychology of Esports: A Systematic Literature Review. Journal of Gambling Studies,35, 351-365. https://doi.org/10.1007/s10899-018-9763-1
  • Behnke, M., Gross, J. J., & Kaczmarek, L. D. (2020). The role of emotions in esports performance. Emotion, October, 22(5), 1059- 1070. https://doi.org/10.1037/emo0000903
  • Charter, R. A. (2003). A breakdown of reliability coefficients by test type andreliability method, and the clinical implications of low reliability. Journal of General Psychology, 130(3), 290-304.
  • Cicchetti, D.V. (1994). Guideliness, criterio, and rules of thumb for evaluating normed and standardized assessment instruments in psychilogy. Physhological Assessment, 6(4), 284-290. https://doi.org/10.1037/1040-3590.6.4.284
  • de Meyrick, J. (2003). The Delphi method and health research. Health Education, 103(1), 7–16. https://doi.org/10.1108/09654280310459112
  • Difrancisco-Donoghue, J., Balentine, J., Schmidt, G., & Zwibel, H. (2019). Managing the health of the eSport athlete: An integrated health management model. BMJ Open Sport and Exercise Medicine, 5(1), e000467. https://doi.org/10.1136/bmjsem-2018-000467
  • Escobar, J., & Cuervo, Á. (2008). Content validity and expert judgement: an approach to their use [in Spanish]. Avances en Medición,6(1), 27-36.
  • Freeman, G., & Wohn, D. Y. (2017). Social support in eSports: Building emotional and esteem support from instrumental support interactions in a highly competitive environment. CHI PLAY 2017 - Proceedings of the Annual Symposium on Computer-Human Interaction in Play, 435–447. https://doi.org/10.1145/3116595.3116635
  • Fruchart, E., & Rulence-Pâques, P. (2022). Predicting sports performance from well-being: A mapping of professional athletes’, amateur athletes’ and non-athletes’ positions. European Review of Applied Psychology, 72(6), 100793. https://doi.org/10.1016/j.erap.2022.100793
  • George, J., & Sherrick, B. (2019). Competition Formats in Esports. In Understanding Esports: An Introduction to the Global Phenomenon (pp. 45–56).
  • Gerber, M., Best, S., Meerstetter, F., Walter, M., Ludyga, S., Brand, S., Bianchi, R., Madigan, D. J., Isoard-Gautheur, S., & Gustafsson, H. (2018). Effects of stress and mental toughness on burnout and depressive symptoms: A prospective study with young elite athletes. Journal of Science and Medicine in Sport, 21(12), 1200–1205. https://doi.org/10.1016/j.jsams.2018.05.018
  • Giakoni-Ramírez, F., Merellano-Navarro, E., & Duclos-Bastías, D. (2022). Professional Esports Players: Motivation and Physical Activity Levels. International Journal of Environmental Research and Public Health, 19(4), 2256-2269. https://doi.org/10.3390/ijerph19042256
  • Gong, D., Ma, W., Liu, T., Yan, Y., & Yao, D. (2019). Electronic-sports experience related to functional enhancement in central executive and default mode areas. Neural Plasticity, 1940123. https://doi.org/10.1155/2019/1940123
  • Gonzalez-Campos, G., Valdivia-Moral, P., Cachon-Zagalaz, J., Zurita-Ortega, F., & Romero, O. (2017). Influence of stress control in the sports performance: self-confidence, anxiety and concentration in athletes. RETOS-Neuvas Tendencias en Educacion Fisica, Deporte y Recreacion, 32, 3-6.
  • Gouttebarge, V., Aoki, H., & Kerkhoffs, G. (2015). Symptoms of common mental disorders and adverse health behaviours in male professional soccer players. Journal of Human Kinetics, 49(1), 277–286. https://doi.org/10.1515/hukin-2015-0130
  • Gray, P. B., Vuong, J., Zava, D. T., & McHale, T. S. (2018). Testing men’s hormone responses to playing League of Legends: No changes in testosterone, cortisol, DHEA or androstenedione but decreases in aldosterone. Computers in Human Behavior, 83, 230–234. https://doi.org/10.1016/j.chb.2018.02.004
  • Grunseit, A. C., MacNiven, R., Orr, R., Grassmayr, M., Kelly, B., Davies, D., Colagiuri, S., & Bauman, A. E. (2012). Australian athletes’ health behaviours and perceptions of role modelling and marketing of unhealthy products. Health Promotion Journal of Australia, 23(1), 63–69. https://doi.org/10.1071/he12063
  • Hulaj, R., Nyström, M. B. T., Sörman, D. E., Backlund, C., Röhlcke, S., & Jonsson, B. (2020). A Motivational Model Explaining Performance in Video Games. Frontiers in Psychology, 11, 1510. https://doi.org/10.3389/fpsyg.2020.01510
  • Jenny, S. E., Manning, R. D., Keiper, M. C., & Olrich, T. W. (2017). Virtual(ly) Athletes: Where eSports Fit Within the Definition of “Sport.” Quest, 69(1), 1–18. https://doi.org/10.1080/00336297.2016.1144517
  • Kari, T., & Karhulahti, V.-M. (2017). Do E-Athletes Move? International Journal of Gaming and Computer-Mediated Simulations, 8(4), 53–66. https://doi.org/10.4018/ijgcms.2016100104
  • Kari, T., & Karhulahti, V. M. (2016). Do e-athletes move? A study on training and physical exercise in elite e-sports. International Journal of Gaming and Computer-Mediated Simulations, 8(4), 53–66. https://doi.org/10.4018/IJGCMS.2016100104
  • Kessler, R. C., Barber, C., Beck, A., Berglund, P., Cleary, P. D., McKenas, D., ... & Wang, P. (2003). The world health organization health and work performance questionnaire (HPQ). Journal of occupational and environmental medicine, 45(2), 156-174.
  • Kokko, S., Selänne, H., Alanko, L., Heinonen, O. J., Korpelainen, R., Savonen, K., Vasankari, T., Kannas, L., Kujala, U. M., Aira, T., Villberg, J., & Parkkari, J. (2015). Health promotion activities of sports clubs and coaches, and health and health behaviours in youth participating in sports clubs: The Health Promoting Sports Club study. BMJ Open Sport and Exercise Medicine, 1(1), 1–11. https://doi.org/10.1136/bmjsem-2015-000034
  • Lee, S., Bonnar, D., Roane, B., Gradisar, M., Dunican, I. C., Lastella, M., Maisey, G., & Suh, S. (2021). Sleep characteristics and mood of professional esports athletes: A multi-national study. International Journal of Environmental Research and Public Health, 18(2), 1–14. https://doi.org/10.3390/ijerph18020664
  • Madden, D., & Harteveld, C. (2021). Constant pressure of having to perform: Exploring player health concerns in esports. Conference on Human Factors in Computing Systems - Proceedings, 324, 1-14. https://doi.org/10.1145/3411764.3445733
  • Maravé, M., Gil, J., Chiva, O., & Moliner, L. (2017). Validation of an instrument for the analysis of socio-emotional skills in Physical Education [in Spanish]. Retos, 30, 8-13. http://hdl.handle.net/10550/53757
  • Mateo-Orcajada, A., Abenza-Cano, L., & Vaquero-Cristóbal, R. (2022). Analyzing the changes in the psychological profile of professional League of Legends players during competition. Computers in Human Behavior, 126, 107030. https://doi.org/10.1016/j.chb.2021.107030
  • Mediavilla., L., & García, J. M. (2013). Design, creation and validation of an interview to obtain biographical data, of a sporting-military nature, of military personnel who participated in the Olympic Games [in Spanish]. Journal of Sport and Health Research, 5(2), 157-166.
  • Medina, A. W., Lepe, G. A. O., Roco, G. C., Ojeda, A. F., Burgos, C. N., Martínez, J. R., & Sepúlveda, R. Y. (2024). Ejercicio físico, hábitos alimentarios y estrés:¿ Qué ocurrió con los estudiantes universitarios durante la pandemia?. Retos: nuevas tendencias en educación física, deporte y recreación, 53, 100-108.
  • Mora-Cantallops, M., & Sicilia, M. Á. (2019). Team efficiency and network structure: The case of professional League of Legends. Social Networks, 58, 105–115. https://doi.org/10.1016/j.socnet.2019.03.004
  • Myrseth, H., Olsen, O. K., Strand, L. Å., & Borud, E. K. (2017). Gaming behavior among conscripts: The role of lower psychosocial well-being factors in explaining gaming addiction. Military Psychology, 29(2), 128-142. https://doi.org/10.1037/mil0000148
  • Nagorsky, E., & Wiemeyer, J. (2020). The structure of performance and training in esports. PLoS ONE, 15(8), e0250316. https://doi.org/10.1371/journal.pone.0237584
  • Nasa, P., Jain, R., & Juneja, D. (2021). Delphi methodology in healthcare research: How to decide its appropriateness. World Journal of Methodology, 11(4), 116–129. https://doi.org/10.5662/wjm.v11.i4.116
  • Newzoo. (2022). Global Esports & Live Streaming Market Report.
  • Oberg, E., & Frank, E. (2011). Physicians’ health practices strongly influence patient health practices. Journal of the Royal College of Physicians of Edinburgh, 4(39), 290–291. https://doi.org/doi:10.4997/JRCPE.2009.422
  • Okoli, C., & Pawlowski, D. (2004). The Delphi method as a research tool: an example, design considerations and applications. Information y Management, 42(1),15-29. https://doi.org/10.1016/j.im.2003.11.002
  • Penfield, R.D., & Giacobbi, P.R. (2004) Applying a Score Confidence Interval to Aiken's Item Content-Relevance Index. Measurement in Physical Education and Exercise Science, 8(4), 213-225. https://doi.org/10.1207/s15327841mpee0804_3
  • Pluss, M. A., Bennett, K. J. M., Novak, A. R., Panchuk, D., Coutts, A. J., & Fransen, J. (2019). Esports: The chess of the 21st century. Frontiers in Psychology, 10, 156. https://doi.org/10.3389/fpsyg.2019.00156
  • Poulus, D. R., Coulter, T. J., Trotter, M. G., & Polman, R. (2020). Stress and Coping in Esports and the Influence of Mental Toughness. Frontiers in Psychology, 11, 628. https://doi.org/10.3389/fpsyg.2020.00628
  • Rajič, F., & Grubić, M. (2018). The Impact of Changing the Coach on Injuries in Professional Sport—Example from Practice. Journal of Health Science, 6(3), 159–162. https://doi.org/10.17265/2328-7136/2018.03.004
  • Reguant-Álvarez, M., & Torrado-Fonseca, M. (2016). El método Delphi. REIRE. Revista d’Innovació i Recerca En Educació, 9(1), 87–102. https://doi.org/10.1344/reire2016.9.1916
  • Reitman, J. G., Anderson-Coto, M. J., Wu, M., Lee, J. S., & Steinkuehler, C. (2020). Esports Research: A Literature Review. Games and Culture, 15(1), 32–50. https://doi.org/10.1177/1555412019840892
  • Rice, S. M., Parker, A. G., Mawren, D., Clifton, P., Harcourt, P., Lloyd, M., ... & Purcell, R. (2020). Preliminary psychometric validation of a brief screening tool for athlete mental health among male elite athletes: the athlete psychological strain questionnaire. International journal of sport and exercise psychology, 18(6), 850-865.
  • Röhlcke, S., Bäcklund, C., Sörman, D. E., & Jonsson, B. (2018). Time on task matters most in video game expertise. PLoS ONE, 13(10), 1–13. https://doi.org/10.1371/journal.pone.0206555
  • Rudolf, K., Bickmann, P., Froböse, I., Tholl, C., Wechsler, K., & Grieben, C. (2020). Demographics and health behavior of video game and esports players in germany: The esports study 2019. International Journal of Environmental Research and Public Health, 17(6). https://doi.org/10.3390/ijerph17061870
  • Sanz-Matesanz, M., Gea-García, G. M., & Martínez-Aranda, L. M. (2023). Physical and psychological factors related to player’s health and performance in esports: A scoping review. Computers in Human Behavior, 143, 107698. https://doi.org/10.1016/j.chb.2023.107698
  • Sanz-Matesanz, M., Martínez-Aranda, L. M., & Gea-García, G. M. (2024). Effects of a Physical Training Program on Cognitive and Physical Performance and Health-Related Variables in Professional esports Players: A Pilot Study. Applied Sciences, 14(7), 2845.
  • Shinners, L., Aggar, C., Grace, S., & Smith, S. (2021). Exploring healthcare professionals’ perceptions of artificial intelligence: Validating a questionnaire using the e-Delphi method. Digital Health, 7, 20552076211003433.
  • Singh, K. (2007). Quantitative Social Research Methods. London: Sage Publications
  • Smith, M., Sharpe, B., Arumuham, A., & Birch, P. (2022). Examining the Predictors of Mental Ill Health in Esport Competitors. Healthcare, 10(4), 1–13. https://doi.org/10.3390/healthcare10040626
  • Sörman, D. E., Dahl, K. E., Lindmark, D., Hansson, P., Vega-Mendoza, M., & Körning-Ljungberg, J. (2022). Relationships between Dota 2 expertise and decision-making ability. PLoS ONE, 17(3), e0264350. https://doi.org/10.1371/journal.pone.0264350
  • Sourani, A., & Sohail, M. (2015). The Delphi Method: Review and Use in Construction Management Research. International Journal of Construction Education and Research, 11(1), 54–76. https://doi.org/10.1080/15578771.2014.917132
  • Sousa, A., Ahmad, S. L., Hassan, T., Yuen, K., Douris, P., Zwibel, H., & DiFrancisco-Donoghue, J. (2020). Physiological and Cognitive Functions Following a Discrete Session of Competitive Esports Gaming. Frontiers in Psychology, 11, 1030. https://doi.org/10.3389/fpsyg.2020.01030
  • Souter, G., Lewis, R., & Serrant, L. (2018). Men, Mental Health and Elite Sport: a Narrative Review. Sports Medicine - Open, 4(1), 1–8. https://doi.org/10.1186/s40798-018-0175-7
  • Studholme, B. & Joseph, S. (January 6, 2023) The esports salary market is headed toward a correction. Digiday. https://digiday.com/marketing/the-esports-salary-market-is-headed-toward-a-correction/#:~:text=Hal%20Biagas%2C%20then%20the%20executive,one%20league%20source%20told%20Digiday
  • Tobar, N. M., Narvaez, L. M. C., & Hurtado, A. F. V. (2023). El uso del videojuego y su relación en el sobrepeso en universitarios, Popayán, Colombia. Retos: nuevas tendencias en educación física, deporte y recreación, 48, 138-144.
  • Trotter, M. G., Coulter, T. J., Davis, P. A., Poulus, D. R., & Polman, R. (2021). Social Support, Self-Regulation, and Psychological Skill Use in E-Athletes. Frontiers in Psychology, 12, 722030. https://doi.org/10.3389/fpsyg.2021.722030
  • Varela-Ruiz, M., Díaz-Bravo, L., & García. Durán, R. (2012). Description and uses of the Delphi method in health research [in Spanish]. Investigación en Educación Médica, 1(2), 90-95.
  • Wilson, E.B. (1927). Probable inference, the law of succession, and statistical inference. Journal of the American Statistical Association, 22, 209-212. https://doi.org/10.1080/01621459.1927.10502953
  • Zubillaga-Olague, M., & Cañadas, L. (2021). Diseño y validación del cuestionario “# EvalEF” para conocer el proceso de evaluación desarrollado por los docentes de educación física. Retos: nuevas tendencias en educación física, deporte y recreación, 42, 47-55.