Abstract
This research article attempts to conceptualize and operationalize the concept of engagement in videogame-play as consumer videogame engagement that comprises both psychological and behavioral dimensions. Accordingly, this study has developed a scale for measuring consumer videogame engagement through following the steps of scale development. Next, the study has collected data on two samples. Besides, this study has applied SPSS 22.0 version and SEM-PLS approach to analyze the data on two samples and to validate the construct of consumer videogame engagement. Based on the study results, an instrument has proven to be a valid source for measuring engagement in videogames as well as a reflective-formative and multi-dimensional construct. This study contributes to the videogame literature as it considers consumer videogame engagement as a multi-dimensional construct comprising on cognitive, affective and behavioral engagement. It further validates the scale of consumer videogame engagement as reflective-formative model among videogame players.
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
Keywords
- Engagement
- Videogame engagement
- Consumer videogame engagement
- Cognitive engagement
- Affective engagement
- Behavioral engagement
- Reflective-formative model
- Scale development process
1 Introduction
Literature indicates that several studies have put their efforts to develop an instrument to measure engagement in videogame playing. Among all the studies, a study by [1], was the first research who developed an instrument to measure the subjective experience of videogame-play based on these dimensions “gameflow, cognitive-absorption and presence” and named it as game-experience questionnaire or GEQ. Another subsequent study done by [2] who developed a scale named as game engagement questionnaire or GEQ with combination of four constructs “flow, presence, absorption and immersion” to measure player’s engagement in videogame. Again, this study has also used almost similar dimensions as it was used in the following study [1]. In similar vein, a recent study [3] has reviewed the model of game engagement construct given by [2]. In this study, the author has discussed that three of the dimensions of game engagement questionnaire such as “flow, immersion and presence” [2] are interrelated to the subjective experience of videogame-play but absorption is similar to flow construct so, it is better not to consider in the measurement of game-engagement questionnaire. According to [3], a new revised construct of game-engagement comprises the following dimensions “flow, presence, involvement and immersion” that can be applied to examine the subjective experience of videogame play.
Doing a critical review of prior researches that have developed and used engagement scale in their studies. The current study has concluded with the following limitations; first, this study finds that mostly studies have only considered psychological constructs (flow, presence and absorption) and have ignored the importance of using behavioral dimensions to examine the subjective experience of videogame play as well as measure the player’ engagement in video games [1–3]. Secondly, these studies have not properly conceptualized and operationalized the term engagement and immersion in their studies.
Moreover, several studies have stated that engagement in videogame, is a multi-dimensional construct [4, 5]. Among these studies, only a study by [4] who really captured the meaning of engagement on a multi-dimensional level. But, the problem with the following study [4] is, authors have misspecified the construct of game immersion as reflective-reflective construct (A reflective measurement model is; when items share a common theme, items are exchangeable and deleting or adding an item does not change the conceptual meaning of the construct [6]) on first and second order construct. Rather, the construct of game immersion seems to be as reflective-formative construct that means reflective on first order and formative on second order construct (A formative measurement is; when items do not require to have a shared common theme, items are not replaceable and deleting and adding an item can change the conceptual meaning of the construct [6]). The decision behind calling a game immersion construct as reflective-formative was drawn on basis of reviewing the following study [6] that has discussed the important decision rules for specifying the construct as reflective or formative.
Therefore, the current study considers the limitations of past studies and takes an initiative to first conceptualize and operationalize the term engagement in videogames as “consumer video-game engagement” and develops a new scale with combination of psychological as well as behavioral dimensions in order to measure engagement in videogame-playing in more advanced level. Moreover, this study aims to validate a newly developed construct among the videogame consumers. The present study is first in videogame literature which considers both psychological and behavioral dimensions for measuring consumer video-game engagement. Secondly, this study considers the importance of both reflective and formative constructs in explaining and measuring the construct of consumer videogame engagement on higher order construct. Thirdly, this study applies the concept of marketing and consumer research, especially the definition of consumer engagement and its related dimensions (cognitive, affective and behavioral) that have been discussed in the following studies [7, 8] in order to conceptualize and operationalize the construct of consumer videogame engagement.
2 Conceptualization of Consumer Videogame Engagement
This study follows the definition of engagement given by [7, 8] as “Engagement is a multidimensional construct which is subject to a context-specific expression of relevant cognitive, emotional, and behavioral dimensions”. The author of the study [8], has further added that engagement is a process which reveals as a result of two-way communications between the engagement-subject (consumer/customer) and a particular engagement-object such as a product, service or a brand, which leads to generate consumer engagement states (cognitive, affective and behavioral). On the basis of above stated definition, this study conceptualizes consumer videogame engagement as “A psychological state that triggers due to two-way interactions between the consumer and videogame product, which generates different level of consumer engagement states (cognitive, affective and behavioral)”.
3 Scale Development and the Validation of Consumer Videogame Engagement
This study adopts the scale development procedure given by [9, 10]. This study first compiles the measurement scales as already reported in the literature which is specifically relevant to the following dimensions: conscious-attention, absorption (cognitive engagement), dedication, enthusiasm (affective engagement), social interaction and interaction (behavioral engagement). The items on the following dimensions such as conscious attention, six items (Items 1 to 6) from [11], item7 from [12] and item8 from [13] are adapted in this study. Absorption scale adapted from [14]. Whereas, dedication items as item1 from [15] and item2 to item7 from [16] and the items of enthusiasm are adapted from the study of [11]. However, social connection scale is adapted as item1 to item4 from [11] and remaining items 5,6 and 7 from [17]. Finally, interaction scale is adapted from [14]. Overall, the study has generated 39 items, which were further evaluated for the content validity by 4 PhD students and two experts to assess the content of consumer videogame engagement. Based on their comments, this study has revised certain items.
For first-time data collection, 200 questionnaires were distributed among university teenage students who play videogames aged 16-19, out of which 160 questionnaires were returned with a response rate of 80 %. Out of 160 questionnaires, 134 valid cases were left after treating the missing values and biased responses. The data were further analyzed for exploratory factor analysis (EFA) as well as for internal consistency and the results are shown in the Table 1. After finding the satisfactory results, this study continued to second-time data collection, 350 questionnaires were distributed and collected 290 responses with response rate of 83 %. After treating missing values and biased responses, we were left with 265 valid cases that were used for further analysis.
SEM-PLS (Structural equation modeling-partial least squares) was employed to validate the construct of consumer videogame engagement because, it has both reflective and formative constructs [18]. For reflective construct, this study involves the estimation of internal consistency, convergent validity and discriminant validity. Whereas, the evaluation of a formative construct follows different guidelines like testing of multicollinearity, indicator weights, and redundancy analysis.
Initially, a reflective measurement model was assessed for its convergent validity and achieved confirmatory factor loadings (CFA) greater than 0.70, composite reliability ranged from 0.89 to 0.92, while AVE were in between 0.61 to 0.75. All criteria of convergent validity were met. Discriminant validity was evaluated through newly introduced method called Heterotrait-Monotrait ratio (HTMT) of correlations [19] and found that all values have passed the critical value of HTMT .85 as in Table 2.
This study has assessed the three criteria for the evaluation of formative measurement model as suggested by [20]. The first criteria is to assess the convergent validity also termed as redundancy analysis. The results indicate that the path coefficient between consumer video-game engagement and global measure is 0.826, which is higher than the threshold value of 0.80 as recommended by [20] and thus, depicting that the formative constructs have achieved the convergent validity. Second, the study has checked the collinearity issues and found that there is no multicollinearity issue because, all values shown in the Table 3, are below the threshold value of 5 as suggested by [20]. Third, this study has assessed the significance of indicator weights as shown in the Table 3 and found that formative constructs are highly significant at 0.00 level.
4 Conclusion
This study first conceptualized operationalized the construct of consumer videogame engagement then developed a scale for measuring consumer video-game engagement. The scale was first validated through EFA and reliability test. Second, the data were recollected on more respondents for measuring CFA and reflective measurement model on first order. All results met the criteria for the assessment of reflective measurement model then second order were created on a formative level. Formative measurement model was assessed on basis of three criteria given by [20] and results met the criteria for the evaluation of a formative model.
References
Jennett, C., et al.: Measuring and defining the experience of immersion in games. Int. J. Hum Comput Stud. 66(9), 641–661 (2008)
Brockmyer, J.H., et al.: The development of the Game Engagement Questionnaire: a measure of engagement in video game-playing. J. Exp. Soc. Psychol. 45(4), 624–634 (2009)
Procci, K.C.: The Subjective Gameplay Experience: An Examination of the Revised Game Engagement Model (Ph.D. Diss). University of Central Florida Orlando, Florida (2015)
Cheng, M.T., She, H.C., Annetta, L.A.: Game immersion experience: its hierarchical structure and impact on game-based science learning. J. Comput. Assist. Learn. 31(3), 232–253 (2015)
Silpasuwanchai, C., et al.: Developing a comprehensive engagement framework of gamification for reflective learning. In: Proceedings of the 2016 ACM Conference on Designing Interactive Systems, pp. 459–472 (2016)
Jarvis, C.B., MacKenzie, S.B., Podsakoff, P.M.: A critical review of construct indicators and measurement model misspecification in marketing and consumer research. J. Consum. Res. 30(2), 199–218 (2003)
Brodie, R.J., et al.: Customer engagement: conceptual domain, fundamental propositions, and implications for research. J. Serv. Res. 14(3), 252–271 (2011)
Hollebeek, L.D.: Demystifying customer brand engagement: exploring the loyalty nexus. J. Mark. Manage. 27(7–8), 785–807 (2011)
Churchill Jr, G.A., A paradigm for developing better measures of marketing constructs. J. Market. Res. 16 64–73 (1979)
Tsaur, S.-H., Yen, C.-H., Yan, Y.-T.: Destination brand identity: scale development and validation. Asia Pacific J. Tourism Res. 21 1–14 (2016)
Vivek, S.D., et al.: A generalized multidimensional scale for measuring customer engagement. J. Market. Theory Pract. 22(4), 401–420 (2014)
Qin, H., Patrick Rau, P.-L., Salvendy, G.: Measuring player immersion in the computer game narrative. Intl. J. Hum. Comput. Interact. 25(2), 107–133 (2009)
Wiebe, E.N., et al.: Measuring engagement in video game-based environments: investigation of the user engagement scale. Comput. Hum. Behav. 32, 123–132 (2014)
So, K.K.F., King, C., Sparks, B.: Customer engagement with tourism brands scale development and validation. J. Hosp. Tourism Res. 38(3), 304–329 (2014)
Schaufeli, W.B., et al.: The measurement of engagement and burnout: A two sample confirmatory factor analytic approach. J. Happiness Stud. 3(1), 71–92 (2002)
Cheung, C.M., et al.: Promoting sales of online games through customer engagement. Electron. Commer. Res. Appl. 14(4), 241–250 (2015)
Kemp, E.: Engaging consumers in esthetic offerings: conceptualizing and developing a measure for arts engagement. Intl. J. Nonprofit Voluntary Sector Market. 20(2), 137–148 (2015)
Hair, J.F., Ringle, C.M., Sarstedt, M.: PLS-SEM: Indeed a silver bullet. J. Market. Theory Pract. 19(2), 139–152 (2011)
Henseler, J., Ringle, C.M., Sarstedt, M.: A new criterion for assessing discriminant validity in variance-based structural equation modeling. J. Acad. Mark. Sci. 43(1), 115–135 (2015)
Hair Jr., J.F., et al.: A primer on partial least squares structural equation modeling (PLS-SEM). Sage Publications (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 IFIP International Federation for Information Processing
About this paper
Cite this paper
Abbasi, A.Z., Ting, D.H., Hlavacs, H. (2016). A Revisit of the Measurements on Engagement in Videogames: A New Scale Development. In: Wallner, G., Kriglstein, S., Hlavacs, H., Malaka, R., Lugmayr, A., Yang, HS. (eds) Entertainment Computing - ICEC 2016. ICEC 2016. Lecture Notes in Computer Science(), vol 9926. Springer, Cham. https://doi.org/10.1007/978-3-319-46100-7_25
Download citation
DOI: https://doi.org/10.1007/978-3-319-46100-7_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-46099-4
Online ISBN: 978-3-319-46100-7
eBook Packages: Computer ScienceComputer Science (R0)