Software Quality Requirement Analysis on Educational Game

Software Quality Requirement Analysis on Educational Mobile Game with Tourism Theme

Anggy Trisnadoli^1*, Istianah Muslim², Wenda Novayani³

^1,2,3Computer Department, Politeknik Caltex Riau, Pekanbaru, Indonesia.

*Tel.: +62 852 6581 5640 ; email: [email protected]

Manuscript submitted March 10, 2016; accepted April 1, 2016.

doi:

Abstract: Mobile game is one type of game that runs on mobile devices such as smartphones and tablet PCs. In previous research, we have proposed quality model for mobile game which is a quality model that was built to measure quality from mobile games. This model was built from quality requirements that were analyzed for mobile games. Educational mobile game is education game genre with mobile based that aimed to learning, then the quality requirements maybe will different compared to other games. This research was conducted by analyzing the mobile game’s quality requirements that specific for educational games genre in order to generate new quality requirements that are specific to the mobile educational game. The case studies that become an evaluation of current research are the tourism of Riau province, Indonesia. So the mobile educational game that will design later is a mobile educational game that contains about tourism in Riau province. To get a list of criteria for this case, then we conducted a survey of several users, and also formed a group discussion forum along with a tourism ambassador of Riau province, so that the quality requirements will be more reliable. So the proposed quality requirements may become a reference to build a game product that has a good quality based on the user’s perspective.

Keywords: Software quality, games, mobile games, educational mobile games, tourism, Riau province.

Game is a system composed of artificial rules that involve players with the aim to entertain [1] [2]. Game contains scenarios that composed of a collection of audio and visual interest that allows users to enjoy game play that has been given by the game. By the unique characteristics game compared to other software, then, there are many things that do more specific, special for the games. Quality model for mobile game is one of the quality models that were built to measure the quality of the mobile games [3]. This model was built based play ability quality models built by Sánchez et al [4] and adapted to the quality requirements for mobile games [3]. In its application this quality model used to measure the quality of a user’s perspective, so that measurements can be made after the game finished mobile products developed.

In designing an educational game, it must be guided by a good reference. Quality assurance can be done starting of the development stage, the design stage. Quality models for the mobile game offers a collection of properties that indicate the needs of a mobile game quality, so that the quality requirements can be used as a reference in building a good mobile game. However, that offered quality requirement is built for the mobile game in general, while the mobile educational game is a genre the mobile game with educational or learning, so that the quality requirements could have a few differences. Based on these problems, so, in this research we performed an analysis of the mobile game’s quality requirements that are specific to the educational games genre, to be able to produce a game product that has fit quality of the quality requirements based on the user’s perspective.

As for the issues that will be studied in this paper are does requirements for a quality mobile game can be used as a reference in the design stage of development the mobile educational games. And how far the relationship of quality requirements for mobile game required to Mobile Educational Games with Tourism content of the user’s perspective to be able produce a good quality product.

2.1. Quality Requirement for Mobile Game

In 2015, research on the quality model for mobile games has been conducted by Trisnadoli, Hendradjaya and Sunindyo [2] entitled ‘A Proposal Quality Model for Mobile Games’. Quality Model for Mobile Game was formed based on the software quality requirements that has been compiled based on the criteria and ideas from several researches on mobile games [3]. The proposed model has quality factors as shown on Fig. 1.

Fig. 1. Quality Model for Mobile Games [2]

Factors and sub factors for the quality of the quality model for mobile games that have been proposed are Usability In Use with sub factors Effectiveness In Use, Efficiency In Use, Satisfaction. Then Flexibility In Use with sub factor Accessibility. And Safety with subfactor User Health & Safety

Table 1. Quality Requirements for Mobile Games [3]

No	Quality Requirements for Mobile Games
1	Game gives a clear goal and a player can achieve goal
2	Players do not find any error in the game
3	Game can be played in a short time
4	Game easy to understand by players
5	Game has a manual (help feature)
6	Control of the game has been consistently in according with the standards
7	Games provide an appropriate response to the action of Players
8	Challenges, strategies and the steps of the game are already balanced
9	Screen layout is comfortable to be seen
10	Audio of the game was comfortable and supportive with a good game
11	Mobile devices and game interface are already suitable and appropriate
12	The experience of playing is Fun
13	Players get the appropriate reward
14	Storyline or scenario of the game is interesting
15	Players can express themselves
16	No repetition that make the game boring
17	Game control is appropriate and flexible
18	Game can accommodate the surrounding environment
19	Game supports multiple ways to play
20	Players are not affected on safety and health issues

Mobile game is defined as a game played on a mobile platform-based devices are expected to increase the entertainment on the user’s mobile device. Mobile devices that can be applied to mobile game such as Smartphones, PDAs, Tablet PCs and Portable Game Console. Mobile game is highly dependent on the device that became his home [5]. Based on the characteristics of mobile games and mobile applications presented by several researchers [6]-[11] then performed an analysis of the characteristics and then were extracted to produce set of quality requirements are been the foundation of building a quality requirement that will be used. After conducting an analysis of data that has been collected, so, the conclusion of proposed quality requirements for mobile game can be seen in Table I.

2.2. Educational Game Genre Characteristics

According to Sugihartono [12], educating means the process of changing the attitudes and behavior of a person or group with a mature effort with teaching and training efforts. Education can be obtained for both formal and informal. Formal education was obtained from a structured learning that has been designed by an institution. While the non-formal education is the knowledge gained humans in everyday life either experienced or learned from others. One way to learn with non-formal system is by educational game.

Educational games are games that are designed or created to stimulate thought include improving concentration and problem-solving [13]. YM Harahap on [14] concluded that the educational game is one of the games that can be useful to support the teaching and learning process with more fun and more creative, and usable to provide teaching or increase user knowledge by an exciting media. According to Hurd and Jennings [15] declared that educational game is game that is specifically designed to teach user a certain learning, concept development and understanding and guide them in their ability to train and motivate them to play. Factors that are considered necessary in developing educational game are usability, accuracy, appropriateness, Relevance, Objectiveness, Feedback, Engagement, Motivation, and Gaming Literacy.

Dondlinger [16], said that a number of distinct design elements on educational games are narrative context, rules, goals, rewards, multisensory cues, and interactivity seem necessary to stimulate desired learning outcomes. And a few other things about the characteristics of the educational game are Challenging, Fun, and Excitement not patronizing and based on experience, interactive, expertise, reflection.

Determination of the quality requirements of mobile educational games, we perform an analysis based on various sources of quality requirements, such as the quality requirements that have been offered by previous researchers then combine from survey results that conducted on some respondents, while also using the functional requirements of mobile educational game stakeholders for tourism in Riau province. So that, the proposed quality requirements can become a reference in developing mobile educational game with good quality.

3.1. Quality Requirements for Mobile Educational Game based on User’s Perspective

In determining the quality requirements of mobile games from the user’s perspective, data collection or surveys conducted to several respondents randomly. Respondents, who being questioned are derived from various professions, age, sex, and excitement in playing the games. The stuff to consider in conducting a survey on software quality requirements analysis for mobile games are The comfort of audio and visual, Interest on the storyline, Satisfaction in playing, the comfort using control game, Screen size of mobile devices, Addictive (the desire to repeat the game).

Survey of users was conducted in the form of an interview. Selection of respondents by random sampling method is applied to 130 people with different backgrounds, but still has an interest in using games on mobile devices.

The interview results are then analyzed and processed by concluding and verification of data obtained. Table II is the result of the conclusions of the quality requirements of mobile games based on the user’s perspective.

Table 2. Survey Result on Requirements from User’s Perspective

No	Indicator	Requirements
1	The comfort of audio and visual	Mobile game should be good appearance
The layout that is used comfortably viewed
Color usage harmonious and good
2.	Game Controller	The buttons position is appropriate
The controller usage is simple
3	Storyline	Game characters are Interesting
Scenario of the games are not boring
The desire to repeat the game again and again

Based on data that shown in Table II, and after calculation of the number of respondents who give a positive statement on the list of requirements, so the number was created in the percentage as shown in Fig. 2.

Fig. 2. Survei result on requirements from user’s perspective by percentage

3.2. The results of the Forum Group Discussion for Riau Province Tourism Case Study

Forum Group Discussion (FGD) was conducted to get a conclusion for the criteria that are required to build a mobile educational game with a case study of tourism on Riau province. This activity was attended by 35 participants that were an ambassador for tourism in Riau province. Discussions were held during few hours, then, closed with some results which can be seen in Table III.

Table 3. FGD Result to Mobile Educational Game Criteria

No	Indicators	Criterias
1	Interface	Attractive appearance (eye catchy)
2		The color usage is comfortably viewed
3	Audio	comfortable to hear
4	Storyline	Interesting storyline or game play
5		Not boring
6		Addiction (wanted to play again-and again)
7	Education Contents	Simple but meaningful
Growing a curiosity

From the discussion we get conclude that the most important content in game tourism theme are Arts, Tourist Attraction and Folklore. Arts with Traditional Dance, Songs and Musical Instrument. Tourist Attraction with Nature and Historical Heritage. Folklore with Legend and Fairy Tales. Table III shows the various technical criteria to be considered in the development of an interesting mobile educational game. In order to build a mobile educational game on tourism sector, there are several things to consider such as the content, simple but meaningful and interesting, and don’t forget to contain about Malay art and culture, because it is a hallmark from Riau Province. As for the interface of this educational game, the things to consider are the attractive appearance, the use of color that comfortable to look at and pleasant sound to be heard.

After discovering the things that become important considerations in the requirement of mobile games, educational games, also the requirement for mobile game with tourism content, then formed a new calculation to show the overlapping and interrelated requirements to be good quality requirements as a reference in designing a mobile-based game with education genre and tourism case study in Riau province. The results of the analysis are shown in Table IV.

Table 4. Mapping of Quality Requirements for Mobile Educational Games with Tourism Theme

Requirements	Quality Requirements for Mobile Games [3]	Previous Research on Educational Game	Survey Result from User’s Perspective	FGD Result on Educational Game on Tourism
Game provides a clear goals	√	√	√
Game is easy to understand	√	√	√	√
Game can be played in a short time	√	√
Game have complete features	√	√
Control of the game has been consistently in according with the standards	√	√	√
Screen layout is comfortable to be seen	√	√	√	√
Audio of the game was comfortable and supportive with a good game	√	√	√	√
The mobile device screen is appropriate to the game	√	√
The experience of playing is Fun	√	√	√	√
Storyline or scenario of the game is interesting	√	√	√	√
No repetition that make the game boring	√	√	√	√
Game control is appropriate and flexible	√	√
Players gain knowledge from the game	√	√
Game is simple but meaningful	√	√
Content on tourism must be update	√
Language usage appropriate to target of player	√	√	√
Having educate messages behind the entertainment given	√	√

Based on that Table IV, indicated that some requirements are actually owned by all sources are used, but there are some requirements that are not discussed on several sources. Especially the contents of tourism that it only required if the specific case study towards the tourism sector, would be an important thing for the preparation of quality requirements.

Based on all the stages that have been done before, and then we analyze it to propose a new quality requirement. Proposed quality requirements for mobile educational game that specific to tourism case study are show on Table V. It contains the proposed quality requirements for mobile educational game with a case study of tourism. So in designing and developing mobile educational game later, these quality requirements can become one of factor to be good quality software. Because of the good quality software is start from the design stage, not only during the implementation or development, even when they are published to the user.

Table 5. Proposed Quality Requirements for Mobile Educational Games with Tourism Case Study

No.	Quality Requirements
1	Game provides a clear goals
2	Game is easy to understand
3	Game can be played in a short time
4	Game have complete features
5	Control of the game has been consistently in according with the standards
6	Screen layout is comfortable to be seen
7	Audio of the game was comfortable and supportive with a good game
8	The mobile device screen is appropriate to the game
9	The experience of playing is Fun
10	Storyline or scenario of the game is interesting
11	No repetition that make the game boring
12	Game control is appropriate and flexible
13	Players gain knowledge from the game
14	Game is simple but meaningful
15	Content on tourism must be update
16	Language usage appropriate to target of player
17	Having educate messages behind the entertainment given

Based on the analysis and evaluation, the conclusions of this research are software quality requirements especially in the game are heavily dependent on type and case studies that will be develop. Software quality requirements can be composed of any various kinds of input, not only from the existing criteria, but also can be collected based on user feedback and the specific requirements of stakeholders that will use the software. Quality requirements for mobile educational game on tourism case studies has been built specifically based on the criteria that collected to build a good quality software. The proposed quality requirements can become a reference in building software educational game design since the beginning, so the quality of mobile educational games already maintained earlier.

For future research, the proposed quality requirements should be performed a validation testing on the feasibility, so that it can be more confirmed as good quality requirements. And the proposed quality requirement can be a reference to build a quality model with specific quality factors and complete metrics to evaluate the mobile educational game software, so it can measure how much the quality value of a mobile educational game in tourism theme.

Acknowledgment

We would like to thank to Politeknik Caltex Riau to Support this research, also to Riau Province and Pekanbaru City’s Tourism Ambassadors “Bujang-Dara” to help us with very generous discussion and feedback.

References

1. Clearwater, D. A. (2011). What defines video game genre? Thinking about genre study after the great divide. The Journal of the Canadian Game Studies Association, 5(8).
2. Trisnadoli, A., Hendradjaya, B., & Danar, S. W. (2015). A proposal of quality model for mobile games. In ICEEI 2015 International Conference. IEEE.
3. Trisnadoli, A. (2015). Software quality requirement analysist on mobile game based software (Analisis kebutuhan kualitas perangkat lunak pada software game berbasis mobile). Journal of Applied Computer (Jurnal Komputer Terapan), 1 (2).
4. Sánchez, J. G., Simarro, F. M., Zea, N. P., & Vela, F. G. (2009). Playability as extension of quality in use in video games. Proceedings of 2nd International Workshop on the Interplay between Usability Evaluation and Software Development (I-USED).
5. Ponnada, A., & Kannan, A. (2012). Evaluation of mobile games using playability heuristics. Proceedings of the International Conference on Advances in Computing, Communications and Informatics (pp. 244-247). ACM.
6. Hussain, A., & Kutar, M. (2008). Usability metric framework for mobile phone application. In Conference Information Integration and Web-based Applications & Services. ACM.
7. Jeong, E. J., & Kim., J. (2009). Definitions, key characteristics, and generations of mobile games. Mobile Computing: Concepts, Methodologies, Tools, and Applications. Monash University
8. Korhonen, H., & Koivisto, E. (2006). Playability heuristic for mobile game. Proceedings of the 8th conference on Human-computer interaction with mobile devices and services. ACM.
9. Nantes, A., Brown, R., & Maire, F. (2008). A framework for the semi-automatic testing of video games. In AIIDE.
10. Nayebi, F., Desharnais, J. M., & Abran, A. (2012). The state of the art of mobile application usability evaluation. Proceedings of 25^th IEEE Canadian Conference on Electrical and Computer Engineering (pp. 1-4).IEEE.
11. Salmre, I. (2005). Writing mobile code: Essential software engineering for building mobile applications. Addison-Wesley Professional.
12. Sugihartono, Fathiyah, K. N., Setiawati, F. A., Harahap, F., & Nurhayati, S. R. (2007). Psychology of Education (Psikologi Pendidikan). UNY Press.
13. Handriyantini, E. (2009). Computer Based Educational games for Elementary Student (Permainan edukatif berbasis komputer untuk siswa sekolah dasar). Malang: Journal of STIKOM Indonesia (Jurnal STIKOM Indonesia).
14. Harahap, Y. M. (2015). Design of Educational Game as a Learning Media for Preschool Children with Adobe Flash CS 5. SP (Perancangan Game Edukatif Sebagai Media Pembelajaran Pada Anak Usia Dini Dengan Adobe Flash CS 5. SP) – Mathematics, USU.
15. Hurd, D., & Jennings, E. (2009). Standardized Educational Games Ratings: Suggested Criteria. Scientific Paper.
16. Dondlinger, M. J. (2007). Educational video game design: A review of the literature. Journal of applied educational technology, 4(1), 21-31.

Authors biographies

Anggy Trisnadoli obtained his B.Sc. degree in Informatics Engineering from Politeknik Caltex Riau in 2011, a M.Sc. also in Informatics Magister from Bandung Institute of Technology in 2015. He has worked as a lecturer in Politeknik Caltex Riau from 2012. Currently, he is lecturing in Information System, Computer Department of Politeknik Caltex Riau, Indonesia. His research interests are in games, mobile application, 3D Animation and Multimedia Software. His email address is [email protected]

Istianah Muslim is a lecturer in Information System Department in Politeknik Caltex Riau. She received her Master of Industrial Engineering from Institute of Technology Sepuluh Nopember in 2013. Her research interests are in the area of human factor, ergonomic, safety and health, supply chain management, production planning and Design Product. Her email address is [email protected]

Wenda Novayani is a lecturer in Computer Engginering Department in Politeknik Caltex Riau. She received her diploma degree in Computer Engginering from Politeknik Caltex Riau in 2006 and B.Sc degree in Electrical Engginering from Intitute Teknologi Bandung in 2013.