A Quality Assessment Methodology for Sign Language Mobile Apps Using Fusion Of Enhanced Weighted Mobile App Rating Scale (MARS) and Content Expert Standardized Criteria
Main Article Content
Abstract
Mobile sign language apps have drawn a lot of interest recently as a way to minimize communication barriers between hearing people and people with hearing impairments. However, there are issues with the criteria and standards that should be taken into account when developing these apps. This study proposes a set of development criteria for sign language mobile apps and standardizes these criteria using the Fuzzy Delphi approach. Furthermore, the Fuzzy-Weighted Zero Inconsistency (FWZIC) approach is utilized to assign weights to the criteria and establish a ranking order. An initial set of requirements is developed based on the literature review. The Fuzzy Delphi technique is used, involving a panel of experts made up of developers, sign language experts, and users of sign language mobile apps, to assess the validity and reliability of the criteria. The FWZIC technique is used to give the criterion weights and determine their ranking order in order to further improve the decision-making process. The relative relevance of each criterion is determined by the FWZIC technique, which involves expert input and makes use of their knowledge and expertise. A thorough ranking is generated by taking into account the effects of each criterion on several zones, assisting in efficient decision-making during the creation of sign language mobile apps. Six Malaysian Sign Language apps that have been shortlisted are being utilized as a proof of concept to test the idea. The result of 6 apps is obtained based on the final standard criteria, their weights, and rankings.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
D. Bragg et al., Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective. 2019, pp. 16-31.
J. K. a. B. Klímová, "Use of Smartphone Applications in English Language Learning—A Challenge for Foreign Language Education," education sciences, 2019, doi: 10.3390/educsci9030179.
G. Abou Haidar, R. Achkar, D. Salhab, A. Sayah, and F. Jobran, "Sign language translator using the back propagation algorithm of an M.L.P.," in 2019 7th International Conference on Future Internet of Things and Cloud Workshops (FiCloudW), 2019: IEEE, pp. 31-35.
H. Haron, H. Samad, F. Md Diah, and H. Yusof, "E-LEARNING APPROACH USING MOBILE APPS: MALAYSIAN SIGN LANGUAGE FOR DUMB AND DEAF," no. 1, pp. 1-7%V 1, 2019-06-23 2019. [Online]. Available: https://myjms.mohe.gov.my/index.php/ijarti/article/view/5991%J International Journal of Advanced Research in Technology and Innovation.
R. L. Romero et al., "Modifying the Mobile App Rating Scale With a Content Expert: Evaluation Study of Deaf and Hard-of-Hearing Apps," vol. 7, no. 10, 2019.
M. G. Vintimilla, D. Alulema, D. Morocho, M. Proano, F. Encalada, and E. Granizo, "Development and implementation of an application that translates the alphabet and the numbers from 1 to 10 from sign language to text to help hearing impaired by Android mobile devices," in 2016 IEEE International Conference on Automatica (ICA-ACCA), 2016: IEEE, pp. 1-5.
F. K. Ryan Lee Romero, Mark Hart, Amanda Ojeda, Itai Meirom, Stephen Hardy., "Modifying the Mobile App Rating Scale With a Content Expert: Evaluation Study of Deaf and Hard-of-Hearing Apps," JMIR Mhealth Uhealth 2019, vol. 7, 2019, doi: 10.2196/14198.
K. A. Dawood, K. Y. Sharif, A. A. Ghani, H. Zulzalil, A. A. Zaidan, and B. B. Zaidan, "Towards a unified criteria model for usability evaluation in the context of open source software based on a fuzzy Delphi method," Information and Software Technology, vol. 130, p. 106453, 2021/02/01/ 2021, doi: https://doi.org/10.1016/j.infsof.2020.106453.
A. A. Alsalem MA, Albahri OS, Dawood KA, Mohammed RT, Alnoor A, Zaidan AA, Albahri AS, Zaidan BB, Jumaah FM, Al-Obaidi JR., "Multi-criteria decision-making for coronavirus disease 2019 applications: a theoretical analysis review.," Artificial Intelligence Review, vol. 1, p. 84 2022, doi: 10.1007/s10462-021-10124-x
H. I. Rahmat Dapari, Rosnah Ismail, Noor Hassim Ismail, "Application of Fuzzy Delphi in the Selection of COPD Risk Factors among Steel Industry Workers," National Research Institute of Tuberculosis and Lung Disease, vol. 16, pp. 46-52, August 25th 2016 2017.
A. F. H. Mohamed Yusoff, Azmil & Muhamad, Norhisham & Wan Hamat, Wan., "Application of Fuzzy Delphi Technique Towards Designing and Developing the Elements for the e-PBM PI-Poli Module (Aplikasi Teknik Fuzzy Delphi Terhadap Elemen-Elemen Reka Bentuk Dan Pembangunan Modul e-PBM PI-Poli)," Asian Journal of University Education, vol. 17, pp. 292-304, 2021, doi: 10.24191/ajue.v17i1.12625. .
F. Smarandache, J. E. Ricardo, E. G. Caballero, M. Y. L. Vázquez, and N. B. J. I. S. Hernández, "Delphi method for evaluating scientific research proposals in a neutrosophic environment," vol. 34, pp. 204-213, 2020.
P.-L. Chang, C.-W. Hsu, and P.-C. Chang, "Fuzzy Delphi method for evaluating hydrogen production technologies," International Journal of Hydrogen Energy, vol. 36, no. 21, pp. 14172-14179, 2011.
C.-H. Cheng and Y. Lin, "Evaluating the best main battle tank using fuzzy decision theory with linguistic criteria evaluation," European journal of operational research, vol. 142, no. 1, pp. 174-186, 2002.
S. Bodjanova, "Median alpha-levels of a fuzzy number," Fuzzy Sets and Systems, vol. 157, no. 7, pp. 879-891, 2006.
H.-C. Chu and G.-J. Hwang, "A Delphi-based approach to developing expert systems with the cooperation of multiple experts," Expert systems with applications, vol. 34, no. 4, pp. 2826-2840, 2008.