Abstract :

Usability is one of the most important software quality attributes in determining user satisfaction, productivity and system acceptance. Afghanistan is a multilingual country, and usability problems with localized software applications may occur due to linguistic diversity, cultural differences, and scarce resources for evaluating the usability of software applications. These traditional usability assessment techniques, such as heuristic evaluation and laboratory testing, are difficult to implement in a capacity-constrained environment, as they require significant time, expertise and funds. The study suggests an automatic usability evaluation framework by machine learning techniques for localized software systems in Afghanistan. Data were gathered from ISO 9241-11 usability framework-based structured questionnaires from users of localized software applications. After collecting the responses, they were subjected to a pre-processing procedure involving cleaning, encoding and normalizing. Three supervised machine learning algorithms Decision Tree (DT), K-Nearest Neighbors (KNN) and Support Vector Machine (SVM) were trained and tested with 80:20 ratio of training and test data. Model performance was evaluated using the accuracy, precision, recall, F1-score and confusion matrix analysis. Experimental results indicate that the highest accuracy of 91.4% is obtained by DT followed by SVM with 90.0% accuracy and KNN with 88.7%. The results show that the Decision Tree is a good model for balancing the prediction accuracy and interpretation of local software environments. The proposed framework has been designed to be both scalable and cost-effective, and can be used to complement existing usability evaluation methods, and can also be used to aid in software quality improvement efforts in multilingual and developing country settings.

---

Keywords :

Afghanistan, Decision Tree, Human-Computer Interaction, k-nearest neighbors, localized software, Machine learning, Support Vector Machine, usability evaluation

---

References :

1. International Organization for Standardization (ISO), “ISO 9241-11: Ergonomics of Human-System Interaction Part 11: Usability: Definitions and Concepts,” Geneva, Switzerland, 2018.
2. Oztekin, D. Nikov, and D. Zaim, “UWIS: An Assessment Methodology for Usability of Web-Based Information Systems,” Journal of Systems and Software, vol. 86, no. 8, pp. 2039–2052, 2013.
3. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed. New York, NY, USA: Springer, 2009.
4. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.
5. P. Murphy, Machine Learning: A Probabilistic Perspective. Cambridge, MA, USA: MIT Press, 2012.
6. Géron, Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow, 3rd ed. Sebastopol, CA, USA: O’Reilly Media, 2022.
7. Raschka and V. Mirjalili, Python Machine Learning, 3rd ed. Birmingham, U.K.: Packt Publishing, 2019.
8. Han, M. Kamber, and J. Pei, Data Mining: Concepts and Techniques, 4th ed. Burlington, MA, USA: Morgan Kaufmann, 2022.
9. Breiman, J. Friedman, R. Olshen, and C. Stone, Classification and Regression Trees. Belmont, CA, USA: Wadsworth International Group, 1984.
10. Cover and P. Hart, “Nearest Neighbor Pattern Classification,” IEEE Transactions on Information Theory, vol. 13, no. 1, pp. 21–27, 1967.
11. Cortes and V. Vapnik, “Support-Vector Networks,” Machine Learning, vol. 20, no. 3, pp. 273–297, 1995.
12. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge University Press, 2000.
13. H. Witten, E. Frank, M. Hall, and C. Pal, Data Mining: Practical Machine Learning Tools and Techniques, 4th ed. Burlington, MA, USA: Morgan Kaufmann, 2017.
14. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 4th ed. Hoboken, NJ, USA: Pearson, 2021.
15. Liu, “Artificial Intelligence Applications in Usability Evaluation: A Systematic Review,” International Journal of Human–Computer Interaction, vol. 41, no. 2, pp. 145–162, 2025.
16. Rahman and S. Ahmed, “Machine Learning-Based Usability Prediction for Web Applications Using Decision Tree Classification,” Journal of Software Engineering Research and Development, vol. 11, no. 3, pp. 88–101, 2023.
17. Basri, N. Abdullah, and M. Hassan, “Comparative Analysis of Machine Learning Algorithms for Usability Sentiment Classification,” International Journal of Advanced Computer Science and Applications, vol. 15, no. 4, pp. 321–330, 2024.
18. Shah, F. Khan, and M. Tariq, “Automated Software Usability Assessment Using Supervised Machine Learning Techniques,” IEEE Access, vol. 10, pp. 102345–102357, 2022.
19. Asghar, S. Ullah, and R. Ahmad, “Intelligent Mobile Learning Usability Prediction Using Support Vector Machine and Genetic Algorithm,” Computers & Education: Artificial Intelligence, vol. 3, pp. 100071, 2022.
20. Sommerville, Software Engineering, 10th ed. Boston, MA, USA: Pearson, 2016.