Semantic Similarity-Based Mobile Application Isomorphic Graphical User Interface Identification

Jing Cheng, Jiayi Zhao, Weidong Xu, Tao Zhang (), Feng Xue and Shaoying Liu
Additional contact information
Jing Cheng: School of Computer Science and Engineering, Xi’an Technological University, Xi’an 710064, China
Jiayi Zhao: School of Computer Science and Engineering, Xi’an Technological University, Xi’an 710064, China
Weidong Xu: School of Computer Science and Engineering, Xi’an Technological University, Xi’an 710064, China
Tao Zhang: School of Software, Northwestern Polytechnical University, Xi’an 710060, China
Feng Xue: School of Software, Northwestern Polytechnical University, Xi’an 710060, China
Shaoying Liu: School of Informatics and Data Science, Hiroshima University, Hiroshima 739-8525, Japan

Mathematics, 2023, vol. 11, issue 3, 1-17

Abstract: Applying robots to mobile application testing is an emerging approach to automated black-box testing. The key to supporting automated robot testing is the efficient modeling of GUI elements. Since the application under testing often contains a large number of similar GUIs, the GUI model obtained often contains many redundant nodes. This causes the state space explosion of GUI models which has a serious effect on the efficiency of GUI testing. Hence, how to accurately identify isomorphic GUIs and construct quasi-concise GUI models are key challenges faced today. We thus propose a semantic similarity-based approach to identifying isomorphic GUIs for mobile applications. Using this approach, the information of GUI elements is first identified by deep learning network models, then, the GUI structure model feature vector and the semantic model feature vector are extracted and finally merged to generate a GUI embedding vector with semantic information. Finally, the isomorphic GUIs are identified by cosine similarity. Then, three experiments are conducted to verify the generalizability and effectiveness of the method. The experiments demonstrate that the proposed method can accurately identify isomorphic GUIs and shows high compatibility in terms of cross-platform and cross-device applications.

Keywords: isomorphic GUI; semantic similarity; mobile application testing (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/3/527/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/3/527/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:3:p:527-:d:1040237

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().