Ontology mapping and semantics of web interface signs
© The Author(s) 2016
Received: 28 April 2016
Accepted: 3 September 2016
Published: 8 September 2016
Although, intuitive interface signs are crucial elements of a good user interface (UI), prior research ignored these in UI design and usability evaluation process. This paper argues that ontology (the set of concepts and skills for understanding the referential meaning of an interface sign) mapping is critical for intuitive sign design. An experiment with fourteen participants and twelve signs (total 168 cases) has been carried out. The data has been analysed using both qualitative and quantitative approaches. The findings suggest that ontology mapping is important for understanding the semantics of interface signs. The paper concludes with design implications and future research plan.
KeywordsInterface sign Ontology User interface design Web usability Human–computer interaction Computer semiotics
In this paper, we focus on the small elements of user interfaces that are defined as interface signs. For example (see Fig. 1), the small element ‘Contact’ at homepage of Military Institute of Science and Technology (MIST) refers to a unique meaning or functional message (i.e. shows the contact details of head of the departments, deans of the faculties, and other administration personnel) to users; thus ‘Contact’ can be considered as an interface sign. An interface sign can be a single sign like ‘Contact’, ‘Clubs’, ‘Home’, and ‘Facebook icon’. It can also take a form consisting texts and icon/symbols like ‘Important Notice with the icon’, ‘Academic with the icon’, etc.
The interface signs act as communication artefacts in web UI to convey information about web content and system functionality. End-users interact with user interfaces through interface signs, which make them crucial elements of web user interfaces. Users need to understand the meaning of the sign in question immediately. Therefore, designers should design interface signs to be intuitive for end-users, so that end-users can understand the referential meaning of interface signs accurately and perform their desired tasks properly. The user-intuitive interface sign is an interface sign that makes it easy and intuitive for end users to accurately understand its referential meaning . According to Islam and Bouwman , a user intuitive interface sign needs to be transparent and reflect the actual content if it is to meet the expectations of users, allowing them to go directly to the content that is essential to them.
Additionally, interaction between users and web interfaces is mediated via interface signs since the content and functions of web systems are directed primarily through interface signs. Thus, at low level, users interpret the interface signs of user interfaces to understand the system’s logic and to perform tasks . It is thus important to design user-intuitive interface signs so that users can interpret the meaning (semantic) of the interface signs easily and accurately. Understanding the meaning of an interface sign properly allows users go directly to the content of interest. Taken together, user-intuitive interface signs are critical for improving both ease of use and usefulness of a web application.
In information systems (IS) research, there has been an absence of research into the core design attributes that likely influence constructs like usefulness  and satisfaction . This is surprising especially in light of the calls that such IT design attributes should be a focal area for IS research [7–9]. Consequently, our research focuses on a website’s core design attributes (i.e. the interface signs).
Indeed, prior research suggests designing user-intuitive interface signs and evaluating the intuitiveness of interface signs as essential in UI design and usability evaluation process. For example, Bolchini et al.  suggested interface sign as one of the major dimensions of web UI design and usability evaluation. A study by Islam and Tétard  shows that, if the interface signs are not intuitive, end-users spend a long time for finding the most suitable sign to obtain the information they are looking for. This leads to increased interaction variation, which may create usability problems and affect usefulness. However, very few studies explicitly focused on interface signs in UI design and evaluation [12–14].
A number of prior studies, conducted on interface signs focused on the importance of sign ontology [12, 13]. The term ontology is defined as the set of concepts and skills for understanding the referential meaning of an interface sign . From the users’ perspective, ontology refers to the knowledge or concepts that users use to understand and interpret the meaning of an interface sign. From the designers’ perspective, ontology refers to the knowledge or concepts presupposed and referred to by an interface sign. We argue that the ontologies used by the users through which they interpret a sign may differ from the ontologies used by the designers when they design the system. For example, an interface sign Spam in an email application may be well designed in terms of colour, layout, position, etc. but will not make any sense to the users who do not know what the concept of Spam refers to. Another example, an interface sign Member in a museum website is designed for providing subscription-functionalities with the museum website to receive updates via email. It may happen that a user interprets the meaning of this Member sign as to be a member of the real-world museum to get some benefits while visiting the museum. Here, the ontology pointed by the interface sign (from designers perspective) is not matched with the ontology used by the users to interpret the meaning of this sign. Thus, the user interpretation to grasp the meaning of this sign will not be accurate.
In this paper, we show that if the users’ ontology (presupposed knowledge) is matched with the ontology referred to by an interface sign, the users understand the semantic (meaning) of an interface sign easily and accurately. This in turn sheds further light on why ontology mapping is important in relation to UI design and evaluation.
This paper is organized as follows. Previous works related to this study are discussed briefly in “Related work” section. In “Research model” section, the research model is presented. The study design is discussed in “Study design” section; that includes discussion on test participants and data collection procedure, data coding, the qualitative and quantitative analysis with the results. The discussion, implications and ideas for future work are presented in the final section.
This section provides a brief overview of previous related research on interface sign design and evaluation and then the related literature on ontology in relation to interface signs in UI design and evaluation.
A number of studies have been conducted for interface sign design and evaluation during the last decades. Previous studies on interface sign mainly strive to investigate which type of sign (icon, text-based, icon with text) works better to improve the ease-of-use of a software system. For example, according to Norman only icons are least well; icon with text signs works best, and only text sign works better than only icons (see ). Some other studies found that only text as well as only icon is not sufficient to design better web interfaces, while icons are generally complemented by a text label to provide hint to its referential or indexical meaning [17, 18]. Therefore, earlier research did not provide any definite suggestion to choose a specific type of sign for a specific context, e.g. some researcher suggested icon is better and some suggested icon with text label is better.
Some other studies have found several underlying factors that impact the recognition or understanding rate of interface sign. These include past experience , graphical representation [20–22], culture [23–25], metaphor [23, 25], cognitive features [25–27], and age [20, 21, 23]. However, a complete list of factors is still missing to design the understandable interface signs to improve the overall system usability.
Therefore, ‘ontology’, one of the key factors of interface sign design, is introduced in HCI to make them more intuitive for end users. Speroni  introduced the concept of ontology for information intensive websites. According to him, the most common ontologies used in information intensive websites are: InterLocutor/Institution Ontology (knowledge related to the owner of the website), Commonsense Ontology (knowledge belonging to the user’s background, and referring to common and everyday terms), Internet Ontology (knowledge related to the internet use), Web Domain Ontology (knowledge related to a specific web domain), Website Ontology (knowledge related to a particular website), and Topic Ontology (knowledge related to a specific topic or subject of a website), and Context Ontology (knowledge related to a specific context of interface sign). In another study, Speroni et al.  showed how the proposed ontologies could be used for evaluating the information intensive website using the expert inspection technique.
Summary of prior research
Introduced the concept of ontology and propose seven ontologies for information intensive websites
Speroni et al. 
Conducted an expert inspection based on Speroni’s  set of ontologies in order to evaluate the web interfaces
Bolchini et al. 
Proposed a few heuristics to design and evaluate web interface signs grounded on Speroni’s  ontology
Islam et al. 
Analysed the interface signs to explore users’ perceived difficulty in interpreting the meaning of interface signs that belong to different ontologies
Described the importance of ontologies in information systems development based on Speroni’s  work
Analysed how re-design changes the ontology referred to by an interface sign; and users’ difficulty in interpreting the meaning of interface signs based on Speroni’s  work
The knowledge of World Wide Web, web browsing and its concepts and conventions
Real World Ontology
The knowledge of the real world experiences and concepts
The knowledge of the (studied) system, its functionalities and concepts
The knowledge of computers and computer uses
The knowledge of mobile and mobile application uses
Current Web Domain Ontologya
The knowledge concerning of web interface signs, which are specific enough to the current web domain (e.g., educational web domain)
Other Web Domain Ontology
The knowledge of web interface signs, which are specific enough to a particular web domain other than the web domain where the sign is currently available
The knowledge of concepts belonging to a common background of users and that uses common sense
The knowledge of a particular subject or topic the website talks about
The knowledge of web interface signs that refer to the institution or organization that owns a website or an application
The knowledge of interface signs which are specific to a particular cultural context
The knowledge of web interface signs which are specific to a particular website
In sum, the related work highlighted that several studies have been conducted on interface sign design, however, a very limited number of research are focused on the issue of ontology. Therefore, this study is focusing on the ontologies of interface signs to show why and how ontology mapping is important in relation to user interface design and evaluation.
Matched Ontology: Matched Ontology occurs when ontology/ontologies referred to by an interface signs matched with the one(s) owned by the users.
Conflicted Ontology: Conflicted Ontology occurs when user’s ontology/ontologies and the one(s) referred to by an interface sign conflict with each other
Unfamiliar Ontology: Unfamiliar Ontology occurs when user is not familiar with the ontology/ontologies referred to by an interface sign.
We argue that the intuitiveness of a sign depends on ontology mapping. For example, the meaning of the ‘HOME’ sign in a webpage refers to ‘getting the main/home page of a website’. A designer uses Internet Ontology when they include it in a website. If a user also uses Internet Ontology (Matched Ontology occurs), then he/she is expected to perceive the sign as intuitive. Alternatively, if the user uses Real World Ontology (Conflicted Ontology occurs), he/she may feel the sign less intuitive and make wrong interpretation by considering it as someone’s house. Finally, if the sign is not known to user (Unfamiliar Ontology occurs), he/she must feel the sign as less intuitive and fail to interpret it. This implies that Matched Ontology cases will have highest intuitiveness score, followed by Conflicted Ontology and Unfamiliar Ontology. To capture this, we propose the following hypotheses:
Users who experience Unfamiliar Ontology perceive lower intuitiveness than those who experience Ontology Conflict.
Users who experience Matched Ontology perceive higher intuitiveness than those who experience Ontology Conflict.
We also suggest that higher intuitiveness of an interface sign is associated with higher interpretation accuracy of understanding the meaning of interface signs. An intuitive sign allows users understand the referential meaning without clicking on it since it become transparent and reflects the actual content to users, allowing them to go directly to the content that is essential to them [4, 15, 31]. Consequently, we propose the following hypothesis:
Intuitiveness is positively associated with Accuracy.
Test participants and data collection procedure
What could be the referential meaning of this sign?
Why do you think this is the meaning of this sign?
When interpreting this sign how intuitive are they to you (less intuitive, average intuitive or highly intuitive; score: 1(not intuitive)—9 (extremely intuitive))?
Do you have any suggestion for redesigning this sign that would make the sign more intuitive in terms of interpreting its meaning?
Each session took about 25–35 min and was audio–video recorded. The interview data was transcribed and then analysed, first using qualitative analysis and then quantitative analysis using partial least squares (PLS) technique.
Model of the profiles of test-participants
Users familiarity with ontologies
Definition of the accuracy levels
Participants’ interpretation of an interface sign matches completely with the designers’ assigned meaning
Participants’ interpretation of an interface sign matches to a certain extend with the designers’ assigned meaning
Participants’ interpretation of an interface sign referred to more than one distinct meaning and the participant was confused when choosing the accurate meaning
Participants’ interpretation referred to a completely different meaning other than the designer’s assigned meaning
Participants were not able to interpret the meaning of interface sign at all
“…I know this sign. I have seen this sign almost all websites. This sign generally provides a set commonly asked questions with answers…”
“…I do not know this word; it might be written in a different language, so it is difficult for me to interpret …”
Furthermore, the qualitative analysis showed that when participants experienced ontology conflicts, they experienced comparatively (a) high difficulty to interpret the meaning of a sign with respect to the cases of ontology mapping, and (b) less difficulty to interpret the meaning of a sign with respect to the cases of unfamiliar ontology. For example, participants experienced ontology conflict for the ‘Students’, ‘Range of Courses’, ‘Other Target Groups’, ‘plus icon’ and ‘Peter Winandy’ signs in university websites (see Fig. 3). Most of the participants failed to interpret the meaning of these signs accurately and the mean intuitiveness scores for these signs were 3.14, 2.94, 3.86, 2.57, and 4.21, respectively. The sign ‘Range of Course’ actually stands for providing information of programs/degree offered (e.g., B.Sc. and M.Sc. in Psychology) in the university. But participants thought that the sign would provide the list of courses (e.g., object oriented programming language, data structure, etc.) offered in the university. They were also confused with the word ‘range’, as it could be used for different purposes like range of time or range of course fee. Here, this sign points to Website Ontology, since it is very specific to the website for this kind of information. However, participants treated the sign as built on Current Web Domain Ontology, System Ontology, and Common Sense Ontology to provide information about the list of courses offered in the university. Also, a few participants experienced ontology conflict to interpret the meaning of the ‘Students’ sign in a university website; because they thought that it could be either (1) for current students, because of the sign ‘Prospective Students’, which was placed to the left of this sign, or (2) for alumni students, because of the appended graduate hat icon. They thought this sign is referred to Current Web Domain Ontology, System Ontology, and Real World Ontology to provide information for the alumni or for students who will graduate soon. But the sign is actually referred to Website Ontology, since the ‘Students’ sign with the graduate hat is specific to this website for providing information for the current students. An ontology conflict thus occurred that led them to experience comparatively high difficulty to interpret the meaning of this sign.
Verification of structural model
PLS model results
All three hypotheses are supported in this study. The results show that reported intuitiveness score is lower (β = −0.45, p < 0.001) for Unfamiliar Ontology than Conflicted Ontology (H1a supported). On the other hand, the reported intuitiveness score is higher (β = 0.55, p < 0.001) for Matched Ontology than Conflicted Ontology (H1b supported). Finally, intuitiveness (β = 0.77, p < 0.001) has significant influence on accuracy (H2 supported). The structural model explains 68 % variance of intuitiveness and 64 % variance of accuracy.
In sum, the analysis suggests that Matched Ontology cases have highest intuitiveness scores, followed by Conflicted Ontology and Unfamiliar Ontology. The analysis also suggests that intuitiveness of interface signs is positively associated with accuracy of interpreting the meaning of interface signs.
Discussions and implications
“…I do not know the meaning, without meaning how I judge it…”
The sign ‘Megaliths’ can be re-designed as ‘Large Stones’, ‘Mega Stones’, or ‘Big Stones’. In such a case the sign will point to Common Sense Ontology, Real World Ontology, and System Ontology. This in turn may improve the intuitiveness of the sign.
“…This sign may be for alumni or those who will graduate…Oh! It may be for local students, as the neighbouring sign is for prospective students….I don’t know! It may be for alumni due to the graduation hat sign….”
Here, the sign is built on the Website Ontology, since the ‘Student’ sign with the graduate hat is specific to this website for providing information for the current student. The participants treated this sign as built on Current Web Domain Ontology, System Ontology, and Real World Ontology and assumed the sign would provide information for the alumni or for students who will graduate soon. They were familiar with this sign through the university websites, university, and real-world experience. As a result, an ontology conflict occurred that led the participants feel the sign as less intuitive.
Moreover, the study’s outcomes (i.e. two ontological guidelines) will contribute to advance practitioners’ knowledge to design and evaluate the web interface signs in order to improve the overall system usability and end user experience. The outcomes may assist practitioners: firstly, to investigate the problems and intuitiveness of interface signs based on users familiarity with ontologies; secondly, to redesign the less intuitive interface signs based on users familiarity with ontologies to make them more intuitive to end users; and finally, to apply the ontological guidelines as an integrated tool or concept with other usability evaluation process (e.g. heuristic inspection, user tests, etc.) in order to improve the usability evaluation.
This paper has a number of limitations that we plan to overcome in our future research. First, we have used a single item to measure intuitiveness in this study. Future research will focus developing a rigorous intuitiveness scale. Second, the current set of ontology and principles are derived for the desktop-based web interfaces. The ontologies and principles may not be directly applicable for mobile context. Thus, future work may focus on mobile interface, where signs have even more importance.
Both author equally contributed to design and conduct the experiment. First author wrote most of the article and carried out the qualitative analysis while second author carried out the quantitative analysis of the study data. Both authors read and approved the final manuscript.
The authors would like thank all the participants of this study. Their efforts are gratefully acknowledged.
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Neumuller M (2001) Hypertext semiotic in the commercialized internet, dissertation. Wirtschaftsuniversität, WienGoogle Scholar
- Peirce CS (1931–58) Collected writings (8 vols.), In: Hartshorne C, Weiss P, Burks A (eds). Harvard University Press, Cambridge
- Islam MN, Bouwman H (2015) An assessment of a semiotics framework for evaluation of user-intuitive web interface signs. Univers Access Inform Soc J 14(4):563–582View ArticleGoogle Scholar
- Derboven J, Geerts D, Grooff D D (2013) Researching user interpretation beyond designer intentions. In: Proceedings of the extended Abstracts CHI 2013. Paris, p 367–372
- Davis FD (1989) Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q 13(3):319–340View ArticleGoogle Scholar
- Bhattacherjee A (2001) Understanding information systems continuance: an expectation-confirmation model. MIS Q 25(3):251–370View ArticleGoogle Scholar
- Benbasat I, Barki H (2007) Quo vadis TAM? J AIS 8(4):211–218Google Scholar
- Benbasat I, Zmud RW (2003) The identity crisis within the is discipline: defining and communicating the discipline’s core properties. MIS Q 27(2):183–194Google Scholar
- Orlikowski WJ, Iacono CS (2001) Research commentary: desperately seeking the “IT” in IT research—a call to theorizing the IT artifact. Inform Syst Res 12(2):121–134View ArticleGoogle Scholar
- Bolchini D, Chatterji R, Speroni M (2009) Developing heuristics for the semiotics inspection of websites. In: Proceeding of the SIGDOC 2009. Bloomington, p 67–72
- Islam MN, Tétard F (2014) Exploring the impact of interface signs’ interpretation accuracy, design, and evaluation on web usability: a semiotics perspective. J Syst Inf Technol 16(4):250–276
- Islam MN, Ali M, Al-Mamun A, Islam M (2010) Semiotics explorations on designing the information intensive web interfaces. Int Arab J Inform Technol 7(1):45–54Google Scholar
- Islam MN (2014) Exploring interface sign ontologies for web user interface design and evaluation: a user study. In: Kecheng L, Gulliver SR, Li W, Changrui Y (eds) 15th IFIP WG 8.1 International Conference on Informatics and Semiotics in Organisations (ICISO 2014), vol 426. IFIP AICT, Shanghai, pp 87–96Google Scholar
- Speroni M, Bolchini D, Paolini P (2006) Interfaces: do users understand them? Proc Mus Web. http://www.archimuse.com/mw2006/papers
- Speroni M (2006) Mastering the semiotics of information-intensive web interfaces, dissertation. University of Lugano, LuganoGoogle Scholar
- Islam MN (2015) Exploring the intuitiveness of iconic, textual and icon with texts signs for designing user-intuitive web interfaces. In: Proceedings of 18th international conference on computer and information technology 2015 (ICCIT 2015). IEEE, pp 450–455
- Haramundanis K (1996) Why icons cannot stand alone. SIGDOC Asterisk J Comput Doc 20(2):1–8View ArticleGoogle Scholar
- Wiedenbeck S (1999) The use of icons and labels in an end user application program: an empirical study of learning and retention. Behav Inform Technol 18(2):68–82View ArticleGoogle Scholar
- Bedford A (2014) Icon usability. www.nngroup.com/articles/icon-usability. Accessed 27 Jul 2014
- Gatsou C, Politis A, Zevgolis D (2011) From icons perception to mobile interaction. In: Proceedings of the federated conference on computer science and information systems. Szczecin, p 705–710
- Gatsou C, Politis A, Zevgolis D (2012) The importance of mobile interface icons on user interaction. Int J Comput Sci Appl 9(3):92–107Google Scholar
- Ferreira J, Noble J, Biddle R (2006) A case for iconic icons. In: Proceedings of 7th Australasian user interface conference (AUIC 2006). Hobart
- Koutsourelakis C, Chorianopoulos K (2010) Icons in mobile phones comprehensibility diferences between older and younger users. Inform Design J 18(1):22–35View ArticleGoogle Scholar
- Kim JH, Lee KP (2005) Cultural difference and mobile phone interface design: icon recognition according to level of abstraction. In: Proceedings of MobileHCI’05. New York: ACM, p 307–310
- Rogers Y (1989) Icons at the interface: their usefulness. Interact Comput 1(1):1989View ArticleGoogle Scholar
- Blattner MA, Sumikawa DA, Greenberg RA (1989) Earcons and icons: their structure and common design principles. Hum Comput Interact 4(1):11–44View ArticleGoogle Scholar
- Familant ME, Detweiler MC (1993) Iconic reference: evolving perspectives and an organizing framework. Int J Man Mach Stud 39:705–728View ArticleGoogle Scholar
- Sharp JH (2011) Semiotics as a theoretical foundation of information design. In: Proceedings of the CONISAR 2011. Wilmington
- Islam MN (2012) Semiotics perception towards designing users’ intuitive web user interface: a study on web sign redesign. In: Proceedings of the MCIS 2012. Guimaraes
- Islam MN, Bouwman H (2016) Towards user-intuitive web user interface sign design and evaluation: a semiotic framework. Int J Hum Comput Stud 86:121–137View ArticleGoogle Scholar
- Islam MN, Tétard F (2013) Integrating semiotics perception in usability testing to improve usability evaluation. In: Garcia-Ruiz M (ed) Cases on usability engineering: design and development of digital products. IGI Global, Hershey, pp 145–169View ArticleGoogle Scholar