A human-centric integrated approach to web information search and sharing

1.1. Information Overload Problem

With the rapid advances of information technologies, information overload has become a phenomenon many of us have to face, and often suffer, in our daily activities, whether it be work or leisure. We all experience the problem whenever we are in need of some information, though "people who use the Internet often are likely to perceive fewer problems and confront fewer obstacles in terms of information overload" [1]. Any of us has experienced a situation when deciding to buy a certain product, say, a washing machine, and trying to figure out its characteristics, such as availability of delayed execution, steam and aquastop functions, we browsed the Web and encountered an excessive amount of information on the product. Then we had to filter out irrelevant information, categorize and analyze the remaining part to do the best choice. Many of those who work at office acquire, filter, analyze, conflate and use the collected information - the process which requires, today more than ever, special skills and software to cope with highly excessive and not always relevant information for proper decision making.

Despite of the public recognition of the problem and the great number of publications discussing and analyzing it, information overload is often a notion slightly differing in the contexts it is applied to and findings of researchers. The word itself has many synonyms, such as information explosion or information burden, and some derivatives, such as salesperson's information overload [2], to name a few. So what is 'information overload'?

As in the example with the washing machine purchase, information overload is generally understood as the situation when there is much more information than a person is able to process. This definition is identical to that given by Miller [3] who considered human cognitive capacity to be limited to five to nine "chunks" of information. First of all, it is often mentioned when the growing number of Web pages and difficulties related to this are discussed. Considering the growing popularity of social network systems (SNS) and user-generated content, the Web is likely to remain the primary area of concern about information overload in future. Indeed, the amount of such content grows very fast (for instance, Twitter had about 50 million tweets per day in February 2010 [4]) and becomes even threatening for men - people are at the risk of being buried with tons of information irrelevant to a particular current information need. And since information technologies in general and the Web in particular are highly employed for most human activities today, the problems raises concerns in many other technology-intensive areas of human activities. However, the problem of information overload should not be considered with regard to growing information resources on the Web only - it is much wider and multidisciplinary problem encountered in sales and marketing, healthcare, software development and other areas.

Information overload is a complex problem. It is not just about effective management of excessive information but also, as Levy [5] argues, requiring "the creation of time and place for thinking and reflection". Himma [6] conducted a conceptual analysis of the notion in order to clarify it from a philosophical perspective and showed that although excess is a necessary condition for being overloaded, it is not a sufficient condition. The researcher writes: "To be overloaded is to be in a state that is undesirable from the vantage point of some set of norms; as a conceptual matter, being overloaded is bad. In contrast, to have an excessive amount of [entity] × is merely to have more than needed, desired, or optimal."

Thus, being overloaded implies some result on a person, and this result is of undesirable or negative nature. Generally, conception of information overload today implies such negative effects. For instance, conducting social-scientific analysis (in contrast to Himma [6]'s philosophical approach) Mulder et al. [7] define information overload as "the feeling of stress when the information load goes beyond the processing capacity."

The state of information overload is individual, in the sense it depends on personal abilities and experiences. As Chen et al. [8] point in their research on decision-making in Internet shopping, the relationship between information load and subjective state toward decision are moderated by personal proclivities, abilities and past relevant experiences. Also though information load itself does not directly influence an individual's decisions, its excess may negatively influence the decision quality. By conducting a series of non-parametric tests and logistic regression analysis, Kim et al. [9] determined factors which predict an individual's perception of overload among cancer information seekers. The strongest factors appeared to be education level and cognitive aspects of information seeking that proves again the individual nature of the information overload and emphasizes the importance of information literacy.

Information overload is a multi-faceted concept and have various implications to human activities, and society in general, many of them becoming known as new researches are conducted. For instance, Klausegger et al. [10] found that information overload is experienced regardless of the nation, with its degree somewhat differing from nation to nation, - there is a significant negative relationship between the overload and work performance for all five nations the authors investigated. It was also found that the phenomenon negatively influence the degree of interpersonal trust, which is a critical component of social capital [1]. One of its plausible and severely harmful outcomes is information fatigue syndrome which includes "paralysis of analytical capacity," "a hyper-aroused psychological condition," "anxiety and self-doubt," and leads to "foolish decisions and flawed conclusions" [11]. Since the problem has a subjective nature, the first countermeasure is information literacy, efficient work organization and work habits, sufficient time and concentration [7] - again, one's strategy will depend on one's work tasks and subjective factors. Another, and not less important, countermeasure we put the focus in our research is technological. Till now a number of solutions as to how to reduce the negative effects caused by the phenomenon have been proposed. To name a few, in order to assure the quality of information and in this way reduce the problem in folksonomy-based systems, Pereira and da Silva [12] propose cognitive authority to estimate the information quality by qualifying its sources (content authors). To reduce excess of information in wiki-based e-learning, Stickel et al. [13] assume every link in the proposed hypertext system having a predefined life-time and use "consolidation mechanisms as found in the human memory - by letting unused things fade away" in order to remove unused links.

For more substantial information on the overload problem, interested readers are recommended to refer to [6, 14]. But to summarize, though simplistically, we reflected the principal and essential components of the phenomenon in Figure 1:

Clearly, to alleviate the information overload for an individual, we can reduce the amount of information and/or increase our processing capabilities. Considering the fact that people with high organization skills and information literacy have less perceived information overload and usually require better tools to process information, and people with constantly perceived information overload requires better training as to how to manage it [15], probably the first step to alleviate the problem is providing information literacy and organization instructions prior to providing the tools. After such measures become ineffective due to the overwhelming amount of information, filtering, summarizing, organizing and other tools have to be applied. Certainly, there is no need for a separation of the approaches and normally they should be used together.

In this study we focus on the technological approach considering each and every individual's interests, preferences and expertise in order to provide selective information retrieval and access, thus expediting the acquisition of desired and relevant information. Section 1.3 will clarify the research questions and objectives, and give a further outline of the approach.

1.2. Growing Role of Human in Information Creation, Assessment and Sharing

In addition to the fact that information overload is a subjective phenomenon and it is a human who is affected by it and has to cope with it, it is easy to see that the phenomenon itself is largely caused by a human and his activities. It started to be particularly tangible with popularization of user-generated content (user-generated media, or user-created content) which, in turn, was enabled by new technologies, such as weblogging (or blogging), wikis, podcasting, photo and video sharing on the Web [16]. User-generated content is publicly available and produced by end-users, such as regular visitors of Web sites.

The motivations for people to share their time and knowledge are, as discussed by Nov [17] for the case of Wikipedia, 1) altruistic contribution for others' good, 2) increasing or sustaining one's social relationships with people considered important for oneself, 3) exercising one's skills, knowledge and abilities, 4) expected benefits in terms of one's career, 5) addressing one's own personal problems, 6) contributing to one's own enhancement (these six categories are closely related to the concept of self-extension we have outlined within social networking services [18]), 7) fun and 8) ideological concerns, such as freedom of information.

According to Nielsen//NetRatings [19], in July 2006 "user-generated content sites, platforms for photo sharing, video sharing and blogging, comprised five out of the top 10 fastest growing Web brands." Among them were ImageShack, Flickr, MySpace and Wikipedia - the brands that are also well-known nowadays to any more or less literate Web user. User-generated content sites continue growing by attracting new users of various ages and social groups. Particularly, such growth is strong in online social networks today. For instance, Twitter is reported to have about 270,000 new users per day [20]. Also, eMarketer reports that in 2011 half of Western Europe's online population will use social networks at least once a month, and 64.4% of Internet users in the region will be regular social network users [21].

With the emergence of user-generated content (UGC) concept, an individual's role as a creator and active evaluator of the shared Web information has become central, and perhaps will become critical in future. With increase of human activities on the Web, the percentage of information related to such activities grows; hence, it is becoming more and more user-centric. Such centricity becomes a cause of creation of excessive amounts of information, but, on the other hand, also can help people to overcome information overload problem with the wisdom of crowds [22]. People use the power of user-generated content to make decisions on their daily activities, whether it be work or leisure, and researches are investigation on how to leverage it in order to benefit from it in a great number of work tasks. JupiterResearch [23] has found that 42 percent of online travelers using user-generated content trust the choices of other travelers and such UGC is very influential on their accommodation decisions. Exchange of user-generated content facilitates an enrichment of our life by creating new social ties and promoting interaction within communities, as, for instance, discussed in the study of enhancing a local community with IPTV platform to exchange user-generated audio-visual content conducted by Obrist et al. [24]. However, along with the virtues, such user-centricity of UGC brings new problems of trust, and quality and credibility of volunteered content that are transformed to adjust the UCG context. As an example, trust becomes a metric for identifying useful content and can be defined as "belief that an information producer will create useful information, plus a willingness to commit some time to reading and processing it" [25].

It should be noted that in our research we do not focus particularly on user-generated content, but, as everyone's Web experiences can show, the number of such content is great and its significance cannot be neglected. Although UGC has its specific problems, such as above-mentioned credibility and trust, to be solved, it shows the growing importance of every individual and proves the power of experience of online users taken altogether, which is an important pillar of our research. Generated by human, user-generated content is rapidly growing and influencing many aspects of human life. In other words, it can be named as a mechanism of indirect societal regulation by human, and this regulation is done by not a group of limited number of specialists, but by all interested people willing to participate. So the role of each and every individual in the modern society is growing and becomes more important than ever. Moreover, in the situation of information overload such an engagement is even essential to overcome the problems of excessive information that are, strictly speaking, created by the participants themselves. To reformulate this, nowadays we have to benefit from each other's expertise and this has to be enabled by appropriate technological solutions, which in turn ought to become as human-centric as possible to understand requirements to them in particular work task settings and employ all power of human expertise.

1.3. Research Objectives

The brief discussion of the problem of information overload and the importance of human to alleviate it take us to the research objectives of this research we will consider on two levels - macro and micro. Macro level will give us explanation of the objectives from the perspective of the presented concepts of information overload and user-centeredness of information creation, assessment and sharing on the Web. Micro level will help to outline the research questions and objectives we are working on in a closer perspective and domain of information retrieval (IR).

In our research we propose a collaborative information search and sharing framework called BESS (BEtter Search and Sharing) in attempt to incorporate the discussed user-centeredness into information seeking tasks. We present a holistic approach as to how to harnesses relevance feedback from users in order to estimate their interests, construct user profiles reflecting those interests and apply them for information acquisition in online collaborative information seeking context. The paper explains the notions of subjective and objective index in IR system, and demonstrates the methods for dynamic multi-layered profile construction changing with change of interests, evaluation of shared information with regard to each user's expertise, and subjective concept-directed vertical search.

1.4. Organization of the Paper

First of all, in Section 2 we discuss human-centric solutions for information seeking and exploration with main focus on personalization, its advances in academy and business, and speculate on user profiles as the core component of personalization. Further, we discuss BESS collaborative information search and sharing framework. Section 3 presents its conceptual basis, its model and architecture. Section 4 narrates about our original interest-change-driven modelling of user interests, discusses its role and position within the framework and compare with other profile construction approaches. Section 5 discusses shared information assessment and search in the framework. A demonstration of a search scenario is given to better reveal the concepts and information seeking strengths of BESS. Finally, Section 6 concludes the paper with the summary of the presented research and outlines future research issues.

2.1. Improving Web Information Retrieval

It is well known that alongside with search engine performance improvements and functionality enhancements one of the determinant factors of user acceptance of any search service is the interface. To build a true user-centric information seeking system, this factor must not be underestimated. Here we will show its importance considering mobile Web search, as the need for improvements are particularly tangible due to small screen limitations of handheld devices most of us possess today.

Landay and Kaufmann [28] in 1993 noted that "researchers continue to focus on transferring their workstation environments to these machines (portable computers) rather than studying what tasks more typical users wish to perform." In spite of all the advances of mobile devices, probably the same can be said about mobile Web search judging from its state today. Search today is poorly adapted to mobile context - often, it is a simplistic modification of search results from PC-oriented search services. For instance, many commercial mobile Web services, like those of Yahoo!, provide search results that consist of titles, summaries and URLs only. However, although all redundant information like advertisements is removed to facilitate search on handheld devices, users may still experience enormous scrolling due to long summaries. To improve the experience some services, like Google, reduce the size of summary snippets. However, this can hardly lead to the improvements and, quite the contrary, can thwart the search. As shown in Figure 2, a mobile user searching for "fireplace" cannot know that the result page is about plasma and does not match his/her needs, and has to load the page to find it out. According to Sweeney and Crestani [29]'s investigation on the effects of screen size upon presentation of retrieval results, it is best to show the summary of the same length, regardless whether it is displayed on laptops, PDAs or smartphones.

Improvements to mobile Web search done in academia go further. For example, De Luca and Nürnberger [31] implement search result categorization to improve the retrieval performance and present the information in three separate screens: screen for search and presentation of the results in a tree, screen to show search results and bookmarks' screen. Church et al. [32] substitute summary snippets, which are coming with each result item, with the related queries of like-minded individuals - queries leading to the selection of a particular Web page in the search result list. The researchers argue that such queries can be as informative as summary snippets and using this approach they provide more search results per one screen.

In contrast to the existing approaches, Shtykh et al. [33] (see also [30]) do not make any modifications to the search results, but propose an interface to handle the results provided by any conventional search service. The approach abolishes fatigue-inducing scrolling while preserving "quality" summaries of PC-oriented Web search. The proposed interface, called slide-film interface (SFI), is a kindred of "paging" technique. Unlike most mobile Web search services that truncate summary snippets of the search result items to reduce the amount of scroll and in this way facilitate easier navigation through search results that often can lead to difficulties in understanding of the content of a particular result, (owing to the availability of one slide of a screen size for one search result) our approach has an advantage to provide the greater part of one slide screen to place the full summary without any fear to make the search tiresome. SFI was compared with the conventional method of mobile Web search and the experimental results showed that, though there was no statistically significant difference in search speed when the two interfaces are used, SFI was highly evaluated for its viewability of search results and ease to remember the interface from the first interaction.

Although such approaches to improve the search with focus on the user, his/her usability are very important and user-oriented, they treat the user regardless of his/her contextual and situational information. As we already mentioned and will discuss more in Section 3, information need and human behavior are very contextual. Therefore peculiarities of information behavior, proclivities, preferences and everything that can give a better conception of the user, his/her behavioral patterns and needs must be considered in order to be able to provide a truly personalized information seeking experience. Although in the paper we focus on information seeking specifically, the application area of personalization spreads far beyond it. It is applied to Web recommendations and information filtering, user adaptation of Smart Home and wireless devices, etc.

Through our research we were particularly interested in personalizing and facilitating a human's interactions with various Web services. And search is not the only activity in Web information space users are engaged in. As empirical studies show [34], most of time users rediscover things they used to find in the past, and often they browse without any specific purpose discovering information space around them or with a particular purpose, such as learning miscellaneous information. To support such a discovery, we designed an exploratory information space [35] that makes use of human-centered power of bookmarking for information selection. The information space is built as a result of a search for something a user intends to discover, and serves as a place for rediscoveries of personal findings, socialization and exploration inside discovery chains of other participants of the system.

2.2. Personalization

Today personalization is the term we often relate to Web search personalization, such as in Google's iGoogle, recommendation system of Amazon.com, or contextual advertisements on Web sites. It is also about Decentralised-Me [36] of emerging Web 3.0 or is an essential part of Mitra [37]'s formula of Web 3.0 - Web 3.0 = (4C + P + VS), where 4C is Content, Commerce, Community, and Context, P is personalization, and VS is vertical search. However, the notion of personalization is much more diverse than that. It differs with regard to its application area and is being transformed over time and advances in its research. It is sometimes synonymous to customization and often to adaptation. It concurs with information filtering and recommendation.

In 1999 Hansen et al. [38] outlined two knowledge management strategies for business - codification, i.e., impersonalized storing knowledge in databases and its reuse, and personalization, which focuses on dialogue helping people to communicate knowledge. The authors claim that emphasizing the wrong strategy or pursing the both at the same time can undermine a business. However, today, in the situation of information overload, the both strategies often complement each other. Greer and Murtaza [39] define personalization as "a technique used to generate individualized content for each customer" and investigate the factors that influence the acceptance of personalization on an organization's Web sites. The research finds that ease of use, compatibility with an individual's value and his/her intents and expectations, and trialability ("the degree to which personalization can be used on a trial basis") are the key factors for personalization adoption. Monk and Blom [40] in their earlier works define personalization as "a process that changes the functionality, interface, information content, or distinctiveness of a system to increase its personal relevance to an individual," and Fan and Poole [41] extends this definition to "a process that changes the functionality, interface, information access and content, or distinctiveness of a system to increase its personal relevance to an individual or a category of individuals" which serves as the working definition for the paper.

Such a great diversity in understanding of what personalization is results in difficulties to produce a holistic view on personalization, hurdles for sharing findings for researches of different fields and difficulties to compare approaches. And this is one of the conceivable reasons why the current approaches focus on "how to do personalization" rather than "how personalization can be done well," as Fan and Poole [41] has noted. Most personalization approaches on the Web are system-initiated, i.e., considering adaptivity which is the ability to adapt to a user automatically based on some knowledge or assumptions about the user. But another concept - of adaptability, which is a user-initiated (or explicit by Fan and Pool [41]) approach to modify the system's parameters in order to adapt its functionalities to his/her particular contexts, - is also important when considering personalization. Monk and Blom [40] emphasized that people always personalize their surroundings, and their Web environment is not an exception, and presented their theory of user-initiated personalization of appearance.

Personalization has a lot of advantages over impersonalized approaches, some of which are obvious and some of which are hidden and have to be empirically proven. For instance, Guida and Tardieu [42] prove that personalization, similarly to long-term working memory, helps to overcome working memory limitations, expanding storage and processing capabilities of human-beings. Although the discussed personalization is considered as a creation of the situation of individual expertise that is generally not exactly what modern personalization systems can provide, such approach indicates the need in better considering context and situation in order to fully employ its merits.

2.3. Modeling User Interests

In order to be user-centric, a service has to know each user it interacts with. This is the task personalization attempts to fulfill with a variety of methods in various work task and environmental settings. Personalization systems extract the user's interests, infer his/her preferences, update and rely on knowledge about the user accumulated and structured in user profiles that differ by the data used for their definition, their structure and complexity, and construction approaches.

At this point we have to note that in modeling user interests we do not make a distinction between Web search personalization, recommendation or information filtering because the differences in their methods and goals are very subtle. All such approaches utilize a certain scheme to know the user's preferences to adapt to his/her future interactions with the system and information it provides, and constructing user profiles (or user modeling) is the most popular method. It has been extensively used from days of first information filtering systems, for instance as a user-specified profile or a bag-of-words extracted from the documents accessed by the user, and today it takes many richer and diverse forms to meet the requirements of the variety of information systems.

3.1. Being User-Centric by Knowing User's Preferences through Contexts

One of the main driving forces of human information behavior is information need that is recognition of one's knowledge inadequacy to satisfy a particular goal [62], or "consciously identified gap" in one's knowledge [26]. Therefore its understanding is crucial for systems that are supposed to facilitate information acquisition. However, in many cases capturing and correctly applying individual information needs is extremely difficult, even impossible. For instance, in IR systems a user's input cannot usually be considered as a correct expression of his/her information needs - that results in invalidity of many traditional relevance measures [63]. And this happens not only in IR, but in any system when context, in which an information need was developed, is lost.

Then, the following question arises. From the discussion to this point in the paper, we can define user-centric system as a system that "understands" (is able to capture) the user's information need in order to satisfy it effectively. But how can the system be user-centric and satisfy sufficiently the user's information need without being able to capture it?

Information need emerges in one's individual context, and both context and information need are evolving over time. Information behaviors happening to satisfy the information need and leading to an information object selection also take place in the same particular context (Figure 3). Therefore, although knowing particular contexts does not give us the full understanding of a particular user's information needs, such knowledge can give us some conception (or a hint) of conceivable information a user tries to obtain in a particular context, i.e., lead us to the potentially correct object selection. As shown in Figure 3, particular information need in a particular context leads to information behaviors which, in their turn, result in object selections from, for instance, two groups of similar objects. Knowing information behavior patterns (and their contexts) resulting in particular object selections, in our research we try to induce a user's current preferences for a particular object without clear knowledge of current information need. Such knowledge gives a chance for a service to identify user contexts during user-service interaction and help with correct information object selection. Further, by matching context information of one particular user with contexts of other users that utilize the same service, we can try to foresee a situation new to the user (an unknown context) and facilitate his/her information behavior.

Essentially, context can be considered as a formation of many constituents - an individual's geographical location, educational background, emotions, work tasks and situations, etc. With the advances of spatial data technologies, ubiquitous technologies and kansei engineering we are likely be able to collect a large part of them in the near future, but this task is still very challenging. Even more challenging is the task to effectively utilize all these constituents in various user-centric services. Moreover, the need in some particular constituent of the whole context depends on the task one particular system is trying to facilitate.

In information seeking tasks we are studying, as in most tasks that support information activities today, it is impossible to collect all contextual information, so the contexts considered here have a fragmentary nature - basically consisting of information behaviors obtained from users' explicit and implicit relevance feedback [65]. Generally, it is a feedback of textual, temporal or behavioral information with regard to the resources a user interacts with.

3.2. User-Centrism in BESS: Main Concepts of the Proposed Approach

3.3. Position of BESS among Modern Web Personalization Systems

Reconsidering information retrieval in the context of each person is essential to continue searching effectively and efficiently. That is why so much attention is paid to this problem and consequently a number of approaches to Web search personalization have emerged recently. Nowadays we are experiencing the much anticipated breakthrough in personalized search efficiency by "actively adapting the computational environment - for each and every user - at each point of computation" [68].

To show the peculiarities of existing Web search personalization systems and the position of BESS inside Web search personalization approaches we classify them as vertical and horizontal, individual-oriented and community-oriented based on breadth of search focus and degree of collaborativeness they possess (see Figure 4; arrows denote current trends in search personalization).

Outride [68] and similar systems take a contextual computing approach trying to understand the information consumption patterns of each user and then provide better search results through query augmentation. Matthijs and Radlinski [69] construct an individual user's profile from his/her browsing behaviour and use it to rerank Web search results. On the other hand, Sugiyama et al. [70] experiments with a collaborative approach constructing user profiles based on collaborative filtering to adapt search results according to each user's information need. Almeida et al. [71] harnesses the power of community to devise a novel ranking technique by combining content-based and community-based evidences using Bayesian Belief Networks. The approach shows good results outperforming conventional content-based ranking techniques. Systems like Swicki, Rollyo, and Google Custom Search Engine correspond to vertical and mostly community-oriented approach of search personalization. They provide community-oriented personalized Web search by allowing communities to create personalized search engines around specific community interests. Unlike horizontal (or broad-based) search systems mentioned above, such systems are considered personalized in the sense that available document collections are selected by a group of people with similar interests and the systems can be collaboratively modified to change the focus of search. Although not Web-based, we take tools like Google Desktop Search as an example of individual-oriented vertical search systems. They search contents of files, such as e-mails, text documents, audio and video files, etc., inside a personal computer. The absence (to the best of our knowledge) of salient Web-based systems of this kind can be explained by the increasing popularity of services on the Web benefiting from community collaboration and favoring fast transition of each person's activities from passive browsing to active participation.

As it is shown in Figure 4, BESS is a community-oriented system having the features of both horizontal and vertical search system. It performs search on information assets of both horizontal (objective index) and vertical (subjective index) nature. The notion of subjective index in our research is similar to 'social search' of vertical community-oriented systems presented above, but differ in higher degree of personalization for every user, high granularity of vertical search model (see subjective concept-directed vertical search in Section 5) and, finally, the way of collecting and (re-)evaluating information pieces. Groups of users are created dynamically without a user's interference based on match of interests/expertise, and the role of community is indispensable for search quality improvement and the system's evolution in general.

3.4. Architecture and System Overview

BESS is a complex system that consists of several components for relevance feedback collection, analysis and evaluation, online incremental clustering, user profile generation, indexing and a few elements realizing several search functionalities.

As we have already discussed, the main purpose of BESS is to realize collaborative personalized search. And to achieve the assigned tasks, first of all, our collaborative search and sharing system has to be capable of distinguishing users, and collecting and analyzing their personal feedback. "Access control and data collection" module of BESS is responsible for this. A user is authenticated when accessing the system, so we know whom it is used by. After that, his/her interactions with the system are logged. To have an understanding of the user's interests we are primarily interested with contributions (explicit feedback), done through the contribution widget of a Web browser, and implicit feedback, collected by monitoring the clickthrough. All the interaction data is stored in "Activity data" database, as shown in Figure 5. Then, this 'raw' data is processed and clusters (concepts) reflecting the user's interests are created by "Data analyzer." Existing concepts are incrementally updated. At this moment the interests are inferred and known, but are of little interest because they say nothing about their temporal characteristics. As a result, some concepts can be outdated, others can be recent and topical.

In order to organize the concepts, "Profile generator/analyzer" generates a user profile using interest-change-driven profile construction mechanism, as described in Section 4, and it is stored. We have to note that, as it is also discussed in the next section, user profile is very central for the system functioning in general. As it is shown in Figure 5, user expertise, together with expertise of other users, with regard to a particular topic (concept) is used for assessing his/her feedback, which is then indexed and stored in the "Subjective data" repository for further retrieval. This personal and 'collectively evaluated' feedback becomes a piece of the user's subjective index data.

Now, when we have data to be searched on, let us consider search.

On logging in, the user has an opportunity to search both with conventional search engines and the search engine provided by BESS. Essentially, both are used when a search request is issued. The results of the conventional one are shown in "Objective search results area" and the results of the one provided by BESS are shown in "Hidable subjective search results area" (See Figure 6). The user can select his/her favorite Web search service from "SE Switch" and hide "Hidable subjective search results area" if there is not enough subjective contributions for the topic in concern, or he/she is simply not interested in collaboration temporarily and wants to concentrate on objective search only. In any case, the user is enriching his/her personal subjective index, and consequently all shared subjective index.

Search on the subjective index data is normally done in the all-shared mode, when the subjective index of all users is searched on. In this case, query-document matching is performed, and all matched documents are retrieved and listed according to the ranking algorithm. However, the user has another option - to search on the subjective index data of the users whose user profiles are conceptually close to his/her current user profile by switching with "Search mode switch." This is what we mentioned as subjective concept-directed vertical search already (Detailed discussion of the ranking algorithm and subjective concept-directed vertical search is given in Section 5).

3.5 Notes on Implementation Technologies

In order to realize all the described functionalities, BESS employs a number of technologies, such as online incremental clustering, indexing and search. Indexing and search is done with help of customized Apache Lucene. User profile construction is a module set implemented according to the methods described in the following section of the paper, and online incremental clustering is described in [72] in every detail. All implementation is done with Java, using JSP (Java Server Pages), Java Servlet, Spring Framework and other Java technologies. For the development of contribution submission Firefox component, we used AJAX (Asynchronous JavaScript and XML) and XUL (XML User Interface Language).

4.1. The Role and Position of User Profile

User profiles play a key role in our BESS information retrieval framework. The framework is developed in attempt to capture information needs and information seeking contexts of every individual, and better facilitate information seeking activities by identifying and providing information resources pertinent to every individual's needs. This is achieved by modeling a user's changing interests from relevance feedback (explicit feedback, called contributions, and observed user behavior, such as clickthrough information) over time and using the models

These steps ensure the search is done on highly selective documents evaluated by the users with similar interests taking into account their expertise, or the degree of their involvement into a particular topic.

Figure 7 is a schematic fragment of the system architecture describing the position and the role that user profiles have inside the system. First, the analyzed relevance feedback is used to update a user's profile with a newly created or updated concept. Then, the updated profile and its concepts' peculiarities are used for the evaluation of the same relevance feedback item (details of the evaluation mechanism are given in Section 5). And finally, the feedback is indexed in every individual's subjective index repository which is shared among all users of the system. When a user searches, he/she can search on the multiple sets of information assets evaluated according to each user's expertise or narrow his/her search to the resources of those users whose interests (concepts in user profiles) are similar to his/her own.

As it can be seen from this short description, the position of user profile in the system operations is central and the quality of the profile is of vital importance not only to information seeking experiences of one user but to the experiences of all users of the system. Therefore, in this paper we pay the particular attention to the profile construction and to the quality of the concepts, which are the constituents of user profiles and indicators of user interests, in particular.

4.2. Concept as a Principal Profile Component

Relevance feedback is an essential element of any information filtering system and a significant part of the proposed system. It is extensively researched in its various forms. Explicit feedback often disrupts normal user activities; therefore another form of feedback that can be collected with no extra cost to the user - implicit - is used widely. Sometimes these two forms are combined to get better insight about a user's peculiarities. Kelly et al. [44] gives a good classification and overview of works on implicit feedback. In many cases, user behavior is considered to be an implicit feedback, and its analysis is done for improving information retrieval by predicting user preferences, re-ranking Web search results and disambiguating queries.

Often relevance feedback is used in attempt to find out user behavioral patterns and generate individual user profiles reflecting current user interests. There exist many approaches for profile modeling. Nanas et al. [73] has profiles made from concept hierarchies that are generated from user specified documents and applied for information filtering. Profiles are divided into three layers by a heuristic threshold each of which determines the topic, subtopics and subvocabulary for the specified topic. Term weighting approach (Relative Document Frequency) is extensively used for hierarchy construction. Matthijs and Radlinski [69]'s profiles are built with the emphasis on users' browsing behavior, therefore, in addition to terms, a list of visited URLs, the number of visits to each, a list of past search queries and pages clicked for these search queries are used for profile construction. Semeraro et al. [74] uses a different approach for profile construction. As in [73], profiles consist of concepts, but the approach employs ontologies where semantic user profiles are built with the use of content-based algorithms extended using WordNet [75]. Such an approach is proved to help infer more accurate user profiles.

BESS makes extensive use of both explicit and implicit relevance feedback for the construction of personal information assets and user profiles. Unlike profiles in the above-mentioned approaches, profiles in BESS are constructed with the main focus on users' interest change when searching, and concepts in them are loosely coupled and dynamic.

User profile in BESS is a structured representation of user contexts which are in turn consist of preferences and interests of a user. It consists of concepts (semantic clusters), and each concept is the system's piece of 'knowledge' about what the user is interested in. Each concept is modeled as a cluster c _i of n document vectors X = (x ₁ , ..., x _n ) from the individual document set grouped by a specific 'knowledge' criteria. Concepts are extracted from minimal user search and post-search behaviors (user-system interactions while searching, browsing and contributing Web pages). The system is configured to capture the following data:

Prior to concept extraction, documents from individual document collections are linearized by removing HTML and script tag data, non-content-bearing 'stopwords' are deleted and document vectors are normalized. Then, a classification method is used to extract concepts from the document vectors. Virtually, any method can be applied for this.

4.3. User Profile Structure

Information seeking, as any information behavior, is done in the context determined by situation, interest, person's task, its phase and other factors. In the process of seeking information, needs and their contexts are changing even within the same seeking task.

Recognizing this fact, we introduce a temporal dimension to user profiles by splitting and combining (generalizing) all concepts on a time line. For this, we make user profiles in BESS multi-layered - each layer reflects user interests within a certain period. It consists of four layers - static pr ^(st) , session pr ^(ss) , short-term pr ^(sh) and long-term pr ^(ln) (Figure 8). Thus, profile of user a can be defined as

where l is a layer and k is a concept number.

Each layer has a pool of concepts that characterize best a user's seeking context for the layer's time span. The static layer is defined at the start of user-system interaction to solve so-called "cold start" problem when the system has no information about the user and cannot facilitate his/her activities or can even damage the whole interaction. Other three layers can be classified as dynamic layers, since they are dynamically constructed and changed along with changing user information needs and their contexts.

The session layer contains the fragmentary context of the current information behavior of a particular user. It is a highly changeable layer and defined by a concept that best matches one of the concepts available in the short-term layer or a newly created concept. In other words, the session layer is the indicator of context switch at the lowest level. The short-term layer is a central layer of the whole system - it consists of concepts formed in all user-system interaction sessions within a specified period of time, and its generation itself serves as an important factor for collaborative feedback evaluation mechanism. And finally, the long-term layer is derived from the most frequent concepts of the short-term layer, as discussed in the profile construction section, and reflects general user context of interaction with the system. When there is enough information for its formation, it is created and gradually supersedes the static layer. The profile layer construction mechanism is further described in the next subsection.

4.4. Dynamic Interest-change-driven Profile Construction

As we have already described, user profile plays an important and central role in BESS for collaboratively evaluating documents contributed to the community and for adjusting the focus of search. Therefore user profiles have to be precise and accurate, and this is achieved by correctly specifying and evolving their concepts in the online and incremental fashion. Moreover, profiles ought to timely reflect the changeability of user interests while maintaining the steadiness of persistent preferences. In our interest-change-driven model for dynamic user profile generation we proposed in [65] we adopt recency, frequency and persistency as the three important criteria for profile construction and update.

Once we have concepts extracted from a user's feedback, we can detect the change of a user's context and set the latest one as the current context (recency criterion), which is the session layer in multi-layered user profiles. By observing concept creation dynamics we can set some to be the short-term layer according to the following (frequency and recency) rule:

For n concepts in the latest clustering output, choose newly-created and already existing concepts whose input item growth is high in a reverse order (newness) of the output sequence.

And finally, the long-term layer is formed from n most frequent concepts which have also been observed in the short-term layer.

Thus, concept extraction method produces C _a = {C _a1 , ..., C _an } set of n concepts which are ordered by recency criterion, i.e., a concept that is newly created or most recently updated appears at the top of the recency list. C _a1 is the most recent concept and considered to be the current context and the session layer of the profile of user a, i.e., $p{r_a}^{\left(ss\right)}=C_{a1}$.

The short-term layer consists of m most frequently updated and used concepts, which are, in their turn, chosen from r most recent (top) concepts in the concept recency list. In other words, these are the concepts that are frequently used and still of some interest for the user. Figure 9 explains how the short-term layer is created.

where α is set experimentally. C _ai is a concept of the set of concepts C _a produced from relevance feedback of user a.

The concepts for the long-term layer are found by the procedure shown in Figure 10.

All the layers dynamically created at time t form concept-based interest-change-driven model of user a, and are the representation of the user's interests at t. A change of the concepts in terms of their ranking in the short-term profile layer signifies a change of user interests and emergence of a new model of user a. The model update is not constrained with the predefined parameters, such as fixed time period after which the update occurs, and driven by natural dynamics of changing user interests. This mechanism is used to find a user's n past profiles and their concepts to determine the areas of expertise of the user to be used in his/her feedback evaluation mechanism, as described in Section 5.

4.5. User Profile Construction: An Example

To demonstrate profile construction using the proposed profile construction scheme and show the rationality of the chosen approach, we give an example of profile construction and discuss its peculiarities.

First, we implemented the profile construction system where every user relevance feedback was processed one by one and the extracted concepts were used to create user profiles according to the scheme described in Section 4.4. Then, we prepared relevance feedback obtained from 12 users with ages from the mid-20's to the mid-40's during one of our experiments for observing users' Web search behavior, which lasted two weeks and resulted in average 320 records collected per participant. The data was processed sequentially using H2S2D (High-Similarity Sequence Data-Driven) clustering method we proposed in [72] with 0.1 threshold, which was proven to produce concepts of reasonably good quality fast and in online and incremental fashion. As a result, in overall 20 concepts were created.

Here we show typical user profile construction results for one user. Since the session profile layer is simple - consisting of one currently used concept - and very frequently changed with the change of the user's current interests and needs, we skip it to illustrate the dynamics of short-term and long-term layers. Figure 11 shows how the user's short-term profile layer is being generated during concept extraction process. "Processed items" axis refers to the number of relevance feedback items processed by H2S2D method. So, for instance, label "288" indicates 288 items processed one by one and it is a point of change of user interests - literally, change of rank of concepts C1, C6, C4 and C8 in the short-term profile layer. "Rank" axis refers to the rank of concepts in the layer (explained in subsection 4.4), where only top m items are considered being the layer's concepts and the others are given to show the change dynamics of concepts during the period the user supplies relevance feedback data when interacting with the system. As shown in the figure, the rank of the concepts, as it can be expected, tend to change often initially and become more stable when more feedback, and accordingly better-quality concepts, is available. In fact, we do not expect the scheme to produce an unchangeable layer, since this layer has to reflect short-term user interests and the change in concept rank indicates emergence of a new user model. This model is called interest-change-driven model, since a new profile generation/update is caused not by some predefined settings, such as days, hours, etc., but by the dynamics of model generation itself (concept rank change). For instance, if we choose three most frequent of r most recent concepts (m < = r) in Figure 11 to be in the short-term layer, we can see that concept rank change, and accordingly a new model definition, occurs after item 94, 131 and so on are processed. The most highly ranked concept C5 keeps its top position since the user keeps working on plugin implementation for Firefox browser. The third highly ranked concept changes often from interests in news to travel and conference-related topics. See Table 1 for simple explanation of concepts presented as a number of terms representative of the concept topics.

Figure 12 shows the generation process of the long-term profile layer which was being constructed alongside with the short-term layer. Again m concepts with the highest persistency factor PF (with α = 0.1) are chosen to be the long-term layer. But, in contrast to the short-layer concepts, they are not ranked and only the fact of their belonging or not belonging to the top m concepts is important for the definition of the layer. The concept ranks in Figure 12 are shown to indicate the change dynamics of the concepts' PF value and their less frequent changeability in comparison to the short-term layer's concepts. In other words, if we choose three concepts with the highest PF to be the long-term layer's concepts, the layer remains the same from the formation time (after item 217 is processed) - Pr _a ^(ln) = {C6, C7, C4}. It changes only after concept C1 gains PF value that is higher than the value of C7 - Pr _a ^(ln) = {C6, C4, C1}. Persistency factor ensures that only those concepts that have a tendency for being long-term interests gain higher value. For instance, concept C1 is ranked highest in the short-term layer and there is no evidence that this is not a long-lasting temporary interest and the user will return to it in future, therefore its PF value is not one of the highest. However, if such evidence will be available in future when the user returns to interests reflected by C1, its PF value will increase and the chances to be a concept of the long-term profile layer will grow.

As it can be seen from the figures and their explanations, the constructed layers meet our expectations and requirements to reflect a user's current interests for the session profile layer, to be a representation of both recent and frequent interests (i.e., the recent and vivid interests lasting for some time) for the short-term layer, and to collect persistent interests for the long-term layer.

5.1. Contribution Co-evaluation

One of the main characteristics of the proposed framework is community-empowered user-centeredness realized through users' contributions. Together with implicit relevance feedback they are used for the users' interest inference and formation of dynamically changing user profiles. In contrast to implicit feedback, which does not give a clear understanding of a user's interests before it is analyzed, contributions are clear indicators of the user's interests and can be used for promotion of contributed documents with regard to his/her expertise to all community members of the information sharing and search system. In BESS, contributions and the user's expertise drawn from his/her user profile are used for co-evaluation of information resources the search is done on.

In order to 'promote' documents contributed by a particular user a, first of all, his/her user profile, and specifically concepts in it, has to be known. Clearly, not all concepts can be used for various reasons - an involvement of too many concepts into the computation process is costly, or many concepts can be considered unsuitable in terms of the current user context and situation. Therefore, we consider concepts of the short-term layer of UP as a highly dynamic and, at the same time, rather consistent layer reflecting most of the recent and significant concepts of user a. As we discussed in Section 4, a change of the concepts in terms of their ranking in the short-term profile layer signifies a change of user interests and emergence of a new model of user a. The short-time profile layer generation process serves as an important factor for feedback value definition mechanism. In other words, its change-driven nature helps to determine the period of time for amount of data used to evaluate user contributions - to determine the concepts that will be used for contribution assessments.

The layer generation process is illustrated in Figure 13. Note that concept re-ranking is done according to the criteria described in Section 4.

i - number of interest changes. Gi - group of dynamic profile concepts. A, B, C, D, E, F - interest concepts. {A, B,..., F} ∈ G _i

Ti - moment of concept change in profiles. G and T - current concept group and moment respectively.

where i is the number of interest changes, T _s - start time of evaluation period, ΔT - the interval to the current position on profile generation time line, and G and T are the current concept group and moment respectively.

After the period is defined, a contribution can be evaluated according to the following criteria with regard to the available concepts of this particular user and all concept space of the system - concepts of all users interacting with the system:

where C _i ∈ C = {C₁,..., C _I } and C _ui ∈ C _u = {C_{u 1},..., C _uI }.

where α is a constant regulating the power of different contribution types - for instance, if implicit feedback is considered as a contribution, its estimated value has to be weakened because it is less indicative of the user's interests compared to explicit feedback.

where |C _d | is the number of (top n) concepts d belongs to.

Evaluating contributions in this way we give an assessment of a user's expertise by his/her involvement degree (CA) and potential value the user brings to the whole community by his/her contribution (CP). More specifically, these criteria take into account:

and stored for document ranking in retrieval process described next.

5.2. Collaborative Search

Both modes are labeled as collaborative. Search in normal mode is collaborative in the sense it is performed on the collection of contributed and shared documents and co-evaluations of the documents are considered for search result re-ranking. Focused search is even more collaborative since it detects search space from subjective document collections of users with similar contexts.

5.2.2. Subjective Concept-directed Vertical Search

Another method to search in BESS is concept-based subjective concept-directed vertical search, or focused search. It is realized by matching of concepts of the individual user profile with concepts of other users when retrieving through the subjective search engine. This operation forms the target search document space for the query by finding users with similar interests and reaching their subjective index repositories. After the search document space is determined relevant documents are retrieved by comparing query and document vector similarity.

By forming the search document space, we change the focus of search, similarly to what occurs in vertical search engines, but automatically detecting users with similar information seeking contexts. In this way we ensure the search will be done on highly selective documents evaluated by the users with similar interests taking into account their expertise, or the degree of their involvement into the topic. That is, by drawing upon community expertise and similarity of information needs, we perform subjective concept-directed vertical search.

Figure 14 shows how the search is done in the system, presenting it on the level of concepts user profile consists of.

Users with similar profiles, and hence their subjective index collections, are found by comparing reference points of concepts in each layer of UP one by one. The following formula is used for the estimation.

$\sum _{k=1}^{K}si{m}_L\left(l_{ak},l_{bk}\right)=\sum _{k=1}^K\frac{\sum _{j=1}^J\sum _{i=1}^{I}sim\left(R{p}_j,R{p}_i\right)}{JI}{\alpha }_k$

(6.9)

When n top users with similar contexts are found, their collections form the search document space. Then, the search is done as in normal subjective search mode.

5.3. Search Scenario

To give a better idea how, for instance, subjective concept-directed vertical search works, let us consider several users of the system having the following rather abstract concepts generated from their contributions, and search and post-search behaviors.

Let us assume that user A searches for the pages explaining air-conditioning in Mitsubishi cars and submits "Mitsubishi air conditioner" query. The user does not know that Mitsubishi Electric produces room air-conditioning appliances, but knows about Mitsubishi cars and is interesting particularly in this topic. As a result of the query, conventional search engine ranks high the documents covering room air-conditioning systems (which are unrelated to the user's search intents), whereas the proposed system will restrict results to document collections of users with similar interests and rank them according to user evaluations if available. In this particular case, user A's interests match those of user C and the query retrieves documents explaining air-conditioning in Mitsubishi cars (Figure 15).

6.1. Summary

With the exponential growth of information on the Web and, as a result, failures to manage and process it effectively and efficiently, solutions beyond conventional information organization and filtering are being sought. Realizing the subjective nature of information overload and witnessing the fast proliferation of user-generated media, academia and business turn to the human more and more often today - human problems are proposed to be solved directly by humans, rather than being mediated by information systems. Algorithms and systems to facilitate information access and acquisition are still very important and their role cannot be diminished, however they have to get better understanding whom they are used by in order to do their job with the expected efficacy and efficiency - that is to say, they have to be user-centric. Having the complete knowledge of each particular individual might be considered sufficient to call a system user-centric, but, in our understanding, such a definition of user-centrism is one-sided and lacks a concept of community as an important part of human context. An approach considering an individual user only will not benefit from "wisdom of crowds" [22] of other users, loose much predictive power it can draw upon other users' experiences, and will not be able to collect all contextual information necessary for complete understanding of the user. Thus, an essential part of user-centrism is considering a user not only in his/her individual scope, but expanding it to the user's community participation quintessence.

Recognizing this, we designed and implemented BESS (BEtter Search and Sharing) as a highly collaborative information search and sharing system. In addition to learning individual interests of each particular user, BESS harnesses collective knowledge of its users who share their personal experiences and benefit from experiences of others. We made an endeavor to develop a holistic approach of how to harnesses relevance feedback (both explicit and implicit) from users in order to estimate their interests, construct user profiles reflecting those interests to applying them for information acquisition in online collaborative information seeking context. To emphasize the collaborative nature of relevance feedback submitted by users explicitly, it is called a contribution in our research. In comparison to implicit feedback, contributions are better indicators of a user's interests and therefore have bigger values for shared information assessment.

The central part in the system is allotted to user profiles claimed to contain fragmentary user contexts and used for contribution evaluation and search. Each user profile consists of a set of concepts representing user interests and inferred with High Similarity Sequence Data-Driven clustering method thoroughly discussed in [72], which is proven to be easy to implement and produces concepts of reasonably good quality fast and in online and incremental fashion. To ensure that a user profile is always updated and reflects current, recent and long-term interests, it is designed multi-layered and changing with change of the user's interests as a result of estimations done with interest-change-driven profile construction mechanism. The mechanism adopts recency, frequency and persistency as the three important criteria for profile construction and update.

As mentioned, user profiles are important for both relevance feedback evaluation and search. And they are especially important to realize a unique mechanism of personalized search - subjective concept-directed vertical search, or focused search. It is realized by matching of concepts of the individual user profile with concepts of other users when retrieving from the subjective search engine.

Furthermore, in order to distinguish between impersonal data of conventional search systems and individualized data of the members searching and sharing in the proposed system, we introduced the notions of subjective and objective index in IR system. Such distinction aims to enrich users' experiences with both conventional and personalized search results.

All these enables tight coupling of information sharing and search in the personalization cycle of contribution submission through search → user modeling from contributions → contribution assessment based on the user's expertise inferred from user models → search result ranking based on the user's individual and community expertise (inferred from user models) → (new) contribution submission through search and so on (Figure 16), which is, together with separation of subjective value-added resources from impersonal objective data of conventional search services (creation of 'social' sub-space for subjective information accumulation and sharing through search) is the major difference of our approach from many modern conventional personalization solutions on the conceptual level.

6.2. Future Research Directions

In order to achieve highly user-centric experience, the discussed research approach puts user profiles in the center of search and sharing. Profiles contain concept-based information about users inferred from relevance feedback and designed to dynamically reflect user contexts. However, contexts handled in this research (as in all today's research) are of fragmentary nature, reflecting only the part of user interests. Recognizing the importance of contextual knowledge about a user for personalization, additional methods to define, capture and organize contextual information effectively, extension of the architecture and algorithms to include more information from a user and assessments of effects of such inclusion on personalized experience are one of the future directions of our research.

Another direction is a closer examination of motivational factor for relevance feedback in social bookmarking and tagging, and search as a means to collect more precise information about a user.