Sted: Vilhelm Bjerknes hus, Auditorium 2
“More than Meets the Eye” – Analyzing the Success of User Queries in Oria (Forskningspaper)
Hugo Christian Huurdeman, Universitetet i Oslo
Dan Michael O. Heggø, Universitetet i Oslo
Mikaela Aamodt, Universitetet i Oslo
Sammendrag Presentasjon fra konferansen
Engaging Social Media? A Case Study of University Library Community Building Practices on Twitter from Norway.
Hilde Drivenes Johannessen, Universitetet i Agder
Birgitte Kleivset, Universitetet i Agder
“More than Meets the Eye” – Analyzing the Success of User Queries in Oria
Library catalogs provide quick access to a wide variety of materials available in academic libraries. However, searching for literature is not always straightforward, and users encounter issues in finding the right material for their work and studies. To get a better understanding of these issues, we have studied user interactions with the library catalog of the University of Oslo Library.
Since January 2015, the discovery system Oria (an installation of Primo) has been the main user interface to the catalogs of Norwegian academic libraries part of the Bibsys consortium. Within Oria, various user actions, such as searches and clicks on search filters are recorded, and aggregated statistical data can be accessed via Primo Analytics. This wealth of data provides new opportunities to analyze user interactions with current library catalogs, and to potentially improve digital access to library collections based on lessons learned.
To improve our understanding of the issues at play when users interact with library catalogs, we explore what types of queries users perform, determine how successful user queries are, and look at underlying reasons for unsuccessful queries. Hence, our main research questions are:
- Which insights can we gain from classifying user queries within Oria by their popularity, specificity and intended target resources?
- To what extent are the most popular user queries successful?
- Which underlying reasons for unsuccessful queries can be determined?
To address our research questions, we have done an analysis of data available from Primo Analytics for the University of Oslo. In particular, we looked at two datasets: the most popular queries (from January 2015 to September 2016), and the “zero-result” queries, i.e. the queries for which searches did not obtain any results (from August 2015 to September 2016).
In addition to a number of basic quantitative analyses, we manually annotated the 50 most popular queries in the dataset, accounting for a large degree of the total number of queries, as well as a random set of 50 zero-result queries. To further validate to what extent the queries were aimed at retrieving popular library materials, we performed cross-comparisons with a set of frequently loaned materials from Alma, the library’s resource management system.
Our conclusion is that the library catalog contains more than meets the eye: even though requested materials may be available in the library, they do not always show up on the first results page. In our analysis we observed a prevalence of queries related to users’ reading lists, but these queries frequently fail to get immediate results. This is caused both by issues in users’ query formulations, and by issues in system support. For instance, frequent user queries consist of pasted citations, which often do not fare well, while in other cases, minor spelling errors impede retrieval of certain items. This suggests the importance of improving system features assisting users in their library catalog searches. Using a variety of findings as a basis, we provide concrete recommendations for improving library catalogs and digital library services at large.
This paper presents results from a case study of community building practices on Twitter in Norwegian University Libraries, using a combination of a qualitative and a quantitative approach. The analysis aims to highlight how academic libraries tweet content that may build a community with two-way communication and engagement with researchers and students. Our research also sheds light on recent developments and current challenges in University Libraries use of Twitter in theory and practice, and give some critical perspectives on information literacy and digital library community engagement.
Methodology The dataset for this research is collected from the twitter timelines of the norwegian university libraries with a presence at Twitter. This is public available data. In addition to tweet content, the frequency of favoritemarking, retweets, answeres and hashtags are retrieved. There will also be a cathegorization of the group each of the libraries have chosen to follow.
Using five principles of Social Media Optimization (SMO), defined in the study “Social media optimization: making library content shareable and engaging” by Doralyn Rossmann and Scott W.H. Young (2015) the objectives will be analyzed accordingly: (1) create sharable content; (2) make sharing easy; (3) reward engagement; (4) proactively share; and (5) encourage use. These principles has been modified and updated from Bhargavas (2006, 2010) established principles of SMO (Rossmann and Young, 529:2015b), and in our paper we will apply and modify these concepts into ten norwegiean university libraries use of Twitter as a community building network. The outcome of this research is expected to give insight into effective community building methods and techniques for use in the university library community on Twitter.
Keywords library community building, engagement, social media, emerging technologies, information literacy, twitter
Bibliography • Bhargava, R. (2006) “5 rules of social media optimization (SMO)” Influential Marketing Blog, available at http://www.rohitbhargava.com/2006/08/5_rules_of_soci.html • Bhargava, R. (2010) “The 5 new rules of social media optimization (SMO)” Influential Marketing Blog, available at http://www.rohitbhargava.com/2010/08/the-5-new-rules-of-social-media-optimization-smo.html • Palmer, S. (2014) “ Characterizing University Library Use of Social Media: A Case Study of Twitter and Facebook from Australia. The Journal of Academic Librarianship. Vol. 40. p. 611-619. • Young, S.W.H. and Rossmann, D. (2015a). Building Library Community Through Social Media. Information Technology and Libraries. Vol.34. No.1. p. 20-37. • Young, S.W.H. and Rossmann, D. (2015b). Social media optimization: making library content shareable and engaging. Vol. 33. No. 4. p. 526-544