Computing Services - University of York

Computing Services - University of York

9th Northumbria International Conference 22-25 August 2011 University of York The Library Impact Data Project: hit, miss or maybe Graham Stone Information Resources Manager http://eprints.hud.ac.uk/10210/ #lidp #jiscad

This work is licensed under a Creative Commons Attribution 3.0 Unported License Using Usage Data since 2005 to improve existing services to gain insights into user behaviour to measure the impact of the library do the students who use the library the most get the highest grades?

Discussing Open Data JISC TILE Project meeting (Jun 2008) 3 Non/Low Use Project digging deeper into data 4

Measuring Library Impact 2008/9 honours graduates Analysis of the results consistently revealed a correlation between e-resource use, book borrowing and student attainment This appears to be the case across all disciplines Results

Not a cause and effect relationship Never proven statistically significant Potential for collaboration on future projects http://www.flickr.com/photos/atoach/3344411469/ JISC Activity Data Call

Obtained funding from the JISC Activity Data Call 6 month project (FebJul 2011) Defining Using Usage JISC Activity Data Programme User activity data record of a users actions on a website or software system or other relevant institutional service

Attention data record of what a user has viewed on a website or software system or other relevant institutional service http://bit.ly/g6S5wH Library Impact Data Project To prove the hypothesis that There is a statistically significant correlation across a

number of universities between library activity data and student attainment Data requirements For each student who graduated in a given year, the following data was required:

Final grade achieved Number of books borrowed Number of times e-resources were accessed Number of times each student entered the library, e.g. via a turnstile system that requires identity card access School/Faculty Legal issues Consultation with JISC Legal, University legal officer and

data protection officer Ensured that any identifying information is excluded before it is handled for analysis Excluded any small courses to prevent identification of individuals e.g. where a course has less than 35 students and/or fewer than 5 of a specific degree level Received guidance from the Using OpenURL Activity Data Data issues

Anticipated that there could have been problems in getting enough data to make the project viable Potential partners were asked to confirm that they could provide at least 2 of the 3 measures of usage as well as student grades Library Impact Data Project book loans (2009/10) Library Impact Data Project book loans & Athens (2009/10)

Library Impact Data Project library PC logins & visits (2009/10) Can we prove the hypothesis? Hit, miss or maybe? Due to the data not being continuous, a correlation cannot be calculated

http://www.flickr.com/photos/jepoirrier/2043728206/ Further statistical tests (1) Running a Kruskal-Wallis test to indicate whether there is a difference between values e.g. between levels of e-resource usage across degree results

THEN we analyse the data visually to check which variables to compare Further statistical tests (2) Running a the Mann-Whitney U test to see whether there is a significant difference between variables tested Matching these findings with previous tests using ANOVA and the Student T test

Can we prove the hypothesis? Hit, miss or maybe? That the relationship and variance means that you can believe what you see And you can believe it across a range of data, e.g. subjects So library usage does impact on students

attainment a t No s u ca d

n ea p i h s n o i t

a l e r t c e f ef 100

83 80 70 65 60 60

45 41 40 30 20

0 1 2:1 MetaLib logins 2:2 books borrowed http://www.flickr.com/photos/biggaypat/10431691/

3 27 Linking back to non/low usage Our research shows that for books and eresource usage, there appears to be a statistical significance across all partner libraries If we know that there is a link between usage and attainment We can link this back to non/low usage

Measuring Library Impact 2008/9 library visits 15.5% of students who gained a 1st never visited the library 34% of students who gained a 3rd never visited the library 22

Measuring Library Impact 2008/9 MetaLib usage 10.5% of students who gained a 1st logged in more than 180 times 23 Measuring Library Impact 2008/9 book loans

15% of students who gained a 1st never borrowed a book 34% of students who gained a 3rd never borrowed a book 24 Profiling non/low users Flesh out themes from the focus groups to advise on areas to work on Check the amount and type of contact subject teams have had

with the specific courses to compare library teaching hours to attainment Baseline questionnaire or exercise for new students To establish the level of information literacy skills for new students Target our users by concentrating staff resources at the right point Focus Group coding Further work

Gender, socio-economic background and nationality? What types of data are needed by library directors, e.g. for the scenario if budget cuts result in less resources, does attainment fall? We are keen to see if we add value as a library through better use of resources Scenarios Does a student who comes in with high grades leave with high grades? If so why? What do they use that makes them so

successful? What if a student comes in with lower grades but achieves a higher grade on graduation after using library resources? What did they do to show this improvement? Quite often students who look to be heading for a 2nd drop to a 3rd in the final part of their course, why is this so? What about high achievers that dont use our resources? What are they doing in order to be successful and should we be adopting what they do in our resources/literacy skills sessions? Acknowledgements

Dave Pattern and Bryony Ramsden Phil Adams, Leo Appleton, Iain Baird, Polly Dawes, Regina Ferguson, Pia Krogh, Marie Letzgus, Dominic Marsh, Habby Matharoo, Kate Newell, Sarah Robbins, Paul Stainthorp Thank you http://library.hud.ac.uk/blogs/projects/lidp/

http://eprints.hud.ac.uk/10210/ Graham Stone [email protected] @Graham_Stone This work is licensed under a Creative Commons Attribution 3.0 Unported License

Recently Viewed Presentations

  • On-Board Diagnostics (OBD-II) Port

    On-Board Diagnostics (OBD-II) Port

    Location of Connector. Driver's side foot-well. No higher than the bottom of the point where the steering column exits the instrument panel when at the lowest adjustable position. Securely mounted to the vehicle. Face of the vehicle connector . pointing...
  • Logic and Philosophy Alan Hausman PART ONE Sentential

    Logic and Philosophy Alan Hausman PART ONE Sentential

    Any argument of the same form as a valid argument is itself valid. 4. Truth and Validity A deductively valid argument can have a false conclusion if one or more of its premises are false. An invalid argument can have...
  • Prefixes - Pacoima Charter Elementary School

    Prefixes - Pacoima Charter Elementary School

    Prefixes reading standard=1.8 Use knowledge of prefixes to determine the meaning of words. Today we are going to use prefixes to determine the meaning of words.
  • Introduction to Linguistics - Arif Awaludin's Notes | Catatan ...

    Introduction to Linguistics - Arif Awaludin's Notes | Catatan ...

    langue, the language system of a speech community. langue. denotes a system of internalised, shared rules governing a national language's vocabulary, grammar, and sound system; Parole. designates actual oral and written communication by a member or members of a particular...
  • School Improvement Grant

    School Improvement Grant

    School Improvement Grant for 2018-2019 CSI Schools @EducateIN. Planning Funds accepted Fall 2018. Compete for up to additional $200,000 Implementation Funding (Single School or LEAs with 4+ CSI schools) Application due by October 18, 2019 for review and approval. Single...
  • SOCIAL PROBLEMS SOCIAL TOPICS - Napa Valley College

    SOCIAL PROBLEMS SOCIAL TOPICS - Napa Valley College

    Structural Mobility. Occurs when social changes cause many people to change social status simultaneously. Exchange Mobility. Suggests that within the United States, each social class contains a relatively fixed number of people
  • Peithō on Trial: Aeschylus' Oresteia

    Peithō on Trial: Aeschylus' Oresteia

    Aeschylus' Oresteia Persuasion and revenge. Agamemnon. Libation Bearers. Persuasion and justice. Eumenides. 2-Feb-17. Agamemnon. for aeschylus' oresteia charts a progression from a dysfunctional, tyrannical, problematic peitho to a supposedly just, democratic version of same:
  • Factors, Primes and Composites 7 = 17 29

    Factors, Primes and Composites 7 = 17 29

    Write the prime factorization of numbers. Prime factorization: a. way that is used to write composite numbers as a product of primes. 36. 2. 18. 2. 9. 3. 3. Circle the prime numbers. 36 = 2 2 3 3. 36...