1 Brinley Franklin and Terry Plum August 18, 2005Successful Web Survey Methodologies for Measuring the Impact of Networked Electronic Services (MINES for LibrariesTM) Brinley Franklin and Terry Plum August 18, 2005

2 Overview Issues in Web-Based SurveysOpen Access – Beyond Vendor Supplied Data An Infrastructure of Assessment The Assessment Gateway MINES for LibrariesTM MINES for LibrariesTM in North American Libraries

3 Issues in Web-Based SurveysVendor Supplied Data International Standards for vendor supplied data (like Project Counter) are helpful and trusted Vendor supplied data tends to be gross usage counts Usage Surveys Can go beyond gross usage counts using sampling Have sets of issues that must be addressed (see, for example, Holly Gunn, “Web-based Surveys: Changing the Survey Process”, First Monday, Issue 7, 2002 and D.A. Dillman, Mail and Internet Surveys, The Tailored Design Method. 2nd ed., 2000)

4 Open Access -- Beyond Vendor Supplied DataISO standards for the electronic collection include e-books, electronic databases, ejournals, and digital documents. Free internet resources are counted separately. Other electronic resources are important, including: Digital libraries Pre-print and post-print servers Open access journals Open access repositories (e.g., institutional repositories)

5 An Infrastructure of Assessment

6 The Assessment Gateway

7 MINES for LibrariesTM MINES is a transaction-based research methodology consisting of a web-based survey form and a random moments sampling plan. MINES typically measures who is using electronic resources, where users are located at the time of use, and their purpose of use. MINES was adopted by the Association of Research Libraries (ARL) as part of the “New Measures” toolkit in May, 2003. MINES is different from other electronic resource usage measures that quantify total usage (e.g., Project COUNTER, E-Metrics) or measure how well a library makes electronic resources accessible (LibQual+TM).

8 MINES for LibrariesTM

9 Demographics by Location of User U.S. Main LibrariesMINES for Libraries™ Demographics by Location of User U.S. Main Libraries Inside the Library n = 9,172 On Campus, Not in the Library n = 6,391 Off-Campus n = 4,953

10 MINES for Libraries™ Demographics by Location of UserU.S. Medical Libraries On Campus, Not in the Library n = 19,582 Off-Campus n = 5,133 Inside the Library n = 6,819

11 MINES for LibrariesTM Demographics by Location of UserOntario Council of University Libraries On Campus, Not in the Library n = 7,090 Inside the Library n = 4,047 Off-Campus n = 9,163

12 Location of Electronic Resources UsersMINES for LibrariesTM Location of Electronic Resources Users U.S. Main Libraries Total Users n = 25,698 U.S. Medical Libraries Total Users n = 31,883 OCUL (Canada) Libraries Total Users n = 20,300

13 Successful Web Survey Methodologies for Measuring the Impact of Networked Electronic Services (MINES for LibrariesTM)