1 Sulis Usage Snapshots of Evaluation Angelica Risquez T&T CoP Showcase Day March 16th 2011

2 Background Adopted in 2006 as institutional choice of learning management system (LMS) Voluntary adoption (sites unpublished by default) ~2,400 module sites published so far (currently ~ 30% of all modules, plus hundreds of sites creating manually) Over 2.5 million visits registered

3 Number of staff/research postgraduates*Background (2) Number of staff/research postgraduates* * No data is available for 2007.

4 Number of students/taught postgraduates*Background (3) Number of students/taught postgraduates* * No data is available for 2007.

5 Evaluation Student evaluation (ULREC No. 08/43), anonymous online survey* 2008: n=483 2011: n=977 LMS review process (end 2009) Online survey to UL teaching community Personal narratives by members of taskforce * Built in collaboration for national study on LMS in Ireland, Cosgrave et al. (2009): Uptake and Usage of Virtual Learning Environments: Findings from a multi institutional student usage survey. AISHE,

6 Results: Student FeedbackYear of study 2008 The profile of students replying to the survey was similar in both years, with first year students overrepresented 2011

7 Results: Student FeedbackHow often do you use Sulis? 2008 The pattern of use has increased in frequency, students are much more reliant on the LMS 2011

8 Results: Student FeedbackWhere do you access Sulis? 2008 Accessibility has improved as more students access the LMS from home and from laptops, use of mobile devices has increased a bit and while access in computer labs has decreased 2011

9 Results: Student FeedbackHow many of your modules are in Sulis? 2008 The pattern of use has increased in frequency, students are much more reliant on the LMS 2011

10 Results: Student Feedback2008

11 Results: Student Feedback2011 Increased satisfaction with the system overall

12 Results: Student FeedbackWhat are the benefits of using Sulis to you? 2008 No significant change on the use of the LMS, seems to point to a widespread use of the LMS as a content repository over interactive features, with coincides with findings at national level and from international literature. When asked about the use of each of the tools we get a similar picture, with Resources being the most commonly used. 2011

13 Results: Student Feedback2008 2011 Next we present some interesting variables

14 Results: Student Feedback2008 2011

15 Results: Student Feedback2008 2011

16 Results: Student Feedback2008 2011

17 Results: Student Feedback2008 2011

18 Results: Student Feedback2008 2011

19 Results: Student FeedbackWhat is the most effective way to get help with Sulis? 2008 2011

20 Results: Faculty Survey (1)Online survey to UL teaching community September-October 2009 146 respondents: 54.6% of respondents are Sulis users (representing ~50% of all current Sulis users) 27% of respondents are SharePoint (previously public folders) users 19% of respondents are Moodle users

21 Results: Faculty Survey (2)N=125

22 Results: Faculty Survey (4)N=133

23 Results: Faculty Survey (5)N=96

24 What next? LMS taskforce continues review, no immediate migrations foreseen Strategic direction to come through the new e-Learning Taskforce