1 Dr Anna Nunan Dr Alexander RunchmanStudent progress in academic literacy on a pre-sessional programme at an Irish university Dr Anna Nunan Dr Alexander Runchman

2 2 parts Student perspective and involvementStudent progress and challenges

3 Research on pre-sessional programmes focuses onAssessing students on pre-sessional programmes (Banerjee, 2006) Content and methods on pre-sessional programmes (Lynch, 2014) Dealing with outside assistance on assignments (Westbrook, 2015) Scaffolding academic writing (Seviour, 2015)

4 The student perspective is under-researchedThe student at the centre of the programme

5 Students on a pre-sessional programme

6 Research on student perspectivesMany students come onto PSPs with an idealistic view of the place they will establish in society (Jarvis, 2010) Students using English outside the classroom has been shown to be a key factor in student satisfaction with their study abroad experience – it may be possible to develop socio-cultural competence in order to support students in taking a more active role in their interactions (Copland, 2011)

7 Perception of English abilityStudents’ perceptions of their English ability are more important in measuring achievement than … scores in IELTS or TOEFL (Xu, 1991) The psychological feeling of incompetence is more debilitating than actual language ability (Chang, 2010)

8 Why study the student perspective?It is difficult to make progress if students are not aware of what to expect on a programme Progress is difficult if students are not sufficiently involved in the programme

9 Pre-sessional students

10 This research focused onStudent expectations of a pre-sessional programme Students’ prior English language learning experiences Student perspectives on a pre-sessional ‘developed for them’

11 Methodology 20 students were interviewed on arrival and at the end of the 10-week programme Questions related to reasons for doing a PSP, prior ELL, future English language use, etc. Qualitative analysis involved a conceptually clustered matrix approach

12 Findings Students do not have a clear sense of what a pre-sessional entails

13 A series of mismatches ‘My agent recommended it’‘I did not have good enough IELTS scores for direct entry’ ‘I studied Law in China but got into Media Studies here’

14 Finding 2 Students are aware of the shortcomings of prior ELL (You, 2004)

15 English classes ‘There were too many students’‘It was boring – I have to remember a lot of words’ ‘Students just want to pass the exams’

16 Teacher oriented classes

17 Finding 3 Students were very interested in the research approach to this study

18 Interest in research ‘I want to learn foreigner’s thought on research’‘We can use academic language for our research projects’ ‘At home we didn’t do our own research’

19 Holistic approach It is important to look at the students in the programme This involves their past, present and future

20 SLL as participation and the (re)construction of selvesSLL is a struggle of concrete socially constituted and always situated beings to participate in the symbolically mediated lifeworld of another culture (Lantolf, 2001)

21 Participation is importantA participation metaphor for SLL obliges us to think of SLL as a process of becoming a member of a community (Pavlenko, 2000)

22 Imagined communities Membership in “imagined communities” affects learning trajectories (Pavlenko, 2007) Identity theorists question the view that learners can be defined in binary terms as motivated or unmotivated, introverted or extroverted (Norton, 2013) A learner can be highly motivated to learn a language, but not necessarily invested in a set of practices (Norton, 2013)

23 Involve the student Becoming part of an academic community

24 Academic community Student involvement, negotiated syllabus, research projects, disciplinary focus

25 Part 2: Student Progress and ChallengesListening

26 Student progress following a pre-sessional programme‘students, irrespective of subject studied, who undertake a top-up course in English do notably poorer than students who arrive with either an acceptable IELTS score for their programme of study, or with other appropriate English language qualifications.’ (Thorpe et al, 2017)

27 ‘This suggests one of two things‘This suggests one of two things. Either the top-up courses undertaken do not bring the student up to the expected IELTS entry score, and/or that these students are in some way inherently weaker academically in any case—and this contributed to their low IELTS score in the first place.’ (Thorpe et al, 2017)

28

29 Two inferences can be drawn from this:Students had not anticipated the demands of academic listening. Many of them were not able to adapt to these demands within the constraints a 5- or 10- week pre-sessional programme. The construct validity of our assessment may need reconsideration. Is our assessment a fair reflection of students’ capability? What should be tested on a pre-sessional programme in terms of listening?

30

31

32

33

34

35 Test-wise strategies ‘the strategies and tactics adopted by native and non-native speakers of English in the IELTS Listening module are not significantly different’ Badger and Yan (2012, a) .

36 ‘To what extent is communicative language teaching a feature of IELTS classes in China?’Attempting to account for teacher-centredness and use of L1: Language schools are commercial organizations seeking to satisfy students and parents who are more familiar with traditional teaching styles ‘the majority of teachers in IELTS preparation programs are non-native speakers of English’ There is a ‘lack of teacher development in IELTS preparation’ (Badger and Yan, 2012 b)

37 Self-appraisal In a sample of 376 students taken from two institutes in Sydney, Australia ‘test-takers were likely to be overconfident in their [IELTS Listening] test performance, particularly in difficult test questions’ (Phakiti, 2016)

38 Field’s proposals for greater authenticityReal-life lectures include: Handout material PowerPoint slides Facial expression and gestures of the lecturer The tendency of the lecture mode towards redundancy in the form of repetition and rephrasing. ‘innovation is likely to prove necessary at some stage if the test is to increase its validity as a predictor of actual lecture-listening behaviour’ (Field, 2016)

39 Factors influencing listeningListening development is a complex area to which many different factors contribute. Quite apart from the very varied ways in which individuals respond to the challenge of L2 listening, there are considerations such as distance of L2 from L1, familiarity with western pattern of logic, extent of integration into the host community, motivation, grasp of the discipline being studied and the communicative imperative felt by the listener. All this suggests that any longitudinal research will need to reply to a whole series of case studies. There seems to be scope for a great deal of investigation in this area in years to come (Field, 2016)

40 References (1) Banerjee, J., & Wall, D. (2006). Assessing and reporting performances on pre-sessional EAP courses: Developing a final assessment checklist and investigating its validity. Journal of English for Academic Purposes, 5(1), Badger, R., & Yan, X. (2012, a). The use of tactics and strategies by Chinese students in the Listening component of IELTS. In L. Taylor & C. Weir (Ed.) IELTS Collected Papers 2: Research in Reading and Listening Assessment (pp ). Cambridge: Cambridge University Press. Badger, R., & Yan, X. (2012, b). To what extent is communicative language teaching a feature of IELTS classes in China? In J. Osborne (Ed.) IELTS Research Reports (pp. 1-44). IDP: IELTS Australia and British Council. Chang, C. E., & Strauss, P. (2010). ‘Active agents of change?’ Mandarin-speaking students in New Zealand and the thesis writing process. Language and Education, 24(5), Copland, F., & Garton, S. (2011). ‘I felt that I do live in the UK now’: international students’ self-reports of their English language speaking experiences on a pre-sessional programme. Language and Education, 25(3),

41 References (2) Field, J. (2016). The cognitive validity of the lecture-based question in the IELTS Listening Paper. In L. Taylor & C. Weir (Ed.) IELTS Collected Papers 2: Research in Reading and Listening Assessment (pp ). Cambridge: Cambridge University Press. Feast, V. (2002). The impact of IELTS scores on performance at university. International Education Journal 3(4), Jarvis, H., & Stakounis, H. (2010). Speaking in Social Contexts: Issues for Pre-Sessional EAP Students. TESL-EJ, 14(3), n3. Lantolf, J. P., & Pavlenko, A. (2001). (S) econd (L) anguage (A) ctivity theory: Understanding second language learners as people. Learner contributions to language learning: New directions in research, Lynch, T. (2014). Developing a pre-sessional English language course for international distance learning students: a case of E-volution. In INTED2014 Proceedings (pp ). IATED. Norton, B. (2013). Identity and language learning: Extending the conversation. Multilingual matters.

42 References (3) Pavlenko, A., & Lantolf, J. P. (2000). Second language learning as participation and the (re) construction of selves. Sociocultural theory and second language learning, Phakiti, A. (2016). Test-takers’ performance appraisals, appraisal calibration, state-trait strategy use, and state-trait IELTS listening difficulty in a simulated IELTS Listening test. IELTS Research Report Series, 6, Pavlenko, A., & Norton, B. (2007). Imagined communities, identity, and English language learning. In International handbook of English language teaching (pp ). Springer US. Seviour, M. (2015). Assessing academic writing on a pre-sessional EAP course: Designing assessment which supports learning. Journal of English for Academic Purposes, 18, Thorpe, A., Snell, M., Davey‐Evans, S., & Talman, R. (2017). Improving the Academic Performance of Non‐native English‐Speaking Students: the Contribution of Pre‐sessional English Language Programmes. Higher Education Quarterly, 71(1), 5-32.

43 References (4) Westbrook, C., & Holt, P. (2015). Addressing the problem of outside assistance in pre-sessional writing assessments. Journal of English for Academic Purposes, 18, Xing, M., Wang, J., & Spencer, K. (2008). Raising students’ awareness of cross-cultural contrastive rhetoric in English writing via an e-learning course. Language Learning & Technology, 12(2), Xu, M. (1991). The impact of English-language proficiency on international graduate students' perceived academic difficulty. Research in Higher Education, 32(5), You, X. (2004). “The choice made from no choice”: English writing instruction in a Chinese University. Journal of Second Language Writing, 13(2), Zou, B. (2013). Teachers' support in using computers for developing students' listening and speaking skills in pre-sessional English courses. Computer Assisted Language Learning, 26(1),