Building Students' Research Skills - Reflections

An unintended consequence of the Undergraduate Research Conference we ran in April is that it is being held up as an example (within my University at least) of how we can prepare and support BTEC students in their transition to University AND of widening participation.

I say unintended because the original plan was simply to try and get our existing students engaged in research. Inviting local colleges to participate - especially those in disadvantaged areas - and focusing on current BTEC students ticked the boxes around widening participation for our Schools Colleges and Community Outreach team, but the focus on research skills also provided extra study skills support for those current undergraduates with a BTEC background.

I was invited (along with my colleague Sarah Barkley from SCCO) to talk about the event at a recent BTEC Symposium - here is the Prezi:

Engaging with Feedback

http://mindinbexley.org.uk/feedback/

It's a common complaint of teaching staff that they spend hours carefully crafting feedback only to have students ignore it - especially first and second years. I know in my own team we have discussed this endlessly, raised it in course committees, berated students in class, introduced the topic into tutor groups....

This year I think I may have accidentally hit on something. Students in year 1 have just finished a group presentation which is worth 30% of their final grade and is the precursor to a more in depth piece of work that results in an academic research poster (and undergraduate mini-conference: more of that later!)

Feedback on their presentation was virtually instantaneous: I typed it up as they presented and published the feedback on the VLE a couple of hours later. Naturally they all immediately looked to see what grade they had received.

Then in this week's class I gave them an exercise to do on using Gibbs' reflective cycle. Principally, my intention was to get them to think about how they had performed as a team. I know the process of working in a group was very difficult for some individuals and I wanted to get some feedback from the majority on how it had gone. However, in their reflections they also took the opportunity to READ THE FEEDBACK I had given them and to use that to think about how they could improve their presentation and communication skills going forward.

A key factor in this is that I had given them another two weeks after their presentation to work on and formally submit their PowerPoint or Prezi, thereby potentially improving their grade. This has also stimulated them to read and understand the feedback they have been given. I think another factor not to be ignored is that they performed their presentations in front of one another and they were able to learn from this how other groups had approached the task. One of the problems with tutor/student dialogue is that it is most often private: other students rarely see how their peers perform and don't know how to judge themselves against any benchmark other than the grading criteria. As well as socially constructed learning at the level of knowledge and understanding, these types of group based public assessments can help to construct a shared understanding of practical approaches and skills.

I have done an activity along these lines with the final year students for the past couple of years: following on from their student-led learning activities, each group reflects on a) the group process b) the feedback from me c) the evaluations provided by their peers and d) their own evaluation of how the session went, and they then present this evaluation as an assessed submission.

The reflective exercise I did with the first years was not assessed but it certainly yielded some interesting comments:

On "what I would do differently next time", they said:

"do more research"
"have note cards instead of reading from the screen"
"less text and more images on the slides"
"use our personal experience to give examples"
"add citations"
"speak slowly and loudly"
"use academic journals instead of websites"
"include statistics"
"be more organised and don't start at the last minute"
"arrange more team meetings"

Ah! music to my ears......now lets just hope they put it all into practice!

Digital storytelling - the process

image: pixabay

So the digital stories are now rolling in. Final year students on my course are all now engaged in producing their end-of-year reflections on learning.

I began the year/semester with the Photopeach video essay on professional identity and values. This had a dual purpose - introducing students to the concept of the digital reflection or story, using OER, and also familiarising them with a Web 2.0 content creation platform - a form of digital warm up.

The step up from this to the digital story is not inconsiderable - there is a narration/voice over required in this final work and the level of reflection should be higher and the content more personal - but the basic processes are the same, including the use of creative commons licensed images and music and hosting on a social platform.

To support my students in the development of their stories I have provided them with a range of resources, including a link to a really useful website - http://digitalstorytelling.coe.uh.edu/ which gives an overview of how to produce a digital story from storyboard through to video editing software and lots of examples to inspire them. I also gave them a free choice as to which platform to use and showed them examples using Prezi and Knovio. Other options include Screencast-o-matic and Windows Movie Maker.

I developed a rubric or set of assessment criteria based on Moon's stages of learning (see p6:  http://www.sussex.ac.uk/education/ctlr/documents/jenny-moon-workshop---reflection-in-higher-education-learning.docx ) which I shared with the students to help them understand the level of reflection that is expected.

I am hoping that the digital stories will yield a deeper or higher level of reflection because of the medium used. In previous years when asking the final year students to reflect on the group process and their learning from it, I have in the main received traditional, theory based essays written in the academic style. I was hoping that by asking for this to be spoken, rather than written, and to include images and music, there will be a greater emotional depth to the reflections.

So far the themes emerging from the final year students reflections over the course of their University careers are much as would be expected (or hoped!). Most frequently mentioned themes are their future career plans, increasing confidence, development of communication skills, the stress of studying, worries about academic ability, developing emotional resiliance, self organisation and time management skills and overcoming all of the fears associated with starting University  - moving away from home, fitting in and making friends. Developing independence, managing work/life balance and motivation are also mentioned by quite a few. Because our course places a major emphasis on it, it is not surprising that many refer to volunteering and work experience and remark upon the transferability of skills learned to future employment. Team work was actually the most frequently mentioned theme - but as my final year students are producing this assignment for a module on teamwork and leadership, this is hardly surprising.

A less common theme, but mentioned by some students from the BME community, is the ethnic diversity within the cohort, and the tendency for those from the African diaspora to stick together. The stories of refugees' journeys - running from civil war to higher education in the UK - were particularly moving. Similarly, the mature students on the course frequently refer to the age of students and feeling "too old for school" as one put it. Some students talk about their struggles with chronic illness, learning disabilities, being bullied at school, and being the first of their families to enter higher education.

I was struck by how this form of assignment gave a voice to some who generally are not very vocal in seminars. Indeed the less formal style of expression and the freedom to be creative seemed to allow some of these quieter students to really excel. The assessment criteria for this digital story is based mainly on depth of reflection and there were some surprisingly high levels from students who do not normally do well in the usual academic assignment. On the other hand, this creative format may have been less comfortable for those used to getting high grades in essays and reports: they seemed to stick to a more formulaic response that focused on academic skills and achievements rather than their personal development.

I have assessed the levels of reflection to some extent on how much the students engage in meta- reflection - commenting on the process of learning itself, rather than simply what they have learned, on their growing self awareness and their commentary on how the process of reflection aids this. The artefacts seem fairly evenly spread between three levels: (2) making sense (able to notice and organise material to develop a reflective narrative) (3) making meaning (linking this narrative to other perspectives - including theory - and evidencing an emerging awareness of their own part in it) and (4) working with meaning (an emerging understanding of the learning process itself and increased self awareness). No-one has been stuck at the level of merely noticing (level 1) - i.e. a purely descriptive account, as most have been able to at least add some form of evaluation of their experiences. But neither have I seen much evidence of a convincing Level 5 -  that of Transformative Learning. One student came close to this with some quite deep ruminating about the influence of friendships on the successful functioning of groups: I had a sense there of a radical shift in her thinking as she explored this.

In terms of platforms used and level of technical skills, the majority used Prezi with a voice over added at each step. Next in popularity was good old PowerPoint - again with a clip of narration added to each slide, followed by Knovio, which is basically a PowerPoint presentation uploaded to the internet and then a voiceover recorded.

Two or three students have created videos in a photostory format, one did an RSA-style speeded up drawing on a whiteboard and another used Screencast-o-matic, navigating through various documents whilst discussing them.

The level of technical skill demonstrated in producing these digital stories has been variable but all have managed to produce something at least functional, attractive and audible whilst the very best are brilliantly creative, witty and original.

Quite a few students in their evaluations of the past year actually cite this assignment as amongst their favourites - of course there is a sense in which they would say that, wouldn't they? but they haven't at the same time gone overboard in their praise of me or the module itself... they simply seem to have enjoyed this and the previous student led learning activity as "different" forms of assessment which tested and developed new skills that they also recognised as valuable in the field of employment.

 What about the impact on me as the marker? On a practical level, it is fairly quick and straightforward to watch a 5-10 minute video; trying to arrive at a level is less easy, even following the rubric I developed before hand, as it is hard to interpret what someone else has learned by listening to short accounts such as these, still harder to put any sort of "value" on that learning. Nevertheless it is no harder than trying to do the same with a 2000 word reflective essay and in many ways it is a good deal more engaging, as in listening to their stories I have felt as though I am in some way sharing their journeys. The use of images, music and voice to tell their story gives these reflective accounts much more emotional impact and in many cases they feel very intimate.

That may be why in most cases the students have not made their stories public but instead chosen PowerPoint or an unlisted url on YouTube. Where they have used Prezi or Knovio, most have disguised their identities and all have been anxious to be reassured that only I (and the external examiner) will get to see and hear their finished artefacts. There are though one or two that I would dearly love to use as "promo videos" to show prospective students and I am hoping that their authors can be persuaded to go public at some point. I am incredibly proud of what they have all achieved  - on many levels - and would love to share their labours with you too, dear reader!

Professional Values: the video(s)

Photo: Sarah Metherell http://photopeach.com/album/d59yl3

I have taken a new approach to my final year module (Leading Teams) this year. For the past 4 years that I have taught it, I have used a project based approach which has multiple facets.

First the students must work in teams of 6-8 students to develop a digital artefact (a website or wiki most often) which has as it's theme the leadership characteristics of the protagonists in a popular film. Over the years the students have analysed Avatar, The Lion King (twice), Toy Story (so many times I had to ban it last year), Twelve Angry Men, and even Matilda.

Theoretical underpinnings for the artefacts are generally drawn from lecture material I produce, seminar discussions and of course text books and articles highlighted in the module reading list. However, a great deal is based on the independent research that the students carry out themselves.

The artefacts produced have ranged in levels of sophistication but generally there has been enough complexity in the task to ensure that all group members get to use their individual talents: some taking on the "techy" roles, others researching or writing, and some surprising themselves as they have emerged as leaders through the process. The students' own reflections on these projects (part 2 of the task) have been an eye opener for them as much as for me.

Student feedback over the years indicates that, increasingly, the students find this less and less challenging technically - and intellectually - so this year the assessment will be based on student-led learning activities. Groups of 5 or 6 have been formed and each has selected a topic which they are going to teach to their fellow students. Apart from two mini lectures introducing the module themes, my input has been minimal. My lecture material and the references are available, but the emphasis is on student-directed research. When students do the teaching  is a short and helpful post about peer to peer teaching (with a great student-produced maths video!).

A more academic discussion of the approach can be found here: David Boud , Ruth Cohen & Jane Sampson (1999) Peer Learning and Assessment, Assessment & Evaluation in Higher Education, 24:4, 413-426,

_________________________________________

As a warm up exercise this year, I gave the students the task of creating short slide show videos - using Photopeach - on the values of a health and social care professional (as I have for the first year students see: Reflection on Professional Identity). The purpose of this was to prepare them to a) learn how to source copyright free images b) create impactful presentations using few words and strong images c) articulate their own values in relation to potential career options on graduating. (This final point relates to the part of the module that looks at career planning and job applications).

All groups approached the task with commitment and there have been some outstanding results.

Here are some of my favourites:

Health and Social Care Values (created with students' own photos)

Social Work

Childcare 

The difference we wish to make 

Why we chose this course..

(with thanks to Gemma Tur Ferrer for the original idea!)

Digital by design

The first two weeks of term have flown by already and the digital story telling project is underway. Using Photopeach to create a simple video with music and captions, the students are busy creating a digital essay on "professional values".

Last year I spent a lot of time explaining the importance of digital skills to my students and pointedly taking them step by step through a number of tools and processes. This year I am adopting a more immersive approach.

In the process of creating this digital essay, students are indirectly learning a number of other skills  - from searching for, downloading, saving and uploading images, to understanding Creative Commons licenses and avoiding copyright restrictions. They also learn how to: access and edit Google Docs to enrol themselves in project groups, share ideas on Discussion Boards, familiarise themselves with the Mac keyboard layout and touch pad gestures, create and save office documents and send them as attachments to emails, take a photo of their whiteboards and upload these to the Facebook group page etc.

We sometimes blithely assume that most students can easily tackle all of these processes, but I have spent a lot of time in the workshops sitting alongside some as they struggle with these tasks, often for the first time.

And let's not forget the really fundamental skill of learning to work together in groups - something that is fraught with anxiety for most students. Even if, as in the case of this project, groups are self selecting and based on early friendship alliances, there are still some students who find it hard to easily fit in a group and, once there, understand how they could or should contribute.

The positive thing for me about the Scale Up workshop is the space it gives me to move around the groups, checking on progress as needed - especially now that I have a two hour workshop with fewer students (well, there are still scheduled to be 60-70 in each workshop, so "smaller" is relative!)

For the first three weeks I also have the luxury of a co-tutor which really helps when students are asking for support on technical issues. 

Well.... so far, so good. I can't wait to see the outputs from this first assignment and to follow up with students on how they see their progress in developing their digital skills.

#FutureEd Learning from my students

OK -this isn't empirical research and it isn't statistically significant, but I had an encounter today with four students which stopped me in my tracks and caused me to rethink my approach to rethinking assessment.

Assessment is a big theme at the moment  - it was the focus of the FutureEd mooc last week, its a matter of debate on the course I teach on, it's also the theme of an assignment my daughter is writing for her PGCE.

I have been really interested in Cathy Davidson's discussion of assessment in her book Now You See It and that in itself has been causing me to rethink a module I teach and how the assessment can be made more pertinent to real skills needed in the workplace and in life.

At the same time I had a worry that assessment methods were becoming a little unbalanced in our first year of the course with quite a strong leaning towards group work at the expense of individual assignments.

Group work is notoriously difficult to assess and often unpopular with students who may feel they are a) doing more than their fair share of work to make up for the loafers and b) missing out on good grades because of poor quality input from others.

Concerns about the quality of students' writing and referencing in years 2 and 3 also caused me to think about introducing more individual, essay-type assessment in the first year in order to try and improve these skills.

But the group that came to see me today, to discuss a first year group assignment I have set, really sold me the idea of group work - particularly for first year students. These four students have worked together in every module requiring a group project and have got to know one another well. One of their number had not studied the subject in college so she was benefiting from the knowledge of the others in getting to grips with the course. Another had come from a completely different education system in a different country so he was also learning from his fellow students - on the other hand, he had years of practical experience working in mental health so he was contributing that. A third student had recently completed an access to HE course so was confident with referencing and research skills and was teaching her friends!

All in all it's a combination that works beautifully and through their working together they have become friends, feel really engaged with the course and have grown in confidence. I realise that other students may be having different - less positive - experiences but if group work can help students engage and learn together, and if they can reap such enhanced benefits from working together across more than one module,  this assessment strategy may actually be the best one we have come up with yet!