Reflecting on the digital story

image: jane challinor

Over the summer I have been working with colleagues at UIB on a paper outlining our adventures with digital storytelling. We reached a conclusion that whilst as a learning activity it had value in promoting collaboration and an awareness of open educational practices as well as developing digital skills, there are caveats about its use for developing reflective skills, particularly with students at the beginning of their university studies.

What we found, in broad terms is that more mature students are better at reflecting (that is they reflect more deeply). This has led me to conclude that as an activity designed to promote reflectivity - and especially as a reflective assessment tool - it is perhaps best left until the final year.

For me this was also borne out by the large number of first year students who failed to submit the digital story at the first (and even 2nd) attempt. This could just be a consequence of having a large number of student last year (ie we were just more likely to have students who had unrelated problems that prevented them from submitting) but in reality the module had the highest number of referred and non-submitting students across the course (around 10%) whereas in the past it has had the lowest incidence of non-submission and referral.

Well - I may be jumping the gun in putting this all down to the mode of final assessment, and it is certainly the case that the final year students all submitted and all passed - most at a high level, but it has certainly given me pause for thought.

Indeed I have already decided to change the mode of assessment for the first year module this year, reverting to a group research project which has worked well in the past. I will though run the same assessment for the final years.

Ok - but what did the first year students think? I am going to be giving a guest session on the second year research module later in the year and I have decided to use the digital storytelling project as my theme. I have therefore asked the students themselves to provide me with feedback on their experience of the final assessment last academic year - and I will feedback to them the findings of that survey.

So here's a sneak preview. I have had 52 responses so far out of a cohort of 126 (41%). Of these 90% are female (this reflects the makeup of the cohort) and 70% are aged 18-24.
23% are over 35 years old.

In creating their digital story, 70% used Prezi, 24% Powerpoint (12 students) and 6% another online tool - Knovio.  As a result of their experience, 75% said they are likely to use the same or another online tool in future for presentations and collaborative tasks. Just 28% (14 students) said they would only use PowerPoint going forward (suggesting that 2 students have tried online platforms and decided to revert to PowerPoint).

What did they get out of the experience?
78% thought it fun
57% thought it was technically challenging
85% said it had helped them to improve their reflective skills
82% said it had helped them improve their digital skills
80% thought it had given them confidence to create content on line
86% thought it relevant to their studies
but just 47% thought it relevant to their future career - and only 44% would mention this as a skill on their CV

Comments from the students expand a little on these results:

Positive and constructive feedback:

a. I feel like the digital story assignment was not quite challenging enough. It seemed to be more of an easy and fun task to complete . 

b. On reflection I should of challenged myself more. Been more adventures

c. I really enjoyed this assignment and it boosted my self confidence. I was very proud at what I had achieved and how much I had progressed.

d. I found the digital story difficult and daunting to begin with, but eventually enjoyed creating my story and proud that I did so.

e. Digital story was something I had usually done in the medium of film. I'm really glad we had this assignment as it opened my eyes to more digital platforms. I also think this would be a fantastic tool to use with certain more tech minded service users

f. It was very enjoyable, relevant to my studies, and gave you chance to create a bit of fun into studies rather than essays, it gave you a breather from the heavy work. Before I came to your lesson I did not know about Prezi but I will certainly use it again,

g. Enjoyable task however, talking in the video was a little tasking, a lot of preparation is needed for someone who lacks in confidence
__________________________________________________________________________________________

Negative feedback:
h. I think that it was completely pointless and irrelevant to our course. I don't know why we needed to do it personally, and I think that it should be scraped for the new people starting the course.


i. I just thought the story telling was irrelevant to what we needed to do most people didn't want to do it I perfer the other tasks this one was just too much



On the whole, the student response is a lot more positive than I had anticipated. Interestingly the two final, highly negative comments came from students in the 18-24 year old group. These were the only two completely negative responses, and even one of these (i) felt that her digital and reflective skills had improved as a result of the task. The more positive comments (c-f) came from the over 35's.

I do now have some regret about abandoning the reflective digital story this year. However, the use of digital tools to present the outcomes of research will form a large part of the final group project that they are engaged in this year. Hopefully, this will preserve the "fun" and creative elements of the assessment task as well as continuing to develop confidence in creating online content.

Digital Storytelling as an assesment tool: the students' view

The brief was to create "an account of your personal learning from the module, commenting and reflecting on your role in the group tasks and including your thoughts about your future career. This account will be produced as a “digital story” – a mix of images, voice narration, written words and music".

Later this was expanded and the following prompts were given:

What has been the most important/surprising/interesting/exciting thing you have learnt this year?
What happened? Who else was involved?
How did you feel about it at the time? How do you feel now?
What were the positives and negatives about the experience?
Can you relate this experience to any theory or research you know about (or could you research more into this type of thing?) (for example - you found yourself taking over as the leader of your group because no one else would: how does this relate to theory about emergent leadership? OR in your group you all had different ideas about what to do - how might this apply to multidisciplinary working in Health and Social Care?)
Overall, what do you conclude from this learning - how has it changed you as a person, changed your ideas?
Looking back, what do you now think about the values you selected in the first Photopeach exercise - would you still pick the same ones? What values or attitudes seem to be most important to you now?
If you had to do this year again, what would you do differently?
What tips would you give to another student about to start their final year?
Based on this experience, how might you plan to approach similar situations in the workplace?
What are your plans after graduating?

So what did the students make of digital storytelling as an approach to assessment?
One or two students have commented to me - in personal communications and in their introductions to their final portfolios - about the process of completing this assignment:

"I came into year three really worried and felt very overwhelmed, but learning how to reflect well has really allowed me to understand any flaws I have and how to improve on this for the future, especially when I go on to study my nursing MSc next September. I really have managed to grow and learn a lot about myself [when] previously I tried to avoid fears I had." (student A)

"the digital story was not a task I was particularly looking forward to as I have never done anything of the kind before, and do not enjoy recording myself! Having said this, it was probably one of my most enjoyable assignments and once I had started it and got into it I didn't actually feel as if I was doing work. The newly learnt skill of producing a digital video is not only one I can use when applying for jobs but also one I can use in my personal life, as I am an avid traveller and can now produce videos portraying my travels. " (student B)

"Creating a digital story was not an easy ask for me at all... Looking back at this digital story and realising that I am now able to create more different ones make me very proud.....The digital story gave me an opportunity to express myself through images. "(student C)

"I personally really enjoyed working on my digital story ... I think this is important to do so as it reminds the individual of changes they have gone through and [how]they have developed ...  I have videoed myself which was very hard as I can be shy talking in front of my camera. However, I have now overcome the fears of using a camera to video myself which I think is amazing ... this skill would be beneficial for my future career, as I may have to talk in front of patients and other professionals or create a presentation." (Student D)

 The following students have also given me permission to post their work here - I think it is possible from these examples to see the variety of responses - in terms of tools and platforms used, depth of reflection and themes - to the assignment brief. In my next post I'll talk more about the teaching and learning processes involved and the impact on me as the assessor. If you'd like to leave any comments here about the students' work, please do. I'm sure they'd enjoy the feedback :)

Sarah (imovie):

Gabrielle (movie maker):

Emily (Screencast-o-matic):

Anna (Knovio):
http://view.knowledgevision.com/presentation/6cf6975f38f14a6bb5b7c4c06141ac12


Amandip (PowerPoint): http://www.authorstream.com/Presentation/jchall00-2478010-leading-teams-reflective-story/ 

Mia (Prezi):

Digital storytelling - the process

image: pixabay

So the digital stories are now rolling in. Final year students on my course are all now engaged in producing their end-of-year reflections on learning.

I began the year/semester with the Photopeach video essay on professional identity and values. This had a dual purpose - introducing students to the concept of the digital reflection or story, using OER, and also familiarising them with a Web 2.0 content creation platform - a form of digital warm up.

The step up from this to the digital story is not inconsiderable - there is a narration/voice over required in this final work and the level of reflection should be higher and the content more personal - but the basic processes are the same, including the use of creative commons licensed images and music and hosting on a social platform.

To support my students in the development of their stories I have provided them with a range of resources, including a link to a really useful website - http://digitalstorytelling.coe.uh.edu/ which gives an overview of how to produce a digital story from storyboard through to video editing software and lots of examples to inspire them. I also gave them a free choice as to which platform to use and showed them examples using Prezi and Knovio. Other options include Screencast-o-matic and Windows Movie Maker.

I developed a rubric or set of assessment criteria based on Moon's stages of learning (see p6:  http://www.sussex.ac.uk/education/ctlr/documents/jenny-moon-workshop---reflection-in-higher-education-learning.docx ) which I shared with the students to help them understand the level of reflection that is expected.

I am hoping that the digital stories will yield a deeper or higher level of reflection because of the medium used. In previous years when asking the final year students to reflect on the group process and their learning from it, I have in the main received traditional, theory based essays written in the academic style. I was hoping that by asking for this to be spoken, rather than written, and to include images and music, there will be a greater emotional depth to the reflections.

So far the themes emerging from the final year students reflections over the course of their University careers are much as would be expected (or hoped!). Most frequently mentioned themes are their future career plans, increasing confidence, development of communication skills, the stress of studying, worries about academic ability, developing emotional resiliance, self organisation and time management skills and overcoming all of the fears associated with starting University  - moving away from home, fitting in and making friends. Developing independence, managing work/life balance and motivation are also mentioned by quite a few. Because our course places a major emphasis on it, it is not surprising that many refer to volunteering and work experience and remark upon the transferability of skills learned to future employment. Team work was actually the most frequently mentioned theme - but as my final year students are producing this assignment for a module on teamwork and leadership, this is hardly surprising.

A less common theme, but mentioned by some students from the BME community, is the ethnic diversity within the cohort, and the tendency for those from the African diaspora to stick together. The stories of refugees' journeys - running from civil war to higher education in the UK - were particularly moving. Similarly, the mature students on the course frequently refer to the age of students and feeling "too old for school" as one put it. Some students talk about their struggles with chronic illness, learning disabilities, being bullied at school, and being the first of their families to enter higher education.

I was struck by how this form of assignment gave a voice to some who generally are not very vocal in seminars. Indeed the less formal style of expression and the freedom to be creative seemed to allow some of these quieter students to really excel. The assessment criteria for this digital story is based mainly on depth of reflection and there were some surprisingly high levels from students who do not normally do well in the usual academic assignment. On the other hand, this creative format may have been less comfortable for those used to getting high grades in essays and reports: they seemed to stick to a more formulaic response that focused on academic skills and achievements rather than their personal development.

I have assessed the levels of reflection to some extent on how much the students engage in meta- reflection - commenting on the process of learning itself, rather than simply what they have learned, on their growing self awareness and their commentary on how the process of reflection aids this. The artefacts seem fairly evenly spread between three levels: (2) making sense (able to notice and organise material to develop a reflective narrative) (3) making meaning (linking this narrative to other perspectives - including theory - and evidencing an emerging awareness of their own part in it) and (4) working with meaning (an emerging understanding of the learning process itself and increased self awareness). No-one has been stuck at the level of merely noticing (level 1) - i.e. a purely descriptive account, as most have been able to at least add some form of evaluation of their experiences. But neither have I seen much evidence of a convincing Level 5 -  that of Transformative Learning. One student came close to this with some quite deep ruminating about the influence of friendships on the successful functioning of groups: I had a sense there of a radical shift in her thinking as she explored this.

In terms of platforms used and level of technical skills, the majority used Prezi with a voice over added at each step. Next in popularity was good old PowerPoint - again with a clip of narration added to each slide, followed by Knovio, which is basically a PowerPoint presentation uploaded to the internet and then a voiceover recorded.

Two or three students have created videos in a photostory format, one did an RSA-style speeded up drawing on a whiteboard and another used Screencast-o-matic, navigating through various documents whilst discussing them.

The level of technical skill demonstrated in producing these digital stories has been variable but all have managed to produce something at least functional, attractive and audible whilst the very best are brilliantly creative, witty and original.

Quite a few students in their evaluations of the past year actually cite this assignment as amongst their favourites - of course there is a sense in which they would say that, wouldn't they? but they haven't at the same time gone overboard in their praise of me or the module itself... they simply seem to have enjoyed this and the previous student led learning activity as "different" forms of assessment which tested and developed new skills that they also recognised as valuable in the field of employment.

 What about the impact on me as the marker? On a practical level, it is fairly quick and straightforward to watch a 5-10 minute video; trying to arrive at a level is less easy, even following the rubric I developed before hand, as it is hard to interpret what someone else has learned by listening to short accounts such as these, still harder to put any sort of "value" on that learning. Nevertheless it is no harder than trying to do the same with a 2000 word reflective essay and in many ways it is a good deal more engaging, as in listening to their stories I have felt as though I am in some way sharing their journeys. The use of images, music and voice to tell their story gives these reflective accounts much more emotional impact and in many cases they feel very intimate.

That may be why in most cases the students have not made their stories public but instead chosen PowerPoint or an unlisted url on YouTube. Where they have used Prezi or Knovio, most have disguised their identities and all have been anxious to be reassured that only I (and the external examiner) will get to see and hear their finished artefacts. There are though one or two that I would dearly love to use as "promo videos" to show prospective students and I am hoping that their authors can be persuaded to go public at some point. I am incredibly proud of what they have all achieved  - on many levels - and would love to share their labours with you too, dear reader!