Our paper on the project has now been published. This gives a good overall summary of the project, the rationale for the underpinning design and the analysis of the evaluation project. The paper is published in Chemistry Education Research and Practice, which is free to read (although you may need to register). The paper should be open access in the next few weeks (i.e. no registration necessary). Enjoy!
This week was D-Day…Week; we had our first years completing their lab skills lab. If you want to try what we did, I’ve linked everything below.
Each student had to:
prepare in advance for the lab by:
completing a pre-lab survey (this is for the associated research project)
watch the pre-lab videos;
complete the techniques in the lab while
being videoed on their phone for two techniques and
completing peer review forms for three techniques;
after the lab they had to
Upload their video to labs afterwards to a video sharing site;
Submit the video links for review.
Overall it seemed to go well. There’s quite a lot to unpack, and having spent every spare moment this week reviewing the titration videos, I haven’t much more energy to say a lot beyond that. But I can say while I was expecting chaos and to be running around the lab coralling students, it just ran like any other lab. Students had something to do. They did it.
Feedback takes two forms.
Students get feedback on their technique via the VLE. This involves watching their videos and giving individual feedback. It is very time consuming, but offers a very rare opportunity to provide specific technique feedback to students. I will be able to build up a good assessment checklist now having gone through lots of them, which is exactly what Marcy Towns said would happen when she described her own implementation.
Students also get feedback on their peer review forms. This gives them feedback on number of decimals recorded, calculations, and significant figures. It was done en masse using mail merge and some Excel formulae under the bonnet, which again means you can give some very individualized feedback, but this time quite easily. (Love mail merge!)
We are counting down now to our final days before our students complete their lab badges skills. Just over a week to go! To move things along, we have gotten the badge back from the designer and they look really great! I’m thinking of making these flyers to try to summarise to students what it is they are all about.
Over the summer we have been working on a lab skills badging project. Lots of detail is on this site, but briefly this is what it’s about:
Experimental skills are a crucial component of student laboratory learning, but we rarely assess them, or even check them, formally. For schools, there is a requirement to show that students are doing practical work.
By implementing a system whereby students review particular lab techniques in advance of labs, demonstrate them to a peer while being videod, reviews the technique with a peer using a checklist, and uploads the video for assessment, we intend that students will be able to learn and perform the technique to a high standard.
I am looking for school teachers who would like to try this method out. It can be used to document any lab technique or procedure you like. You don’t necessarily need an exemplar video, but a core requirement is that you want to document students laboratory work formally, and acknowledge achievement in this work by a digital badge. We will provide the means to offer the badge, and exemplar videos if you need them, assuming they are within our stock. Interested teachers will be responsible for local implementation and assessment of quality (i.e. making the call on whether a badge is issued).
This will be part of a larger project and there will be some research on the value and impact of the digital badges, drawing from implementation case studies. This will be discussed with individuals, depending on their own local circumstances.
So if you are interested, let’s badge! You can contact me at: firstname.lastname@example.org to follow up.
I attended a useful workshop given by Marcy Towns and colleagues of Purdue at the BCCE 2016 conference. They published the paper on badging for pipette techniques. A few things came out of the workshop:
Student videos were less than 2 minutes long. A series of common errors were noted in pipetting.
This study didn’t use exemplar videos, but did use demonstrations in the lab, so it will be interesting to see if exemplars reduce common errors in the first instance.
This has prompted me to think about assessment – we will need to have prompts to focus students on demonstrating the actual technique and just recording that.
Therefore we will need to tell them not to video the washing procedures, and probably point them to what they must demonstrate. Towns used this to develop a rubric subsequently.
Silent videos are scary.
In their first iteration, students duly demonstrated what they were meant to, but didn’t narrate. Students are now told to narrate, to ensure that it is clear that they know what they are doing in each step and why they are doing it.
When to do it.
The Purdue implementation allowed students to make the videos at any stage of the lab course. In our case, we are dedicating an early (Week 2) lab session to it, as other labs are very busy and we feel that some students may not have the time to complete the videoing. We also want them to get the idea of good technique early.
By several measures, including costs of broken glassware, tutor and demonstrator observations, and students reporting themselves, the process of demonstration worked. I hope that by adding a peer-review step, we will emphasise the notion of correct technique by adding in an interim review step before videos are uploaded.