Showing posts with label assessment. Show all posts
Showing posts with label assessment. Show all posts

Tuesday, 26 February 2013

Back to Basics: Improving Homework

For quite a while now, one of my weaknesses as a teacher has been the regular setting-collecting-marking-feedback cycle of homework. Part of the reason has been a want to move away from busy work and get pupils to have responsibility for making sure they have met targets.
However, schools have policies, and I want to keep to them as I've found it adversely affects students' attitudes towards me when I don't. This term I've refocussed on this aspect of my teaching, looking at what I already do and looking at things to try out. I would also love to hear how others handle homework and stay on top of it, so please add your comments below.

What I Already Do:

  • Put homework in to SBG (as the link above talks about, there are many reasons not to do this. However, as I have to grade the work, I might as well keep the scores in a useful format)
  • Have set days for each class for handing out and collecting work.

Things I am trying out this term:

  • Be mega-strict about it - there are so many pupils that come to me saying they forgot the sheet or lost it or somebody stole their bag etc., and I spend half my time trying to remember who's handed in what and when they said they'd hand it in and so on. Instead, they have a set day to bring it in and they will either hand it in first thing the next day or do it in detention.
  • Write down who was in when handing it out (so I know who got the sheet)
  • Before students hand in their sheets, I will ask for a hands-up of who has not yet done it. I will write down their names and set-up the detentions for the next day.
  • Have the entire term's worth of homeworks ready-made - This took the longest time to set-up, and it means that they have to be highly differentiated as I'm not yet sure where the pupils will be up to in their understanding. I've done it because I noticed that homework is often an after-thought with me, as all the more immediate duties of being a teacher came first. This way I don't need to think about it much as I print out the sheet and decide which parts they should do.
  • I am going to read about, and possibly try out, Sam Shah's binder check method.
How do you deal with this in your classes?

Wednesday, 22 August 2012

SBG Booklet

Inspired by the booklets shown here: http://statteacher.blogspot.co.uk/2012/08/made-4-math-monday-8.html, I wanted to make my own grade-tracking booklet for the pupils. With it comes a simple description of what SBG means. I'm not entirely happy with that description and it may change, but it is one of the ways I will be attempting to make the SBG method more concrete and understood in my classes this year.



You may have noticed that my scale only goes up to 3.5 this year. Previously I used an adapted version of Samjshah's 4 point rubric, but found that pupils couldn't really distinguish much between 3 and 3.5. My new scale fits in with the school's 'red, amber, green' policy and I think it places more emphasis on getting to a pass grade. 3.5 should be viewed as a distinction. However, its hard to say exactly how it'll work until I try it out.

Tuesday, 21 August 2012

SBG: Ways of ensuring reassessment *UPDATED*

I have been trying Standards Based Grading out for a couple years now and really love how much more accurate and constructive my assessment and feedback has become because of it. One part of it that I still haven't managed to get down, though, is ensuring reassessment; the super-motivated students come in to fix their one below-par grade and the ones lagging behind are made to catch up, but everyone else sneaks by without reassessing much and without realising one of the main benefits of SBG (the chance to ever improve on topics done way in the past in class).

In order to remedy this, this year I'm looking to add a few regular methods of reassessment that will feed in to my Gradebook:
  • Each week I would like to have at least twenty minutes of a lesson assessing the current topics plus one topic done earlier in the year (If it is a topic that students struggled with the first time around I will give a week's notice and have its revision as homework). I do not want this to be a test every week. More on that later.
  • I set homework each week. On week A I will set a normal homework which will feed in to my gradebook (I know that this is risky as I will have no knowledge of how much help that student got, but marking homework is part of the school-wide policy so I might as well count it with the rest). 
  • On week B, students can choose a skill they need to improve on and show revision of that topic for their homework. They will get a sheet to help framework this:

  • A week before each end of term test, we will have a revision lesson where pupils identify their weaknesses, improve them and reassess. It will be at least a week before so that pupils can revise any skills they still struggle with as final homework.
  • UPDATE: Assessed starter/warm-up questions.

I'm think that a test every week would be pretty damn unmotivating for some students, so I would like to mix up the assessments. My ideas for this so far:
  • Making a poster to show what they know
  • Make an instructional video or presentation
  • Make up a difficult question for your partner and answer your partner's question. Grade each other's understanding.
  • Marking some questions done by me another student.
As always, any critique or addition to this is most welcome.

Tuesday, 3 April 2012

Gamification of the Classroom?

It seems that lately I'm hearing about gamification (applying the mechanics of gaming) of everything, including education. My initial reaction was wary, since gaming and education have different core objectives (entertainment and learning respectively). However, reading this article on 'Cognitive Flow: The Psychology of Great Game Design', I couldn't help but think of the similarities between its discussion of feedback and my ideas of what makes good assessment.

This has inspired me to think about gamification and what features of game design it may be useful to apply to teaching. This is just an open thought experiment, so if you have anything to add, or disagree with, please let me know. Note that as well as the article mentioned above, I will also reference "Creating Flow, Motivation & Fun in Learning Games".

Characteristic 1: Games should have concrete goals with manageable rules.


This seems a fairly obvious statement when applied to the classroom. Pupils are generally happier when they know what is expected of them and its why there is so much emphasis from OFSTED about making learning objectives (L.O.s) and outcomes clear throughout the lesson. Ways to achieve this:
  • Make the goals plainly comprehensible in every part of the lesson. This could include linking explanations, questions and assessments to the L.O.s. Particularly useful may be the questions, so that 'if you can do these questions then you have met this L.O.'.
  • Goals and new skills need to be introduced with a minimum of distractions.
  • Time should be taken to train the pupil on new skills in a low risk environment (e.g. when you get the Gravity Gun in Half-Life you first use it to play fetch with dog). Traditionally this is achieved by examples and practice questions. You could also use group activities where pupils can confirm each other's correct answers.
  • 'The completion of small goals (e.g., clearing a field of boars) links to larger goals (e.g., getting enough XP to level up), which in turn link to even larger goals (e.g., getting access to level-specific gear). This linkage creates a series of rewarding experiences that can hook gamers to a game and create the goal-achievement-reward cycle.' This link is certainly present in education; learning skills, connecting with other skills, enabling a higher test score etc., which all links to your final exams. I do think though that this link is not always clear. Sharing standards achieved and how it links to termly reports etc. (see SBG) would be one way of doing this. Another link which I will talk about more below is the link between classwork and 'maths in the real world'.

Characteristic 2: Games should only demand actions that fit within a player's capabilities.


This is obviously desirable, particularly with pupils who lack confidence, but is not always easy to acheive in a class of 30+. Use of optional support and extension tasks can help to find the right difficulty, as can rich tasks, which allow for multiple entry points and investigation. This is similar to the game design idea of Dynamic Difficulty Adjustment.

Other things mentioned are how games should 'avoid introducing a lot of skills at the same time', 'avoid the tendency to over-specify', sticking only to the most important parts, and 'start out simple, with minimal information, and add in new data as needed'.

Characteristic 3: Games should give clear and timely feedback on player performance.


This is what initially caught my attention as a lot of SBG is about creating the opportunity for timely and useful feedback, and in fact people have already discussed its similarities to game systems. Its also what I like about Kate Nowak's Row games, because pupils get almost instant feedback on each question. Its also something that computer apps, such as this excellent algebraic equations app, are capable of achieving.

This section also mentions setting up feedback systems from the start and maintaining them. This is something I've had trouble with in the past and am currently trying to focus on being more consistent with merits, etc.

Characteristic 4: Games should remove any extraneous information that inhibits concentration.

This links to Dan Meyer's discussion of pseudocontext, where he invites you to ask whether the context adds anything to the problem or just disguises it.

Getting people to repeat tasks.


Repetition is obviously conducive to learning, but its sometimes hard to get pupils to perservere when they don't immediately understand. Here are some ways that games can do it:
  • Most games simply let players 'try again' without any stigma attached. This is harder to achieve in a classroom, but it probably starts with encouraging a "growth mindset" culture that embraces initial difficulties, like this 'favourite no' idea.
  • 'Give the player enough feedback so they can figure out how to improve their performance the next time.' This can be achieved through direct instruction and questioning or group/peer work. Its also another stated aim of SBG.
  • 'Allow players to skip excessive and meaningless repetition of the same skill. Focus on skills related to the learning objectives, let the player know when they succeeded, and move on.' Having a harder task that pupils can move on to when they feel they've mastered the basics. Dan's version of SBG has pupils skip problems they already have evidence of mastery with. This is something that I really feel needs improvement in schools. For example, a popular answer to the question 'When Will I Ever Use This????' seems to be that pupils should treat math class like brain training, like how a footballer does weights. However, where is the motivation if you never actually get them to play football? The gaming equivalent would be a computer game that was just one long tutorial. Functional maths tasks and Dan Meyer's 3Acts/WCYDWT problems are a couple of ways to address this. Here, you are applying maths in unmistakably real-world situations. They may be hand picked to be simple enough for pupils to understand, but they do not feel contrived and because they have multiple entry points and solution strategies, they allow pupils to 'play' with the skills they have learned.
  • 'Make the repeated task feel different each time around. This means providing choices, actions, and control so that the player can become engaged in a similar but slightly different experience. Alternately, the next time around, the process should go much faster. This allows them to enjoy the experience of mastery over previously challenging content.' This one has stumped me. Though it sounds entirely applicable to education, I can't really think of ways to do it. Any help on this?

Monday, 2 April 2012

SBG vs. APP: The Battle of the Acronyms!

My guess is that a lot of the online community are already familiar with these concepts, but I recently decided to have a rethink about how I use them in my classes. I thought I'd share my process with you all in case anyone finds it useful. Also, if I've made any mistakes about APP or SBG or you have any suggestions about how I could improve my practice, please let me know.

What are SBG and APP?

SBG and APP are models for assessment. SBG, or Standards Based Grading, is used mostly by American teachers and has been widely endorsed in recent years by the edublogging community. APP, or Assessing Pupils' Progress, is a UK government initiative, which has found success in pilot schemes but is not in regular practice yet in UK secondary schools. Both of them are trying to address similar common problems with assessment in schools, though they do it in slightly different ways. These are the problems:
  • Over-reliance on summative forms of assessment (hindering pupils' growth mindset and focus on improvement) including end-of-term tests.
  • Forms of assessment (e.g. homework scores) which are only understandable by the setter of the assessment.
  • Low quality/Limited evidence for achievement and feedback for improvement.
Green text: 'Well done, Jenny!', 'Must try harder, Mike.'

Standards Based Grading

The main features of SBG are as follows:
  • Regular assessment of skills or standards that pupils can understand (e.g. 'able to factorize quadratics')
  • Lots of opportunity for reassessment so that:
    • If a pupil is found to be weak in an area they have the opportunity to revise and try again.
    • Pupils are expected to retain knowledge of previously covered topics.
  • Non-assessed homework. Homework is now used primarily as a method of feedback for improving knowledge of a subject (note: this is not the case for all teachers implementing SBG).
  • Assessment is shared with the pupils so that they are able to see their progress and set their own targets. As asessments are now linked to shared standards, they may also be shared with other teachers and parents.
For more information, there are some great links from some of the most influential bloggers about SBG on the 'Old Math Dog New Tricks' blog.
Two notable programs that have come out of this are ActiveGrade and BlueHarvest, which both aim to make feedback readily accessible by pupils. They are both definitely worth checking out.

Assessing Pupils' Progress

The main features of APP:
  • Assessments are all linked to national curriculum levels and expemplifications so (in theory) that assessment can be applied across the whole department and even between schools.
  • Assessment can (but doesn't have to) take into account any work pupils show, including understanding shown in discussion as well as any written work.
  • Work that pupils do is reviewed regularly (termly, half-termly, end of each unit, etc.) and their current levels on each topic are upgraded. Feedback is also given at this point on what pupils should do next.
  • This assessment should then be used to inform future planning of lessons/transitions to a new class/etc.
More info about APP can be found from this handy PDF published by the government (note: this one contains things specific to maths education).

Conclusions

I used SBG in my last full-time job and found it vastly more informative than assessment I had performed previously and made discussions with pupils and parents much more constructive. It took me a little while to make the system efficient enough that the workload for it was managable and I never completely convinced many of my pupils of its benefits from their point of view (though they did appreciate that the process was being shared with them). In my upcoming job, I hope to start out with it and really sell the idea to the pupils from the off. I will do this by:
  • Discussing the aims of SBG with them.
  • Making assessments regular.
  • Giving opportunities for revision and reassessment that do not pile on extra work for the pupils (e.g. homeworks on a standard of their choice).
  • Sharing these opportunities with a pupil's parents/carers.
  • (If the school accepts the idea) I will not grade homework, but use it as a tool for revision, feedback and improvement.
These are the parts of APP that I will try to incorporate in to the SBG I already do:
  • Link the standards to the national framework (I'm not entirely sure how this will work yet though I'm guessing my 'standards' will be connected to the units of study and within each of those I'll have the targets i'm looking for based on the national curriculum level descriptors). I'm not so excited about this one as it seems like more work and makes the system more complicated. Schools and parents like to hear about levels though, as they can compare these nationally.
  • Using their exercise books as evidence on the standards. Last time I used SBG I ended up having a lot of mini-tests. This became very tedious for the pupils and probably turned many off from SBG in general. This time I will get most of my evidence from work in class, which I will review at the end of each unit. Department-wide tests will also be included and will be touted as an opportunity to show improvement from the original level I gave.
  • My feedback will include a list of what they can do as well as what they need to improve on. This is just an attempt to make my feeedback more positive and, if I can get it into a web application, it shouldn't be any extra work on my part.

Friday, 17 February 2012

SBG: Early successes

My first success with SGB came minutes after showing my year 9 pupils their new grades. I asked each pupil to do base their homework on improving their score on a topic they are lower on. At the end of class a pupil stayed behind and asked for specific help on the first topic we'd covered in the year. He'd got a low homework score on it then but had left it. Straight away with SBG though, he'd spotted it as a problem that hasn't gone away. We went through it together and he's now as strong on it as anyone in class.

The second success was a little more unexpected. I find myself putting a lot more effort into the homeworks I give, I spend a little bit more time marking, but I don't mind because already I am so much more aware of where my pupils are at. I suppose that before I'd seen homeworks as only marginally helpful and more time consuming for me and them than they are worth. Now I care much more for the work they do, because it feeds straight back into their learning and is constantly changing without actually getting much more complicated. I know its early days, but God I love it!

The homework itself was a bit of a mixed bag and in future I will need to set boundaries to help the pupils. For example, many pupils ended up doing the questions they had already shown they could do. Next time I will advice pupils to look back at their previous work and work on questions that they got wrong or didn't understand the first time around.

Standards based grading

I quick look over any teaching blogs and you will hear a lot about standards based grading. The idea is to give each pupils marks for each individual topic, and in this way you know better which topics to revisit and the pupils know their individual strengths and weaknesses and where they should look to improve.

Last week, much to my surprised delight, I got permission to try it out in my own classes. I now have a very colourful spreadsheet and a lot of marking to catch up on. Any pupils who get a score below a B on a topic will have to do more work on it and prove to me that they have come to understand it. This can be done on a revision test, extra homework or during maths clinic.

I will let you know how it goes.

Quick wins from Direct Instruction: Dimensions of Difficulty

This post was inspired by an episode of the Craig Barton podcast with Kris Boulton. Kris was acting as a salesman for Engelmann's Direct...