Barefoot In the head

If you think so....

My Photo
Location: Newcastle upon Tyne, Tyne and Wear, United Kingdom

I am around if you are around.

Wednesday, September 19, 2012

A Self-Organised Assessment Method (SOAM)

A few year ago, I was a bit curious about how well learners can evaluate each other. I designed a small experiment to find out. It goes like this:

  1. Take a group of learners, say 15 in number, in a classroom.
  2. Give everybody 15 sheets of paper and ask them to write their names on the top right corner of every sheet.
  3. Now, ask everyone to write down a question about something they have recently learned, been taught or discussed. It should be from whatever course you are conducting. The question should be such that the person making it should be confident of answering. Also questions should be such that each can be answered in two minutes or less.
  4. Now collect all the sheets with the questions. If there are questions that are very similar to each other, then ask one of the authors to change his or her question.
  5. You can now construct a question paper with 15 questions. Make 15 copies of this question paper.
  6. Distribute the question paper and start a 30 minutes examination. Each learner has to write the answer to each of the 15 questions on a separate sheet of paper. On top of each answer sheet, they should write 'Answer to Q no. x' etc. Each person must answer all the questions except the one they made. So each person has 14 questions to answer on 14 sheets of paper.
  7. After the time is over, collect all the answer sheets and put all the answers to question 1 together, all the answers to question 2 together, and so on. At the end, you would have 15 piles of 14 sheets each.
  8. Distribute all the answers to question 1 to the author of that question, answers to question 2 to the author of that quesiton and so on.
  9. Ask each learner to give marks out of 10 for each answer sheet for the question authored by him/her.
  10. After all the answer sheets have been graded, take them back and re-group them by the name of each learner. So, now you have 15 piles of 14 sheets each, for each learner.
  11. Total the marks for each learner and convert to a percent score. You now have a list of scores.

In other words, you have conducted an examination without making a question paper and without having to mark a pile of answer books.

I tried this for three years in the course I teach on Educational Technology for M.Ed. Students, each time usually after the first two weeks. There is an uncanny correlation between the scores and the scores at the end of the one year course. I haven't yet done all the stats and written it all up as a paper but I will.

In the meanwhile, I thought you might like to try....


Blogger Unknown said...

Yes I am using it tomorrow in a training program for star managers of HDFC Bank tomorrow and shall keep u posted Doc
Jai Shankar

September 19, 2012 at 7:29 PM  
Blogger HEMCHARI said...

Excellent I shall implement with our M.A II Education students opting for ICT & ODL.
i SHALL ALSO SHARE THIS With Dept of Education-University of Mumbai

September 19, 2012 at 8:52 PM  
Blogger Ardis said...

I'd like to figure out how to do this on mobile phones or Moodle.

September 20, 2012 at 3:58 PM  
Blogger Chandrakant Redican said...

This is excellent, I hate grading papers... I am going to use this next time I assess my class

September 20, 2012 at 8:11 PM  
Blogger Sugata Mitra said...

Please do let me know how it went, if you tried it.

September 22, 2012 at 2:45 AM  
Blogger Mashall said...

Do you think this would work with younger students? Perhaps not the grading part, but...

October 5, 2012 at 1:45 AM  
Blogger Tara TJ said...

I am looking forward to reading your paper. We are trying Self Organized Assessment Methods in the NZ Primary School context (children aged 5-11 years old) where they use technology to capture their own evidence of learning. Will share our findings too!

October 30, 2012 at 12:48 AM  
Blogger Luis HernĂ¡n said...

I'm doing it with my college students, and since they're studying to become teachers, I will also ask them to create and specify the parameters for a correct answer (like a rubric or checklist), then I'm killing two birds with one stone.

November 21, 2012 at 4:16 AM  
Blogger 21C-villages said...

Can we try and emulate this experiment on a Tablets (laptops?), network, asynchronously, over the Internet, and probably Cloud hosted ? Something like a MOOC, but for testing and evaluation?

Any takers?

I am tinkering with 21st century communities and villages. Knowledge Machine is one key component. Wondering how MOOC's, Flip schooling, Khan Academy and continuous learning, can shape up?

Vipen Mahajan.
ex-NIIT in the 1990's.

Regards, Sugato.

February 21, 2013 at 8:00 PM  
Blogger Unknown said...

We may have an environment where we can allow students to write questions. Only multiple-choice though, but the exams would be automatically graded.


March 17, 2013 at 4:02 PM  
Blogger Lyra Josefsson said...

Any advice for 4-5-6-7 year olds who are not very proficient readers or writers yet!

March 18, 2013 at 7:27 PM  
Blogger Justice said...

Hi, I have used Socratic Dialogues - self written, to assess what I know about any particular subject and create more questions. I have done this successfully and reckon having students write their own dialogues could be a way of self assessment or group assessment if the dialogues are read by others. I would appreciate your own thoughts on this. I have written as much eslewhere on this blog following listening to your interesting TED talk. Many thanks and kind regards.
Robert L. Fielding

October 10, 2013 at 11:35 AM  

Post a Comment

<< Home