A Self-Organised Assessment Method (SOAM)
A few year ago, I was a bit curious
about how well learners can evaluate each other. I designed a small
experiment to find out. It goes like this:
- Take a group of learners, say 15 in number, in a classroom.
- Give everybody 15 sheets of paper and ask them to write their names on the top right corner of every sheet.
- Now, ask everyone to write down a question about something they have recently learned, been taught or discussed. It should be from whatever course you are conducting. The question should be such that the person making it should be confident of answering. Also questions should be such that each can be answered in two minutes or less.
- Now collect all the sheets with the questions. If there are questions that are very similar to each other, then ask one of the authors to change his or her question.
- You can now construct a question paper with 15 questions. Make 15 copies of this question paper.
- Distribute the question paper and start a 30 minutes examination. Each learner has to write the answer to each of the 15 questions on a separate sheet of paper. On top of each answer sheet, they should write 'Answer to Q no. x' etc. Each person must answer all the questions except the one they made. So each person has 14 questions to answer on 14 sheets of paper.
- After the time is over, collect all the answer sheets and put all the answers to question 1 together, all the answers to question 2 together, and so on. At the end, you would have 15 piles of 14 sheets each.
- Distribute all the answers to question 1 to the author of that question, answers to question 2 to the author of that quesiton and so on.
- Ask each learner to give marks out of 10 for each answer sheet for the question authored by him/her.
- After all the answer sheets have been graded, take them back and re-group them by the name of each learner. So, now you have 15 piles of 14 sheets each, for each learner.
- Total the marks for each learner and convert to a percent score. You now have a list of scores.
In other words, you have conducted an
examination without making a question paper and without having to
mark a pile of answer books.
I tried this for three years in the
course I teach on Educational Technology for M.Ed. Students, each
time usually after the first two weeks. There is an uncanny
correlation between the scores and the scores at the end of the one
year course. I haven't yet done all the stats and written it all up
as a paper but I will.
In the meanwhile, I thought you might
like to try....
12 Comments:
Yes I am using it tomorrow in a training program for star managers of HDFC Bank tomorrow and shall keep u posted Doc
Jai Shankar
Excellent I shall implement with our M.A II Education students opting for ICT & ODL.
i SHALL ALSO SHARE THIS With Dept of Education-University of Mumbai
I'd like to figure out how to do this on mobile phones or Moodle.
This is excellent, I hate grading papers... I am going to use this next time I assess my class
Please do let me know how it went, if you tried it.
Do you think this would work with younger students? Perhaps not the grading part, but...
I am looking forward to reading your paper. We are trying Self Organized Assessment Methods in the NZ Primary School context (children aged 5-11 years old) where they use technology to capture their own evidence of learning. Will share our findings too!
I'm doing it with my college students, and since they're studying to become teachers, I will also ask them to create and specify the parameters for a correct answer (like a rubric or checklist), then I'm killing two birds with one stone.
www.ted.com/tedx/events/6082
Can we try and emulate this experiment on a Tablets (laptops?), network, asynchronously, over the Internet, and probably Cloud hosted ? Something like a MOOC, but for testing and evaluation?
Any takers?
I am tinkering with 21st century communities and villages. Knowledge Machine is one key component. Wondering how MOOC's, Flip schooling, Khan Academy and continuous learning, can shape up?
Vipen Mahajan.
ex-NIIT in the 1990's.
Regards, Sugato.
vmahajan9@gmail.com
We may have an environment where we can allow students to write questions. Only multiple-choice though, but the exams would be automatically graded.
Gunnar
Any advice for 4-5-6-7 year olds who are not very proficient readers or writers yet!
Hi, I have used Socratic Dialogues - self written, to assess what I know about any particular subject and create more questions. I have done this successfully and reckon having students write their own dialogues could be a way of self assessment or group assessment if the dialogues are read by others. I would appreciate your own thoughts on this. I have written as much eslewhere on this blog following listening to your interesting TED talk. Many thanks and kind regards.
Robert L. Fielding
Post a Comment
<< Home