<div>G'day Liam.</div><div><br></div>This topic could become an Edulist topic in its own right. Writing questions is as much art as science, and usually based on lots of experience of how students typically think and respond. Perhaps this is why some exam questions written by advanced IT academics who don't actually teach 16-17 year olds occasionally go wrong?<div>
<br></div><div>I've just finished writing 2 ITA exams and - thinking back - a lot of my writing was based on predicting what an average kid of mine would read and how he/she* would respond. The challenge is to write questions to differentiate between D, C, B, and A+ students fairly, and give each of them a chance to show what they know.<br>
</div><div><br></div><div>I also learn a lot from classic bad questions I've seen in exams: those that are too easy, removed from the study design, vaguely worded, ambiguous, confusing, incorrect in fact. Some questions are fine, but the suggested answers are the problem: this is a big problem with VCAA exams since you can't complain about an answer after the exams have been marked.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">But your average exam will have a very few low-level Bloom taxonomy questions: define this word etc. One or two, to settle students' nerves at the start of section A and B. The majority of them, however, should be getting students to apply their knowledge in a given context, and justifying their opinions.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">And I agree with other posters: you need to abide by exam conventions, but also sometimes break out and challenge kids with unexpected (but fair and relevant) means of assessing their understanding.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">I keep telling my kids all year: your job is to fill your Bucket O' Knowledge with ITA facts. Your payday comes when you select relevant facts from the bucket and apply them to a question in an exam or outcome. It's the judgement you get marks for, not the memorization of words and definitions.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">Dammit. This post has already started to become a thesis. Time to stop.</div><div class="gmail_extra"><br></div><div class="gmail_extra">Good question, though, Liam. It's one I don't usually think about consciously, but it lurks, unuttered in my exam-writing reptilian brain stem.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">Mark</div><div class="gmail_extra">-- </div><div class="gmail_extra"><br></div><div class="gmail_extra">* (dammit- it's "he" - no girls in my ITA classes since 2008!) <br>
<br>--</div><div class="gmail_extra"><br><div class="gmail_quote">On 29 November 2012 17:29, O'Grady, Liam A <span dir="ltr"><<a href="mailto:o'grady.liam.a@edumail.vic.gov.au" target="_blank">o'grady.liam.a@edumail.vic.gov.au</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div lang="EN-AU" link="blue" vlink="purple">
<div>
<p class="">Hi Everyone,<u></u><u></u></p>
<p class=""><u></u> <u></u></p>
<p class="">What makes a good exam/test question for IT? Do you have any that you would be happy to share?<u></u><u></u></p>
<p class=""><u></u> <u></u></p>
<p class="">Recently I was writing my yr 11 exams and trying to improve the questions I had that really give kids a chance to show their understanding of IT. The following questions arose in this process:<u></u><u></u></p>
<p>
<u></u><span>1.<span style="font-style:normal;font-variant:normal;font-weight:normal;font-size:7pt;line-height:normal;font-family:'Times New Roman'">
</span></span><u></u>How much should questions be about factual recall and how much about how to apply the knowledge?<u></u><u></u></p>
<p>
<u></u><span>2.<span style="font-style:normal;font-variant:normal;font-weight:normal;font-size:7pt;line-height:normal;font-family:'Times New Roman'">
</span></span><u></u>What is a good question?<u></u><u></u></p>
<p>
<u></u><span>3.<span style="font-style:normal;font-variant:normal;font-weight:normal;font-size:7pt;line-height:normal;font-family:'Times New Roman'">
</span></span><u></u>How could we write questions that are interesting enough that the kids want to answer them?<u></u><u></u></p>
<p>
<u></u><span>4.<span style="font-style:normal;font-variant:normal;font-weight:normal;font-size:7pt;line-height:normal;font-family:'Times New Roman'">
</span></span><u></u>How can we write a good question and make it easy to mark? For example, the question below whilst having scope for more detailed answers could also be harder to mark fairly.<u></u><u></u></p>
<p class=""><u></u> <u></u></p>
<p class="">One question I came up with is below. This is NOT a model question – just my attempt to get the ball rolling.
<u></u><u></u></p>
<p class=""><u></u> <u></u></p>
<p class=""><b>Question 7<u></u><u></u></b></p>
<p class="">St Mungo’s is a large hospital network with hospitals in all Australian capital cities. All computer servers run from a datacentre in the main hospital in Hobart. These servers contain all the electronic information used by the hospital.
This includes patient medical records, billing details, medical operations scheduling, staff details and the ordering system for medical supplies. All other branches connect to the datacentre via a VPN connection through the Internet.
<u></u><u></u></p>
<p class=""><u></u> <u></u></p>
<p class="">They are thinking about moving to Cloud Computing because it is very expensive running their own datacentre in terms of staff and hardware. A couple of times recently there have been power failures in the datacentre which has meant that
none of the hospitals could access the information needed to run.<u></u><u></u></p>
<p class=""><u></u> <u></u></p>
<p style="margin-left:18pt;text-align:justify">
<u></u><span>a)<span style="font-style:normal;font-variant:normal;font-weight:normal;font-size:7pt;line-height:normal;font-family:'Times New Roman'">
</span></span><u></u>What would you recommend that they do? Justify your recommendation. (4 Marks)<u></u><u></u></p>
<p class=""><u></u> <u></u></p>
<p class=""><u></u> <u></u></p>
<p class="">Cheers<u></u><u></u></p>
<p class="">Liam O’Grady<u></u><u></u></p>
<p class="">Brunswick Secondary College<u></u><u></u></p>
</div>
<p></p><p><b>Important - </b>This email and any attachments may be confidential. If received in error, please contact us and delete all copies. Before opening or using attachments check them for viruses and defects. Regardless of any loss, damage or consequence, whether caused by the negligence of the sender or not, resulting directly or indirectly from the use of any attached files our liability is limited to resupplying any affected attachments. Any representations or opinions expressed are those of the individual sender, and not necessarily those of the Department of Education and Early Childhood Development.</p>
</div>
<br>_______________________________________________<br>
<a href="http://www.edulists.com.au" target="_blank">http://www.edulists.com.au</a> - FAQ, resources, subscribe, unsubscribe<br>
IT Applications Mailing List kindly supported by<br>
<a href="http://www.vcaa.vic.edu.au/vce/studies/infotech/itapplications3-4.html" target="_blank">http://www.vcaa.vic.edu.au/vce/studies/infotech/itapplications3-4.html</a> - Victorian Curriculum and Assessment Authority <br><br>
<a href="http://www.vitta.org.au" target="_blank">http://www.vitta.org.au</a> - VITTA Victorian Information Technology Teachers Association Inc <br><br>
<a href="http://www.swinburne.edu.au/ict/schools" target="_blank">http://www.swinburne.edu.au/ict/schools</a> - Swinburne University<br></blockquote></div><br><br clear="all"><div><br></div>-- <br>Mark Kelly - <a href="mailto:kel@mckinnonsc.vic.edu.au" target="_blank">kel@mckinnonsc.vic.edu.au</a><br>
Manager of ICT, Reporting, IT Learning Area<br>McKinnon Secondary College, McKinnon Rd, McKinnon 3204, Victoria, Australia<br>Phone: +613 8520 9085, Fax +613 9578 9253<br>VCE IT Lecture Notes: <a href="http://vceit.com" target="_blank">http://vceit.com</a><br>
Moderator: <a href="http://edulists.com.au/itapps/index.htm" target="_blank">IT Applications Edulist</a><br>--<br>My personal best for the 100 metre sprint is 11.9 metres.<br><br><br><br>
</div>