[Year 12 IT Apps] When to establish evaluation criteria?

[Christophersen, Paula P]

So that everyone gets some sleep, as Robert T-A says, the study design states that evaluation criteria happens in the design stage, so that's where it is sitting for this study design.



It's great to be part of such a vibrant community - thank you.



regards

Paula

________________________________
From: itapps-bounces at edulists.com.au [itapps-bounces at edulists.com.au] on behalf of Andrew Shortell [shortell at get2me.net]
Sent: Monday, 12 September 2011 9:19 PM
To: Year 12 IT Applications Teachers' Mailing List
Subject: Re: [Year 12 IT Apps] When to establish evaluation criteria?

However
Who does evaluation?  The users – the client – the workers. Not the designer, not the coder, not the analyst, etc.

Criteria are all about : does it do what was identified as needing doing? Does it fix the identified problem? / needs? /wants? /desires (written and contracted)? /whatever it was that got the analyst in there in the first place?

you must set the evaluation criteria before you start the design otherwise you will only evaluate the solution you create/design – you might not be evaluating a solution to the problem that you identified in the analysis.

We often tend to create test data that tests what we have designed, not necessarily test key decision points- we have all (I am sure) left out key decisions (in our design) because we worked on the design without referencing the analysis often enough and because our test data and our evaluation criteria were created after the solution  and so only tested/evaluated the solution that we made - ---

So, simply put, in reality, we create our evaluation criteria, our test data, and our client acceptance criteria before we start designing so that we do not waste time in the design phase working on things that do not fit with the analysis stage. All design works towards satisfying the tests/evaluation/acceptance. At every step.

If the analysis stage does not identify what constitutes a solution for the client then analyse properly. There is no point in doing anything if you do not understand what the client wants – unless of course you work for free or you are an artist (see Blue Poles as a good example – would that work as a solution in a client focussed environment?).
I do NOT work for free when creating things for clients. I also do not allow for wastage that is avoidable so do not quote above the needs identified in the analysis; thus I ensure that I identify what they want.

Andrew --
It must be bedtime so off my hobby horse. Good night

--
--
Andrew Shortell

mailto:shortell at get2me.net
Heidelberg Teaching Unit
Ph 9470 3403
Fax  9470 3215




On 12/09/11 8:27 PM, "Branson, Steven S" <branson.steven.s at edumail.vic.gov.au<https://www.edumail.vic.gov.au/owa/UrlBlockedError.aspx>> wrote:

I assume “criteria” means criteria for evaluation- not worded well. My thought is that analysis is all about gaining an understanding of the problem and what the client wants. You will have these  in the back of your mind, during the analysis process. These will cover what you hope to produce and hence possible criteria, but they will be broad. However until you start designing the solution you can’t develop a full set of criteria that is detailed enough to evaluate the solution.


Steven Branson




From: itapps-bounces at edulists.com.au<https://www.edumail.vic.gov.au/owa/UrlBlockedError.aspx> [mailto:itapps-bounces at edulists.com.au] On Behalf Of Mark KELLY
Sent: Monday, 12 September 2011 8:48 AM
To: Year 12 IT Applications Teachers' Mailing List
Subject: [Year 12 IT Apps] When to establish evaluation criteria?

Hi all. I'm checking a commercial exam I bought... I'm doubtful about its answer to one question

At which stage should criteria should be established?
A. Analysis?
B. Design?
C. Development?
D. Evaluation?

The suggested answer is B, but should they not be developed in conjunction with functional requirements during analysis?


Important - This email and any attachments may be confidential. If received in error, please contact us and delete all copies. Before opening or using attachments check them for viruses and defects. Regardless of any loss, damage or consequence, whether caused by the negligence of the sender or not, resulting directly or indirectly from the use of any attached files our liability is limited to resupplying any affected attachments. Any representations or opinions expressed are those of the individual sender, and not necessarily those of the Department of Education and Early Childhood Development.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.edulists.com.au/pipermail/itapps/attachments/20110912/350a7a44/attachment.html