Evaluation Criteria

What is Evaluation?

• Happens at Last phase of PSM• This is NOT testing• NOT finding faults to fix!• DOESN’T improve the system, but facilitate

the improvement of the next.• Measures how well the original ambitions

have been achieved.

Evaluation Criteria Design• Happens at the second phase (DESIGN)• Typical Evaluation Criteria

– Speed– Accuracy– Quality of Output– Reliability– Cost of Operation– Attractiveness– Robustness– Capacity– Compatibility– Required Functionality– Security– Flexibility– Size– Portability

What is Evaluation Criteria?

• Evaluation criteria describes:– WHAT features will be measured

– NOT

– HOW they will be measured

• There is:– Evaluating Effectiveness Criteria

• THINK: Time, Money, Labour/Effort

– Evaluating Efficiency Criteria• THINK: How well a job is done

Evaluating Efficient Criteria• Time Efficiency

– How quickly:• the system should start• Data is processed• Output is produced• Information is communicated

• Economic Efficiency– Cost of:

• Initial hardware, software• Training and Documentation• Wages• Consumables• Repairs, upgrades, maintenance• Leasing, hire

• Labour Efficiency– When operating the system

• What is the required number of staff?• What is the hours required to maintain it?

Evaluating Effective Criteria

• Measure of “how well” a job is done– Regardless of

• Time• Money,• Or Effort

• Examples include– Accuracy of data formatting, calculations– Quality of Print, Graph outputs– Reliability– HTML Compatible with different browsers – User Friendiness, ease of use

Evaluation Methods

• How evaluation is done.

• More about this when we get to it in unit 4 outcome 2 the last one!!!!

Identify Effective and Efficient• Typical Evaluation Criteria

– Speed - Efficiency– Accuracy - Effectiveness– Quality of Output - Effectiveness– Reliability - Effectiveness– Cost of Operation - Efficiency– Attractiveness - Effectiveness– Robustness – Effectiveness– Speed of Processing - Efficiency– Capacity – Effectiveness– Compatibility - Effectiveness– Required Functionality - Effectiveness– Security – Effectiveness– Required System Operators - Efficiency– Flexibility - Effectiveness– Size - Effectiveness– Portability – Effectiveness– Data Storing and Effectiveness– User Friendliness - – Efficiency Effectiveness

Practise SAC 2 – Evaluation Criteria• Efficiency

– Timely processing of final cost– Timely output of order information

• Effectiveness– Accurate saving of new username into txt file– Accurate text file output of order information– Clear and unambiguous formatting of order text output.– Reliable and Accurate calculation of final price including discounts.– Calculation results correct to 2 decimal places– User Friendliness of login interface, new username creation and ordering

system.– Compatible with windows 7– Effective Security lock for incorrect username with relevant button disability.