best practices in design outcomes of a survey p. h. king, phd, pe joan walker, phd vanderbilt...

Best Practices In DesignOutcomes Of A Survey

P. H. King, PhD, PEJoan Walker, PhDVanderbilt University

Design Survey, 13 respondents, late 2003

• How many credit hours & terms – design course

• Which measures are required, as needed, not needed

• Grading examples?• Suggested additions re ABET &

design?

Course Structure: Credits

• 3 + 3 5 programs• 3 3 programs• 2 + 3 1 program• 2 + 2 1 program• 1 + 2 1 program• 3 to 6 1 program (variable credit)• 8 1 program (over 6 terms)

Topics: Rank ordered

• Final Written Paper• Periodic Written Reports• Periodic Oral Reports• Prototype• Project Notebook• Final Oral Presentation• Health & Safety Analysis• Final Poster Presentation

• 13, 0, 0 • 13, 0, 0• 11, 2, 0• 9, 2, 2• 9, 1, 3• 8, 1, 4• 8, 4, 1• 8, 1, 4

Columns are: Required, As needed, Not Required

Topics: Rank ordered, Continued

• Order of Magnitude Calc.

• Societal Impact• Market/Econ. Analysis• Design History File• Ethical Concerns• Grant Proposal• Patent Application• Manufacturability

• 7, 1, 5 • 6, 3, 4• 6, 3, 4• 6, 1, 6• 5, 6, 2• 4, 3, 6• 3, 4, 6• 3, 4, 6

Columns are: Required, As needed, Not Required

Topics: Rank ordered, Continued

• Cite Relevant Standards

• Sustainability• Environmental Impact• Political

Considerations

• 2, 8, 3 • 1, 3, 9• 0, 9, 4• 0, 3, 10

Columns are: Required, As needed, Not Required

Suggested Additions to List

• Manuscript ready for journal publication

• K-12 outreach presentation of project• Proof of concept prior to design• Aesthetic considerations• Timeline• System Specification• Peer review

Suggested Additions To List (If ABET)

• Teamwork & Leadership (2)• Peer & Self Evaluations• Design Controls• Engineering Analysis (FEM)• Innovation• Quality Controls• Design of Experiments

Grading Schemes Collected:

• Course Grading Scheme 7• Peer Review 2• Design Notebook 1• Oral Report 1• Design Report 2• Poster Judging 1• Proposal Grading 1

Oral Grading Sheet - Marquette

Presentation Skills/Organization: (30 pts)

Were members of group professional in appearance? 5 points

Were speakers adequately prepared for presentation and questions?

10 pts

Was presentation clear and understandable? 10 pts

Were visual aids sufficient in numbers and properly used? 5 pts

Technical Content of Presentation: (30 pts)

Did group demonstrate sufficient technical understanding and base concept(s) on sound engineering principles? 15 pts

Did prototype/key deliverable adequately communicate proposed concept? 15 pts

Oral Grading Sheet Continued

Salability: (40 pts)

Was audience convinced that:

proposed concept will meet customer needs? _______(15)

proposed concept is technically feasible? _______(10)

proposed concept is economically viable? _______(10)

group can complete project by May 2004? _______(5)

TOTAL _______(100)

+ comments to speaker …

+ comments to course coordinator …

Paper & Poster - Vanderbilt

1 Engineering goals __/20

Problem Statement: clear problem definition (identify constraints & alternatives), definition based on customer requirements (demands & wishes) F  E- E E+

Prototype, test and/or prediction of performance: manufacturability; proof of concept; prototype can be a database which is established or revised. F  E- E E+

Documentation of problem solution: feasibility analyses (if no prototype); validation and verification (meets customer demands and industry standards) F E- E E+

Safety, Health & Risk Analysis: safety & risk analysis; demonstration of appropriate mathematical analyses; environmental impact na  E- E E+

Economic/market consideration: Can it be made? Can people afford it? What is the number of potential users? Mathematical analyses if necessary.  Market survey? na  E- E E+

Continued …

2 Creative ability __/20

Approach: logical analysis, consideration of alternatives; example of generation of ideas, ideation and innovation

F  E- E E+

Originality: new, non-obvious, a contribution to the body of engineering knowledge; na  E- E E+

3 Thoroughness __/20

Documentation of effort: e.g., project notebook; Innovation Work Bench; Design  file, etc. F  E- E E+

Literature review & Patent search, References: primary sources; patents… F E- E E+

Application of Standards (if applicable): relevant standards cited, e.g., FDA,, ISO, etc. na  E- E E+

4 Overall Competence in Design __/25

Proper application of modern engineering techniques, skills and tools to problem F E- E E+

Demonstrated ability to design system, component or process F E- E E+

Problem scope: Design difficulty (e.g., open- v. closed-ended problem), magnitude of design challenge; is the problem trivial or not?

na  E- E E+

Continued

5 Clarity of presentation__/10

Engineering layout: easy to read, mix of text and pictures F E- E E+

Well-written: is it a stand alone summary? Convincing evidence of solution’s quality; links findings to project statement? F E- E E+

Overall impact: overall communication; convincing that this is a good  solution F E- E E+

Evidence of teamwork: can the evaluator have a substantive exchange about the project with each team member? na E- E E+

6 Ethical/Societal/Political considerations:__/5

Ethical/Societal/Political considerations: Is anyone being excluded? Ethical treatment of subjects (human and animal)? F  E- E E+

Other sources

• TIDEE – transferable integrated design engineering education - http://www.tidee.cea.wsu.edu/assessment-tools/design-processes.html

• BESTEAMS – building engineering student team effectiveness and management systems - http://www.enme.umd.edu/labs/BESTEAMS/

Material Solicited

• Please send to paul.h.king@vanderbilt.edu

• Material will be posted on VaNTH website: http://vubme.vuse.vanderbilt.edu/King/design_education.htm in the near future

Thank You!

Questions or Comments?

This work is supported primarily by the Engineering Research Centers Program of the National Science Foundation under Award Number EEC-9876363