Research• Word has a broad spectrum of

meanings–“Research this topic on ….”–“Years of research has

produced a new ….”

What Research is Not• Not mere information gathering

– Computer Crime– XML for Web Pages

• Not the mere transportation of facts from one location to the next– Computer Crime and Digital Signatures– XML versus HTML

• Not merely rummaging for information

What Research Is• Originates with a question or a problem.

– makes a difference, worthy, relevant– leads to new knowledge– builds on relevant existing knowledge

• A clear articulation of a goal– What problem to you intend to solve?– And how do you propose to solve it?

What Research Is• Follows a specific plan or procedure

– how you will reach your goal• Usually divided into manageable sub-

problems• guided by a hypothesis• accepts certain critical assumptions• grounded in objective reality• the collection and interpretation of data

Scientific Research• Science is an objective, logical, and systematic

method of analyzing phenomena, devised to permit the accumulation of reliable knowledge..

• Premises of science are – empiricism – objectivity– control

• The product of science is knowledge

Scientific Research• The search for knowledge, with an open mind, to

establish novel facts, usually using a scientific method. – basic research (as opposed to applied research) is

discovering, interpreting, and the developing methods and systems for the advancement of knowledge in a given area.

– Scientific Method: systematically observe, formulate hypotheses, define concepts, gather/analyze data, test/revise hypotheses, repeat, formulate theories, examines their logical consistency and subjects them to further empirical test.

What is Good Research?

• Purpose clearly defined - scope, limitations are fully specified

• Process detailed - can be repeated and except when secrecy is imposed reveal the sources of data and means by which they were obtained

• Design thoroughly planned - make as objective as possible

What is Good Research?

• High ethical standards applied• Limitations frankly revealed - there are very

few perfect designs• adequate analysis - data classified to clearly

reveal findings, probability of error should be estimated

• findings presented unambiguously• conclusions justified

Research Life Cycle• Definition

– Exploratory research defines a new problem, new constraints, new opportunity, or a new approach.

– This initial research must be guided by hypotheses that will later be further instantiated and specified.

• Initial Solutions– Initial algorithms, designs, theorems, programs are developed.

• Evaluation of Initial Solutions– Initial solutions are evaluated and refined in isolation.

• Comparison of Solutions– Solutions are compared to one another and also to ideal solutions.

• Technology Transfer– Best approaches are transferred to users.

Possible Research Results• a definition of a problem or task • a unit for solving a problem, performing a task • identification of factors influencing the cost, effectiveness, or

applicability of a unit (and relative importance of the factors) • development of an ideal model • a finished unit that can be distributed to users • measurement of some properties of a unit: run time, chip area,

representation requirements, • reliability, usability, etc. • identification of problems and shortcomings in a unit. • a demonstration that one unit is better than another. • a definition, demonstration or analysis of a tradeoff • a generative (explanatory) theory for some set of units

Possible Research Methods• writing programs • developing systems • developing architectures • developing content architectures (ontologies, knowledge bases, class

libraries, graphics toolboxes, etc.) • measuring properties of units • finding and proving theorems • analyzing and consolidating previous research results• interviewing experts, customers • performing experiments, surveys, observations • Importing/adapting techniques and results from other fields • measuring and predicting constraints• writing papers, monographs, and textbooks

Research Project Phases• An individual research project (such as a Ph.D.

dissertation) follows a lifecycle related to the research life cycle: – Choose research question/problem; formulate hypotheses– Determine current state of knowledge– Apply appropriate methods to produce research results

• To verify the hypotheses• To evaluate the proposed solutions

– Write up research results

• Research is not complete until it is written up!

A Research Project Checklist (I)• Are ideas clear and consistent?• Is the problem worthy of investigation?• Does the project have appropriate scope?• What is the hypothesis• What are the specific research questions?• What would disprove the hypothesis?• What are the assumptions and are they

“sensible”?

A Research Project Checklist (II)• Has the work/plan been critically assessed?

Are you convinced that it is sound science?• What forms of evidence are to be used?• How are outcomes to be evaluated? Why

are the selected methods appropriate or reasonable for verifying the hypothesis or evaluating the proposed solutions?

• What are the likely weaknesses of your solutions?

A Research Project Checklist (III)• Is there a written research plan?• Have milestones, timelines, and deadlines been

identified?• Do the deadlines leave enough time to receive

feedback on the drafts and to allow colleagues to contribute?

• Has the literature been adequately explored? Once the work is done – and your perspective has changed – does in need to be explored again?