MSIT 121 RESEARCH IN SCIENCE AND TECHNOLOGY Adopted from a Presentation made during the Research Ski

1
MSIT 121RESEARCH IN SCIENCE AND
TECHNOLOGYAdopted from a Presentation made
during theResearch Skills and Research
Capability Building SeminarOctober 24, 2002,
Audio Visual Room 5, New Commerce
BuildingXavier University Ateneo de Cagayan

• Gerry S. DorojaDepartment of Computer
  ScienceCollege of EngineeringXavier University
  Ateneo de Cagayan(gsd_at_xu.edu.ph)

2
Question What is this?
3
Presentation Outline

• 1. What is research in science and technology?
• 2. What are the types of research?
• 3. What is research and development?
• 4. What is a unit of study?
• 5. What is the typical research lifecycle?
• 6. What is expected out of research (i.e.,
  result/output)?
• 7. What are the research methodologies?
• 8. What are the research project phases?
• 9. What are the required supporting skills?
• 10. How to design a research project?
• 11. How to choose a research problem?
• 12. How to write a research proposal?

4
What is research in science and technology (ST)?
1/12

• Research is
• exploratory (investigative)
• Research is
• work that show evidence of (a) independent
  inquiry, (b) originality in the methods used
  and/or conclusions drawn AND (c) must make an
  appreciable new contribution to knowledge in the
  field of study or,
• work that show evidence of (a) independent
  inquiry AND/OR (b) originality in either
  conclusions or method (Source University
  Calendar, Trinity College, Dublin)
• Research is
• innovating (originating, discovering, inventing)
  - research in developed countries
• adapting (adjusting, arranging, accommodating) -
  research in developing countries
• NOT adopting (taking in, using, employing) - not
  research just a project
• NOT copying (imitating, duplicating, reproducing)
  - plagiarism or piracy

5
What are the types of research?
2/12

• Basic research - refers to experimental or
  theoretical work undertaken primarily to acquire
  new knowledge of underlying foundations of
  phenomena and observable facts
• without immediate or specific use in view (free
  fundamental research)
• geared toward the solution of a specific problem
  that has not been solved before (oriented basic
  research)
• Applied research - refers to investigation
  undertaken in order to verify data/information
  gathered from basic or fundamental research or to
  acquire new knowledge directed primarily towards
  a specific practical aim or objective
• systematic work, drawing from existing knowledge
  gained from research and/or practical experience
  that is directed to producing new materials,
  products and devices, to installing new
  processes, systems and services and to improving
  substantially those already produced or installed
  (experimental development)
• innovative activity aimed at gaining experience
  leading to further technical improvement of the
  product or the production process and setting the
  parameters prior to the commercialization process
  (pilot testing)
• (Source DOST Revised Guidelines Governing the
  Grants-in-Aid Program, 1997)

6
What are the types of research? (contd)
2/12
Basic research
Applied research
oriented basic research
fundamental research
experimental development
pilot testing
Industry research
Academic research
Contract research
Industrial research and development
7
What is research and development?
3/12

• Remember that research (R) is not development
  (D) although D will be necessary in solving your
  R problem. If you stray to far in D, you will
  probably be passed by industrial RD and find
  your years of work will (sic) be released as a
  product before you start to write-up.
• (Source A. Bundy, A. et al., The Researchers
  Bible, University of Edinburgh, 1995)

8
What is the unit of study in ST research?
4/12

• Generally, the unit of study may be systems,
  system components, architectures, models,
  processes, procedures, methods, techniques,
  theories, etc in a particular field or discipline
  (study population in social science research)
• For example, in computer science study units may
  be
• In Algorithms algorithms, routines
• In Artificial intelligence methods, techniques,
  algorithms
• In Programming languages languages, language
  components or features
• In Architecture instruction sets, memory
  hierarchies, architectures
• In Theory models, theorems, proof techniques
• In Systems systems, components of systems,
  system architectures
• (Exercise 1 Can you come up with a similar list
  in your field/discipline? )

Characteristics of study units hierarchy and
diversity
9
What is the unit of study in ST research?
(contd)
4/12

• Units have HIERARCHICAL structure. (important
  for understanding context/developing framework)
• For example

unit
computerarchitecture
Level 0
memory hierarchies
instruction sets
Level 1
floating point units
instructions for branching
support for virtual memory
floating point representation
instructions for procedure call
arithmetic algorithms
study of caches
Level 2
study of cache coherency
implementation strategies
pipeline design
(Exercise 2 Can you come up with a similar unit
hierarchy in your field/discipline? )
10
What is the unit of study in ST research?
(contd)
4/12

• Units vary (DIVERSITY) by their SIZE, POTENTIAL
  VARIETY, COST OF EVALUATION, and so
  on.(important for defining scope and
  limitations)
• Size
• Small units algorithms, language features,
  architectural components
• Medium-size units instruction sets, proof
  techniques
• Large units languages, architectures, machines
• Potential Variety
• Low variety sorting algorithms, cache designs
• High variety AI algorithms, languages,
  architectures
• Cost of Evaluation
• Low cost algorithms, artificial intelligence
  methods
• Medium cost theorems, components of
  architectures
• High cost languages, architectures, ideal models
• Generally, smaller units exhibit less variety and
  lower cost of evaluation, so they are easier to
  do research on.

(Exercise 3 Can you come up with a similar
classification in your field/discipline? )
11
What is the typical research lifecycle?
5/12
Commercialization
Definition (1)
Initial Solutions (2)
Technology Transfer (6)
Exploratory theory
Space of Possible Solutions (5)
Evaluation of Initial Solutions (3)
Tradeoff
Comparison of Solutions (4)
Next
12
SIDETRACK Apocalypse of the two elephants
Billion dollar investment (Commercialization)
Research
Standards
Activity
Time
Source David Clark, MIT (as quoted in A.
Tanenbaum, Computer Networks, 2e, Prentice Hall,
1988)
13
1. Definition Phase (Research Lifecycle)

• Exploratory research defines a new problem, new
  constraints, new opportunity, or a new approach.

Back
14
2. Initial solutions Phase - CREATE UNITS
(Research Lifecycle)

• Initial algorithms, designs, theorems, programs
  are developed.

Back
15
3. Evaluation of initial solutions Phase -
EVALUATE UNITS (Research Lifecycle)

• Initial solutions are evaluated and refined in
  isolation.

Back
16
4. Comparison of solutions Phase - COMPARE UNITS
(Research Lifecycle)

• Solutions are compared to one another and also to
  ideal solutions.

Back
17
5. Space of possible solutions Phase - SPACE OF
UNITS IDEAL MODEL (Research Lifecycle)

• Theorems are proved about the limits on any
  solutions. Existing solutions are placed in a
  common framework to determine whether all
  possible solutions have been found.

Back
18
6. Technology Transfer Phase (Research Lifecycle)

• Best approaches are transferred to users.

Back
19
What is the typical research lifecycle? (contd)
5/12

• Not all of these phases are seen in all areas.
• For units with high cost of evaluation only
  relatively weak methods can be applied to
  evaluate initial solutions and compare solutions.
• For units with high variety, it is difficult to
  understand the space of all possible solutions.

20
What is expected out of research (i.e.,
result/output)?
6/12

• Here are some examples
• a definition of a problem or task
• a unit for solving a problem, performing a task
• identification of factors in influencing the
  cost, effectiveness, or applicability of a unit
  (perhaps with some idea of the relative
  importance of the factors)
• development of an ideal model
• a finished unit that can be distributed to users
  and,
• measurement of some properties of a unit e.g.,
  run time, chip area, representation requirements,
  reliability, usability, etc.

21
What are the research methodologies? (Some
generic examples)
7/12

• Design units
• Implement units
• Run units
• Find and prove theorems
• Analyze and consolidate

• Study users
• Import techniques
• Read literature
• Write paper

There are many possible research methodologies
(depending on the field/discipline).
The Research Methodology section in a research
proposal or paper is normally an elaboration of
one or a combination of these methodologies used
in the research as well as the
materials/resources to be used/used.
22
What are the research methodologies? (contd)
Some specific examples
7/12

• writing programs
• writing systems
• developing architectures
• developing content architectures (ontologies,
  knowledge bases, class libraries, graphics
  toolboxes, etc.)
• measuring properties of units
• finding and proving theorems
• analyzing and consolidating previous research

• interviewing experts, customers
• performing psychological experiments, surveys,
  observations
• building hardware
• reading literature
• importing techniques and results from other
  fields
• measuring and predicting constraints on future
  units (e.g., VLSI technology, government
  regulation, user expectations and requirements)
• writing papers, monographs, and textbooks

23
What are the research methodologies? (Example
Scenario)

• There are many possible methodologies, but you
  should have one. Many start from different
  beginnings but merge later. Here is one example
  of a methodology.
• Stage 1
• Think of a scenario -- i.e. a sample output which
  would show that your computer program was
  exhibiting the ability you want it to model. In
  mathematical reasoning this scenario might be a
  proof in natural language a sample dialogue in
  vision the recognition of a scene, etc.
• Stage 2
• Hypothesize what processes might achieve such a
  scenario. Outline the procedures and data
  structures that might be involved. Try to make
  these as general as possible. See the problems
  you encounter as examples of general problems. Do
  not use ad hoc mechanisms except to overcome
  problems that are not central to the issue you
  are addressing.
• Stage 3
• Think of further scenarios. See whether your
  proposed program or system could cope with them.
  Use them to refine generalize extend and debug
  it.

24
What are the research methodologies? (Example
Scenario contd)

• Stage 4
• When you are satisfied that your proposed
  solution or project is stable, choose the
  programming language that fits your needs closest
  and implement your program.
• Stage 5
• Do thought experiments before subjecting your
  problem/solution to a program. Use a pencil and
  paper to see if your mental solution might work
  before subjecting it to a coding solution.
• Stage 6
• Describe your program using language independent
  of your particular implementation. Try to draw
  out any new techniques. Compare them to previous
  techniques in your area. If time permits, apply
  your technique to other areas. N.B. Stages 4 and
  5 will take longer than you think -- years not
  months -- so leave plenty of time!

(Source A. Bundy, A. et al., The Researchers
Bible, University of Edinburgh, 1995)
25
What are the research project phases?
8/12

• An individual research project follows phases
  related to the research life-cycle
• Choose research question/problem/tradeoff
• Determine current state of knowledge (literature
  review)
• Apply appropriate methods to produce research
  results and,
• Write up research results.
• To address the basic questions/framework for
  research
• What is the problem? (INTRODUCTION)
• What did you use to tackle it? (MATERIALS AND
  METHODS)
• What results followed? (RESULTS AND DISCUSSION)

Research is not complete until it is written up!
26
What are the research project phases?
8/12
Research Methods
Research Phase-Method Matrix

Research Phases
Next
27
SIDETRACK Research and Literature Review
Literature review is fundamental to research!
Back
28
What are the required supporting skills?
9/12

• Different research methods require different
  supporting skills. Some examples of required
  SKILLS

• Programming
• Design
• Organization
• Mathematics
• Psychological techniques
• Protocol analysis
• Experimental manipulations

• Survey methods
• Statistics
• Writing proposals
• Writing papers
• Critiquing papers
• Designing experiments
• Giving talks

29
How to design a research project?
10/12

• Some factors to consider

• Impact and significance
• Required skills
• Inherent interest

• Feasibility and competition
• Phase of research extendibility
• Opportunities for learning new skills

30
How to choose a research problem?
11/12

• Questions about yourself
• Questions about context
• Questions about the lifecycle

31
Questions About Yourself

• What research skills do you excel at?
• Where in the lifecycle are those skills most
  needed?
• What kind of outcome do you seek?
• Satisfaction from being a competent researcher?
• Solving important societal, commercial, or
  scientific problems?
• Transforming the way computers are programmed?
• Transforming the way current users employ
  computers?
• Bringing computation to a new kind of user?
• Starting a company and making a fortune?
• What research skills do you excel at? What
  research skills do you excel at?
• What research contributions do you most admire?

32
Questions About the Context

• What new technologies may drive change?
• How will these technologies shift tradeoff
  points?
• What new problems will they introduce?
• What kinds of new users are potentially out
  there?
• What are their problems?
• What application areas are very messy and need
  formalizing?

33
Questions about the lifecycle Research Strategies

• Technique-Driven Research
• Primarily interested in a technique (e.g.,
  machine learning), look for applications of it.
• Much of computer science is here.
• Problem-Driven Research
• Primarily interested in a goal (e.g., dynabook",
  databases, digital library), use whatever methods
  are appropriate.

Technique-driven - researcher learn about many
applications. Problem-driven - researcher learn
about many techniques.
34
How to write a research proposal?
12/12

• CONTENT FORMAT

35
Proposal Contents (An Example)
12/12

• Long term goals. These provide the framework and
  justification for the proposal.
• Significance. Explain why the proposed work is
  significant. Who would care if it succeeded? What
  difference will it make?
• Specific goals. Specific things to be achieved
  during the grant period.
• Methods and Experiments. What methods will you
  apply to achieve the goals? What experiments will
  you perform?
• Feasibility. Evidence that the goals are
  achievable by you. Assessment of the difficulty
  of the goals prior experience with similar goals
  and methods.
• Risks. What could go wrong? How will risks be
  minimized?
• Current State of Knowledge. What is currently
  known about this problem?
• Timetable. Demonstrates feasibility, especially
  within time constraints.
• Budget. How much will it cost? What are the items
  of expenditure (line item budget)
• Budget Justification. Every item of the budget
  should be essential to the success of the
  project. Explain this.

36
Proposal Format (An Example)
12/12

• Project Summary. 250-word abstract describing the
  project and its significance.
• Goals and Significance. Describe the long term
  goals, the short-term goals (briefly), and their
  significance. May need to briefly review prior
  work to set the stage.
• Previous Research. Current state of knowledge.
  Include your own research here to demonstrate
  your knowledge and project feasibility. Cite all
  potential reviewers. May need to include a
  tutorial on this area.
• Specific Goals. May interleave with methods and
  experiments.
• Methods and Experiments. Give sufficient detail
  to assure reviewers of feasibility and of your
  ability to do them. Risky outcomes should be
  accounted for in the design.
• Timetable. Brief list of specific tasks and
  expected time when they will be completed.
• References.
• Budget and Budget Justification. This is usually
  a separate section.
• Other Materials. CV of investigators letters of
  support from and collaborators. Letters verifying
  unusual items (e.g., institutional matching
  funds, etc.)

37
In summary,

• 1. Defined research in ST
• 2. Identified the types of research
• 3. Differentiated research vs. development
• 4. Defined unit of study in research
• 5. Discussed the research lifecycle
• 6. Discussed expected results/output of research
• 7. Discussed (some) of the research methodologies
• 8. Discuss project phases vs. research
  methodologies
• 9. Mapped project to required supporting skills
• 10. Identified research project design criteria
• 11. Discussed factors in choosing a research
  problem
• 12. Shown example research proposal content and
  format.

38
Answer. This is the first mouse.
AFIP Fall Joint Conference, 1968 Douglas C.
Engelbart
39
Quotes

• Copying from ONE source is plagiarism copying
  from MORE THAN ONE source is research. (WRONG!)
• Research is TEN steps forward and NINE steps
  backwards.
• Genius is 1 inspiration and 99 perspiration.
• The best way to learn about research is to do
  it.

40
A Dictionary of Useful Research Phrases

• This is the popular tool for reading research
  papers seen tacked up in offices, labs, and above
  copying machines everywhere. It has been reported
  to me that it originally appeared in a scientific
  journal article, Graham, Jr., C. D.,Metal
  Progress, Volume 71, Number 5, May, 1957
  (http//smurman.best.vwh.net/soga/misc/research.ht
  ml)

41
Thank you!