Fifteen groups composed of engineering students and professionals were videotaped while performing a simulated design task. Using interaction analysis, it was found that professional teams were more likely to engage in management activities, outline an overall design philosophy, and not overlook detailed specifications. Professional teams also adhered tentatively to the early design artifacts; early design attempts were viewed as experiments for acquiring more information about the design space. Student teams were much more likely to engage in a generate and test pattern throughout their design process, making incremental improvements to their current artifact. Although the number of groups was small, these patterns were strong and the differences were statistically significant. It is suggested that these differences are useful for guiding how engineers are educated and for understanding whether students should be used as experimental subjects in engineering design research.

Issue Section:
Research Papers
Topics:
Design, Engineers, Students, Teams, Engineering design, Engineering students
1.
O¨mer
Akin
, “
Necessary Conditions for Design Expertise and Creativity
,”
Design Studies
, Vol.
11
, pp.
107
–
113
,
1990
.
2.
Atman
Cynthia J.
, and
Bursic
Karen M.
, “
Teaching Engineering Design: Can Reading a Textbook Make a Difference?
”
Research in Engineering Design
, Vol.
8
, No.
4
, pp.
240
–
250
,
1996
.
3.
Ball
Linden J.
,
Evans
Jonathan St. B. T.
,
Dennis
Ian
, and
Ormerod
Thomas C.
, “
Problem-Solving Strategies and Expertise in Engineering Design
,”
Thinking and Reasoning
, Vol.
3
, No.
4
, pp.
247
–
270
,
1997
.
4.
Barkan
Philip
, and
Iansiti
Marco
, “
Prototyping: A Tool for Rapid Learning in Product Development
,”
Concurrent Engineering: Research and Applications
, Vol.
1
, No.
2
, pp.
125
–
134
,
1993
.
5.
Brown
Shona L.
, and
Eisenhardt
Kathleen M.
, “
Product Development: Past Research, Present Findings, and Future Directions
,”
Academy of Management Review
, Vol.
20
, No.
2
, pp.
343
–
378
,
1995
.
6.
Bucciarelli, L. L., Goldschmidt, G., and Whipple, B. C., “Delta—A Design Exercise,” Technical report, M.I.T. Science, Technology, and Society Program, 1991.
7.
Bucciarelli, Louis L., Designing Engineers. M.I.T. Press, Cambridge, 1994.
8.
Casaday, G., “Rationale in Practice; Templates for Capturing and Applying Design Expertise,” In T. P. Moran and J. M. Carroll, editors. Design Rationale: Concepts, Techniques, and Use, pp. 351–372. Lawrence Erlbaum Associates, Mahwah, N.J., 1996.
9.
Chi
Michelene T. H.
,
Feltovich
Paul J.
, and
Glaser
Robert
, “
Categorization and Representation of Physics Problems by Experts and Novices
,”
Cognitive Science
, Vol.
5
, pp.
121
–
152
,
1981
.
10.
Clark, Kim B., and Fujimoto, Takahiro, Product Development Performance. Harvard Business School Press, Boston, 1991.
11.
Cooley
Elizabeth
, “
Training an Interdisciplinary Team in Communication and Decision-making Skills
,”
Small Group Research
, Vol.
25
, No.
1
, pp.
5
–
25
,
1994
.
12.
Cooper
Robert G.
, and
Kleinschmidt
Elko J.
, “
Determinants of Timeliness in Product Development
,”
Journal of Product Innovation Management
, Vol.
11
, No.
5
, pp.
381
–
396
,
1994
.
13.
Cross, Nigel, “Research in Design Thinking,” In N. Cross, K. Dorst, and N. Roozenburg, editors. Research in Design Thinking, pp. 2–10. Delft University Press, Amsterdam, 1992.
14.
Dorst, Kees, “Analyzing Design Activity; New directions in Protocol Analysis,” special issue, Design Studies, Vol. 16, No. 2, 1995.
15.
Droz
Dan
, “
Prototyping: A Key to Managing Product Development
,”
Journal of Business Strategy
, Vol.
13
, No.
3
, pp.
34
–
38
,
1992
.
16.
Eckersley
M.
, “
The Form of Design Processes; A Protocol Analysis Study
,”
Design Studies
, Vol.
9
, No.
2
, pp.
86
–
94
,
1988
.
17.
Ehrlenspiel
Klaus
, and
Dylla
N.
, “
Experimental Investigation of the Designer’s Thinking Methods and Design Procedures
,”
Journal of Engineering Design
, Vol.
4
, No.
3
, pp.
201
–
212
,
1993
.
18.
Ehrlenspiel
Klaus
,
Giapoulis
Anthimos
, and
Gu¨nther
Joachim
, “
Teamwork and Design Methodology-Observations About Teamwork in Design Education
,”
Research in Engineering Design
, Vol.
9
, No.
2
, pp.
61
–
69
,
1997
.
19.
Finegold
M.
, and
Mass
R.
, “
Differences in the Process of Solving Physics Problems Between Good Physics Problem Solvers and Poor Physics Problem Solvers
,”
Research in Science and Technological Education
, Vol.
3
, No.
1
, pp.
59
–
67
,
1985
.
20.
Frankenburger
Eckart
, and
Auer
Peter
, “
Standardized Observation of Team-Work in Design
,”
Research in Engineering Design
, Vol.
9
, No.
1
, pp.
1
–
9
,
1997
.
21.
Gabel, Dorothy L., and Bunce, Diane M., “Research on Problem Solving: Chemistry,” In Dorothy L. Gabel, editor, Handbook of Research on Science Teaching and Learning, pp. 301–326. Macmillan Publishing, New York, 1994.
22.
Gay
Geri
, and
Grosz-Ngate
Maria
, “
Collaborative Design in a Networked Multimedia Environment; Emerging Communication Patterns
,”
Journal of Research on Computing in Education
, Vol.
26
, No.
3
, pp.
418
–
432
,
1994
.
23.
Griffin
Abbie
, “
The Effect of Project and Process Characteristics on Product Development Cycle Time
,”
Journal of Marketing Research
, Vol.
34
, No.
1
, pp.
24
–
35
,
1997
.
24.
Habraken
N. John
, and
Gross
Mark D.
, “
Concept Design Games
,”
Design Studies
, Vol.
9
, No.
3
, pp.
150
–
158
,
1988
.
25.
Hacker
Winfried
, “
Improving Engineering Design-Contributions of Cognitive Ergonomics
,”
Ergonomics
, Vol.
40
, No.
10
, pp.
1088
–
1096
,
1997
.
26.
Handfield
Robert B.
, “
Effects of Concurrent Engineering on Make-to-Order Products
,”
IEEE Transactions on Engineering Management
, Vol.
41
, No.
4
, pp.
384
–
393
,
1994
.
27.
Hubka, Vladimir, and Eder, W. Ernst, Design Science: Introduction to the Needs, Scope and Organization of Engineering Design Knowledge, Springer Verlag, London, 1996.
28.
Hull
Frank M.
,
Collins
Paul D.
, and
Liker
Jeffrey K.
, “
Composite Forms of Organization as a Strategy for Concurrent Engineering Effectiveness
,”
IEEE Transactions on Engineering Management
, Vol.
43
, No.
2
, pp.
133
–
142
,
1996
.
29.
Ittner
Christopher D.
, and
Larcker
David F.
, “
Product Development Cycle Time and Organizational Performance
,”
Journal of Marketing Research
, Vol.
34
, No.
1
, pp.
13
–
23
,
1997
.
30.
Jordan, Brigitte, “Ethnographic Workplace Studies and Computer Supported Cooperative Work,” In D. Shapiro, M. Tauber, and R. Traunmuller, editors. Proceedings of the Interdisciplinary Workshop on Informatics and Psychology, North Holland, Amsterdam, 1993.
31.
Jordan
Brigitte
, and
Henderson
Austin
, “
Interaction Analysis: Foundations and Practice
,”
Journal of the Learning Sciences
, Vol.
4
, No.
1
, pp.
39
–
102
,
1995
.
32.
Kilpatrick, J., “Problem Formulating: Where do Good Problems Come From?” In Alan H. Schoenfeld, editor, Cognitive Science and Mathematics Education, pp. 1–147. Lawrence Erlbaum Associates, Hillsdale, N.J., 1987.
33.
Lee
Tat Y.
, and
Radcliffe
David F.
, “
Innate Design Abilities of First Year Engineering and Industrial Design Students
,”
Design Studies
, Vol.
11
, No.
2
, pp.
96
–
106
,
1990
.
34.
Lewis, W. P., and Sier, G. H., “The Diagnosis of Plant Failure: A Comparison of Student and Professional Engineers,” IEEE Transactions on Engineering Management, EM-30, No. 1, pp. 12–17, 1983.
35.
Maloney, David P., “Research on Problem Solving: Physics,” In Dorothy L. Gabel, editor, Handbook of Research on Science Teaching and Learning, pp. 327–354. Macmillan Publishing, New York, 1994,
36.
Miles, Matthew B., and Huberman, A. Michael, Qualitative Data Analysis: a Sourcebook of New Methods, Sage Publications, Beverly Hills, Calif., 1984.
37.
Olson, G. M., Olson, J. S., Storro̸sten, M., Carter, M., Herbsleb, J., and Rueter, H., “The Structure of Activity During Design Meetings,” In T. P. Moran and J. M. Carroll, editors, Design Rationale: Concepts, Techniques, and Use, pp. 217–239. Lawrence Erlbaum Associates, Mahwah, N.J., 1996.
38.
Olson
Gary M.
,
Olson
Judith S.
,
Carter
Mark R.
, and
Storro̸sten
Marianne
, “
Small Group Design Meetings: an Analysis of Collaboration
,”
Human-Computer Interaction
, Vol.
7
, No.
4
, pp.
347
–
374
,
1992
.
39.
Radcliffe, David F., and Lee, Tat Y., “Design Methods Used by Undergraduate Engineering Students,” Design Studies, No. 10, pp. 199–207, 1989.
40.
Reif
Frederick
, and
Heller
Joan I.
, “
Knowledge Structures and Problem Solving in Physics
,”
Educational Psychologist
, Vol.
17
, No.
2
, pp.
102
–
127
,
1982
.
41.
Samuel
A. E.
, “
Educational Objectives in Engineering Design Courses
,”
Instructional Science
, Vol.
13
, No.
3
, pp.
243
–
273
,
1984
.
42.
Samuel
A. E.
, and
Lewis
W. P.
, “
Evaluation of Students’ Strategies for Concept Application in Engineering Design
,”
Instructional Science
, Vol.
20
, No.
4
, pp.
311
–
329
,
1991
.
43.
Samuel, A. E., and Weir, J. G., “The Acquisition of Wisdom in Engineering Design,” Instructional Science, No. 20, pp. 419–442, 1991.
44.
Schoenfeld, Alan H., “What’s All the Fuss About Metacognition?” In Alan H. Schoenfeld, editor, Cognitive Science and Mathematics Education, pp. 189–215. Lawrence Erlbaum Associates, Hillsdale, N.J., 1987.
45.
Schoenfeld
Alan H.
, “
A Way With Numbers
,”
Chemtech
, Vol.
20
, No.
11
, pp.
664
–
671
,
1990
.
46.
Schoenfeld, Alan H., “Learning to Think Mathematically: Problem Solving, Metacognition, and Making Sense in Mathematics,” In D. A. Grouws, editor, Handbook of Research on Mathematics Teaching and Learning, pp. 334–370. Macmillan Publishing, New York, 1992.
47.
Segal
Uma A.
, “
The Cyclical Nature of Decision Making: An Exploratory Empirical Investigation
,”
Small Group Behavior
, Vol.
13
, No.
3
, pp.
333
–
348
, 1982.
48.
Simon, Herbert A., The Sciences of the Artificial, M.I.T. Press, Cambridge, Mass., 1981.
49.
Smith, Robert P., Eppinger, Steven D., and Gopal, Amarnath, “Testing an Engineering Design Iteration Model in an Experimental Setting,” In Proceedings of the 4th International Conference on Design Theory and Methodology, Scottsdale, Ariz., 1992.
50.
Smith, Robert P., and Tjandra, Primanata, “Experimental Observation of Iteration in Engineering Design,” Research in Engineering Design, Vol. 10, No. 2, 1998.
51.
Stewart, James, and Hafner, Robert, “Research on Problem Solving: Genetics,” In Dorothy L. Gabel, editor, Handbook of Research on Science Teaching and Learning, pp. 284–300. Macmillan Publishing, New York, 1994.
52.
Suchman, L. A., and Trigg, R. H., “Understanding Practice: Video as a Medium for Reflection and Design,” In J. Greenbaum and M. Kyng, editors, Design at Work: Cooperative Design of Computer Systems, pp. 65–90. Lawrence Erlbaum Associates, Hillsdale, N.J., 1991.
53.
Tang
John C.
, “
Findings from Observational Studies of Collaborative Work
,”
International Journal of Man-Machine Studies
, Vol.
34
, No.
2
, pp.
143
–
160
,
1991
.
54.
Tang
John C.
, and
Leifer
Larry
, “
An Observational Methodology for Studying Group Design Activity
,”
Research in Engineering Design
, Vol.
2
, No.
4
, pp.
209
–
219
,
1991
.
55.
Verma
Niraj
, “
Design Theory Education; How Useful is Previous Design Experience?
”
Design Studies
, Vol.
18
, No.
1
, pp.
89
–
99
,
1997
.
56.
Weth
Ru¨diger von der
, and
Frankenburger
Eckart
, “
Strategies, Competence and Style-Problem Solving in Engineering Design
,”
Learning and Instruction
, Vol.
5
, No.
4
, pp.
357
–
383
,
1995
.
57.
Wall
Matthew B.
,
Ulrich
Kari T.
, and
Flowers
Woodie C.
, “
Evaluating Prototyping Technologies for Product Design
,”
Research in Engineering Design
, Vol.
3
, No.
3
, pp.
163
–
177
,
1992
.
58.
Ward
Allen
,
Liker
Jeffrey K.
,
Cristiano
John J.
, and
Sobek
Durward K.
, “
The Second Toyota Paradox: How Delaying Decisions can Make Better Cars Faster
,”
Sloan Management Review
, Vol.
36
, No.
3
, pp.
43
–
61
, Spring
1995
.
59.
Wind
Jerry
, and
Mahajan
Vijay
, “
Issues and Opportunities in New Product Development; An Introduction to the Special Issue
,”
Journal of Marketing Research
, Vol.
34
, No.
1
, pp.
1
–
12
,
1997
.
This content is only available via PDF.
Copyright © 1998
 by The American Society of Mechanical Engineers
You do not currently have access to this content.