Abstract
Teams are common throughout engineering practice and industry when solving complex, interdisciplinary problems. Previous works in engineering problem solving have studied the effectiveness of teams and individuals, showing that in some circumstances, individuals can outperform collaborative teams working on the same task. The current work extends these insights to novel team configurations in virtual, interdisciplinary teams. In these team configurations, the whole meta-team can interact, but the sub-teams within them may or may not. Here, team performance and process are studied within the context of a complex drone design and path-planning problem. Via a collaborative research platform called HyForm, communication and behavioral patterns can be tracked and analyzed throughout problem solving. This work shows that nominally inspired sub-structured teams, where members work independently, outperform interacting sub-structured teams. While problem-solving actions remain consistent, communication patterns significantly differ, with nominally inspired sub-structured teams communicating significantly less. Questionnaires reveal that the manager roles in the nominally inspired sub-structured teams, which are more central in communication and information flow, experience a greater cognitive and workload burden than their counterparts in the interacting sub-structured teams. Moreover, members in the nominally inspired sub-structured teams experience their teams as inferior on various dimensions, including communication and feedback effectiveness, yet their performance is superior. Overall, this work adds to the literature on nominal versus interacting problem-solving teams, extending the finding to larger, interdisciplinary teams.
Issue Section:
Design Theory and Methodology
References
1.
Kim
, K.
, and Lee
, K.-P.
, 2016
, “Collaborative Product Design Processes of Industrial Design and Engineering Design in Consumer Product Companies
,” Des. Stud.
, 46
(9
), pp. 226
–260
. 2.
Coburn
, J. Q.
, Salmon
, J. L.
, and Freeman
, I.
, 2018
, “Effectiveness of an Immersive Virtual Environment for Collaboration With Gesture Support Using Low-Cost Hardware
,” ASME J. Mech. Des.
, 140
(4
), p. 042001
. 3.
Cheng
, K.
, and Olechowski
, A.
, 2021
, “Some (Team) Assembly Required: An Analysis of Collaborative Computer-Aided Design Assembly
,” ASME 2021 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
, Virtual
, Aug. 17–19
, Vol. 85420. American Society of Mechanical Engineers, p. V006T06A026.4.
McComb
, C.
, Cagan
, J.
, and Kotovsky
, K.
, 2017
, “Optimizing Design Teams Based on Problem Properties: Computational Team Simulations and an Applied Empirical Test
,” ASME J. Mech. Des.
, 139
(4
), p. 041101
. 5.
Gyory
, J. T.
, Cagan
, J.
, and Kotovsky
, K.
, 2019
, “Are You Better off Alone? Mitigating the Underperformance of Engineering Teams During Conceptual Design Through Adaptive Process Management
,” Res. Eng. Des.
, 30
(1
), pp. 85
–102
. 6.
Diehl
, M.
, and Stroebe
, W.
, 1987
, “Productivity Loss in Brainstorming Groups: Toward the Solution of a Riddle
,” J. Pers. Soc. Psychol.
, 53
(3
), pp. 497
–509
. 7.
Diehl
, M.
, and Stroebe
, W.
, 1991
, “Productivity Loss in Idea-Generating Groups: Tracking Down the Blocking Effect
,” J. Pers. Soc. Psychol.
, 61
(3
), pp. 392
–403
. 8.
Taylor
, D. W.
, Berry
, P. C.
, and Block
, C. H.
, 1958
, “Does Group Participation When Using Brainstorming Facilitate or Inhibit Creative Thinking?
,” Adm. Sci. Quart.
, 3
(1
), pp. 23
–47
. 9.
Tadmor
, C. T.
, Satterstrom
, P.
, Jang
, S.
, and Polzer
, J. T.
, 2012
, “Beyond Individual Creativity: The Superadditive Benefits of Multicultural Experience for Collective Creativity in Culturally Diverse Teams
,” J. Cross Cult. Psychol.
, 43
(3
), pp. 384
–392
. 10.
van Knippenberg
, D.
, Nishii
, L. H.
, and Dwertmann
, D. J.
, 2020
, “Synergy From Diversity: Managing Team Diversity to Enhance Performance
,” Behav. Sci. Policy
, 6
(1
), pp. 75
–92
. 11.
Hoever
, I. J.
, van Knippenberg
, D.
, van Ginkel
, W. P.
, and Barkema
, H. G.
, 2010
, “Fostering Team Creativity: Perspective Taking as Key to Unlocking Diversity's Potential
,” Academy of Management Proceedings. No. 1. Briarcliff Manor, NY 10510: Academy of Management
, Montreal, Canada
, Aug. 8–10
, pp. 1
–6
.12.
Prat
, A.
, 2002
, “Should a Team Be Homogeneous?
,” Eur. Econ. Rev.
, 46
(7
), pp. 1187
–1207
. 13.
Hoever
, I. J.
, Zhou
, J.
, and van Knippenberg
, D.
, 2018
, “Different Strokes for Different Teams: The Contingent Effects of Positive and Negative Feedback on the Creativity of Informationally Homogeneous and Diverse Teams
,” Acad. Manag. J.
, 61
(6
), pp. 2159
–2181
. 14.
Diehl
, M.
, 1992
, “Production Losses in Brainstorming Groups: The Effects of Group Composition on Fluency and Flexibility of Ideas
,” Joint Meeting of the European Association of Experimental Social Psychology and the Society for Experimental Social Psychology
, Leuven/Louvain-la-Neuve, Belgium
.15.
GitHub Inc.
, “HyFormTM GitHub
,” https://github.com/hyform/drone-testbed-server/releases/tag/2021-March-v2, Accessed April 23, 2021.16.
Wright
, D. B.
, 2007
, “Calculating Nominal Group Statistics in Collaboration Studies
,” Behav. Res. Methods
, 39
(3
), pp. 460
–470
. 17.
Linsey
, J. S.
, and Becker
, B.
, 2011
, “Effectiveness of Brainwriting Techniques: Comparing Nominal Groups to Real Teams,” Design Creativity 2010
, Springer
, London
, pp. 165
–171
.18.
Chen
, C. X.
, Trotman
, K. T.
, and Zhou
, F.
, 2015
, “Nominal Versus Interacting Sub-Team Electronic Fraud Brainstorming in Hierarchical Audit Teams
,” Account. Rev.
, 90
(1
), pp. 175
–198
. 19.
Maier
, T.
, DeFranco
, J.
, and McComb
, C.
, 2019
, “An Analysis of Design Process and Performance in Distributed Data Science Teams
,” Team Perform. Manag.
, 25
(7/8
), pp. 419
–439
. 20.
Phadnis
, V.
, Arshad
, H.
, Wallace
, D.
, and Olechowski
, A.
, 2021
, “Are Two Heads Better Than One for Computer-Aided Design?
,” ASME J. Mech. Des
, 143
(7
), p. 071401
. 21.
Mello
, A. S.
, and Ruckes
, M. E.
, 2006
, “Team Composition
,” J. Bus.
, 79
(3
), pp. 1019
–1039
. 22.
Cannon-Bowers
, J. A.
, Salas
, E.
, and Converse
, S.
, 1993
, “Shared Mental Models in Expert Team Decision Making,” Individual and Group Decision Making: Current Issues
, N. J.
Castellan
, ed., Lawrence Erlbaum Associates, Inc.
, Hillsdale, NJ
, pp. 221
–246
.23.
Hill
, A. W.
, Dong
, A.
, and Agogino
, A. M.
, 2002
, “Towards Computational Tools for Supporting the Reflective Team,” Artificial Intelligence in Design’02
, Springer
, Dordrecht
, pp. 305
–325
.24.
Weimann
, P.
, Hinz
, C.
, Scott
, E.
, and Pollock
, M.
, 2010
, “Changing the Communication Culture of Distributed Teams in a World Where Communication Is Neither Perfect nor Complete
,” Electron. J. Inf. Syst. Eval.
, 13
(2
), pp. 187
–196
.25.
Kim
, M. S.
, 2007
, “Analysis of Team Interaction and Team Creativity of Student Design Teams Based on Personal Creativity Modes
,” Proceedings of ASME 2007 International Design Engineering Technical Conferences and Computers
, Las Vegas, NV
, Sept. 4–7
, pp. 1
–13
.26.
Song
, B.
, Soria Zurita
, N. F.
, Zhang
, G.
, Stump
, G.
, Balon
, C.
, Miller
, S. W.
, Yukish
, M.
, Cagan
, J.
, and McComb
, C.
, 2020
, “Toward Hybrid Teams: A Platform to Understand Human-Computer Collaboration During the Design of Complex Engineered Systems
,” International Design Conference – Design 2020
, Virtual
, Oct. 26–29
, pp. 1551
–1560
. 27.
Nguyen
, T. A.
, and Zeng
, Y.
, 2017
, “Effects of Stress and Effort on Self-Rated Reports in Experimental Study of Design Activities
,” J. Intell. Manuf.
, 28
(7
), pp. 1609
–1622
. 28.
Dinar
, M.
, Shah
, J. J.
, Cagan
, J.
, Leifer
, L.
, Linsey
, J.
, Smith
, S. M.
, and Hernandez
, N. V.
, 2015
, “Empirical Studies of Designer Thinking: Past, Present, and Future
,” ASME J. Mech. Des.
, 137
(2
), p. 021101
. 29.
Wickens
, C. D.
, 1992
, Engineering Psychology and Human Performance
, HarperCollins
, New York
.30.
Brown
, I. D.
, 1994
, “Driver Fatigue
,” Hum. Factors
, 36
(2
), pp. 298
–314
. 31.
Fallahi
, M.
, Motamedzade
, M.
, Heidarimoghadam
, R.
, Soltanian
, A. R.
, and Miyake
, S.
, 2016
, “Effects of Mental Workload on Physiological and Subjective Responses During Traffic Density Monitoring: A Field Study
,” Appl. Ergon.
, 52
(1
), pp. 95
–103
. 32.
Heikoop
, D. D.
, de Winter
, J. C.
, van Arem
, B.
, and Stanton
, N. A.
, 2017
, “Effects of Platooning on Signal-Detection Performance, Workload, and Stress: A Driving Simulator Study
,” Appl. Ergon.
, 60
(4
), pp. 116
–127
. 33.
Dym
, C. L.
, Agogino
, A. M.
, Eris
, O.
, Frey
, D. D.
, and Leifer
, L. J.
, 2005
, “Engineering Design Thinking, Teaching, and Learning
,” J. Eng. Edu.
, 94
(1
), pp. 103
–120
. 34.
Kana
, A. A.
, Shields
, C. P. F.
, and Singer
, D. J.
, 2016
, “Why Is Naval Design Decision-Making So Difficult?
” RINA, Royal Institution of Naval Architects—International Conference on Warship 2016: Advanced Technologies in Naval Design, Construction, and Operation, Royal Institution of Naval Architects
, London, UK
, Oct. 26–27
.35.
Sandi
, C.
, 2013
, “Stress and Cognition
,” Wiley Interdiscip. Rev. Cogn. Sci.
, 4
(3
), pp. 245
–261
. 36.
Hart
, S. G.
, and Staveland
, L. E.
, 1988
, “Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research.
” Adv. Psych.
, 52
(4
), pp. 139
–183
.37.
Dykstra
, J.
, and Paul
, C. L.
, 2018
, “Cyber Operations Stress Survey (COSS): Studying Fatigue, Frustration, and Cognitive Workload in Cybersecurity Operations
,” 11th USENIX Workshop on Cyber Security Experimentation and Test (CSET 18)
, Baltimore, MD
, Aug. 13
.38.
Nolte
, H.
, and McComb
, C.
, 2021
, “The Cognitive Experience of Engineering Design: An Examination of First-Year Student Stress Across Principal Activities of the Engineering Design Process
,” Des. Sci.
, 7
(3
), pp. 1
–31
. 39.
Battiste
, V.
, and Bortolussi
, M.
, 1988
, “Transport Pilot Workload: A Comparison of Two Subjective Techniques
,” Proceedings of the Human Factors Society Thirty Second Annual Meeting
, Human Factors Society
, Santa Monica, CA
, pp. 150
–154
.40.
Rubio
, S.
, Díaz
, E.
, Martín
, J.
, and Puente
, J. M.
, 2004
, “Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA-TLX, and Workload Profile Methods
,” Appl. Psychol.
, 53
(1
), pp. 61
–86
. 41.
Hertel
, G.
, Geister
, S.
, and Konradt
, U.
, 2005
, “Managing Virtual Teams: A Review of Current Empirical Research
,” Hum. Resour. Manag. Rev.
, 15
(1
), pp. 69
–95
. 42.
Gibson
, C. B.
, and Gibbs
, J. L.
, 2006
, “Unpacking the Concept of Virtuality: The Effects of Geographic Dispersion, Electronic Dependence, Dynamic Structure, and National Diversity on Team Innovation
,” Adm. Sci. Q.
, 51
(3
), pp. 451
–495
. 43.
Mascitelli
, R.
, 2000
, “From Experience: Harnessing Tacit Knowledge to Achieve Breakthrough Innovation
,” J. Prod. Innov. Manag.
, 17
(3
), pp. 179
–193
. 44.
Sailer
, K.
, 2011
, “Creativity as Social and Spatial Process
,” Facilities
, 29
(1/2
), pp. 6
–18
. 45.
Thompson
, L.
, 2021
, “Virtual Collaboration Won’t Be the Death of Creativity
,” MIT Sloan Manag Rev
, https://sloanreview.mit.edu/article/virtual-collaboration-wont-be-the-death-of-creativity/46.
Leenders
, R. T. A. J.
, Van Engelen
, J. M. L.
, and Kratzer
, J.
, 2003
, “Virtuality, Communication, and New Product Team Creativity: A Social Network Perspective
,” J. Eng. Technol. Manag.
, 20
(1–2
), pp. 69
–92
. 47.
Marlow
, S. L.
, Lacerenza
, C. N.
, Paoletti
, J.
, Burke
, C. S.
, and Salas
, E.
, 2018
, “Does Team Communication Represent a One-Size-Fits-All Approach?: A Meta-Analysis of Team Communication and Performance
,” Organ. Behav. Hum. Decis. Process.
, 144
(1
), pp. 145
–170
. 48.
Jarvenpaa
, S. L.
, and Leidner
, D. E.
, 1999
, “Communication and Trust in Global Virtual Teams
,” Org. Sci.
, 10
(6
), pp. 791
–815
. 49.
Marlow
, S. L.
, Lacerenza
, C. N.
, and Salas
, E.
, 2017
, “Communication in Virtual Teams: A Conceptual Framework and Research Agenda
,” Hum. Resour. Manag. Rev.
, 27
(4
), pp. 575
–589
. 50.
Martins
, L. L.
, Gilson
, L. L.
, and Maynard
, M. T.
, 2004
, “Virtual Teams: What Do We Know and Where Do We Go From Here?
,” J. Manag.
, 30
(6
), pp. 805
–835
. 51.
Hiltz
, S. R.
, Johnson
, K.
, and Turoff
, M.
, 1986
, “Experiments in Group Decision Making Communication Process and Outcome in Face-to-Face Versus Computerized Conferences
,” Hum. Commun. Res.
, 13
(2
), pp. 225
–252
. 52.
Singh
, H.
, Cascini
, G.
, and McComb
, C.
, 2022
, “Virtual and Face-to-Face Team Collaboration Comparison Through an Agent-Based Simulation
,” ASME. J. Mech. Des.
, 144
(7
), p. 071706
. 53.
Kirkman
, B. L.
, and Mathieu
, J. E.
, 2005
, “The Dimensions and Antecedents of Team Virtuality
,” J. Manag.
, 31
(5
), pp. 700
–718
. 54.
Marks
, M. A.
, Zaccaro
, S. J.
, and Mathieu
, J. E.
, 2000
, “Performance Implications of Leader Briefings and Team-Interaction Training for Team Adaptation to Novel Environments
,” J. Appl. Psychol.
, 85
(6
), pp. 971
–986
. 55.
González-Romá
, V.
, and Hernández
, A.
, 2014
, “Climate Uniformity: Its Influence on Team Communication Quality, Task Conflict, and Team Performance
,” J. Appl. Psychol.
, 99
(6
), pp. 1042
–1058
. 56.
Warkentin
, M. E.
, Sayeed
, L.
, and Hightower
, R.
, 1997
, “Virtual Teams Versus Face-to-Face Teams: An Exploratory Study of a Web-Based Conference System
,” Dec. Sci.
, 28
(4
), pp. 975
–996
. 57.
McIntyre
, R.M
, and Salas
, E.
, 1995
, “Measuring and Managing for Team Performance: Emerging Principles From Complex Environments
,” Team Effectiveness and Decision Making in Organizations
, 16
, pp. 9
–45
.58.
Keyton
, J.
, 1997
, “Coding Communication in Decision-Making Groups
,” Managing Group Life: Communicating in Decision-Making Groups
, pp. 236
–269
.59.
Monge
, P. R.
, Contractor
, N. S.
, Contractor
, P. S.
, Peter
, R.
, and Noshir
, S.
, 2003
, Theories of Communication Networks
, Oxford University Press
, Oxford, UK
.60.
Gyory
, J. T.
, Soria Zurita
, N. F.
, Martin
, J.
, Balon
, C.
, McComb
, C.
, Kotovsky
, K.
, and Cagan
, J.
, 2022
, “Human Versus Artificial Intelligence: A Data-Driven Approach to Real-Time Process Management During Complex Engineering Design
,” ASME J. Mech. Des.
, 144
(2
), p. 021405
. 61.
Song
, B.
, Gyory
, J. T.
, Zhang
, G.
, Soria Zurita
, N. F.
, Stump
, G.
, Martin
, J.
, Miller
, S.
, Balon
, C.
, Yukish
, M.
, McComb
, C.
, and Cagan
, J.
, 2022
, “Decoding the Agility of Human—Decoding the Agility of Human-Artificial Intelligence Hybrid Teams in Complex Problem Solving
,” Des. Stud.
, p. 101094
. 62.
Gibson
, C. B.
, Zellmer-Bruhn
, M. E.
, and Schwab
, D. P.
, 2003
, “Team Effectiveness in Multinational Organizations
,” Group Organ. Manag.
, 28
(4
), pp. 444
–474
. 63.
Schaefer
, K. E.
, 2016
, “Measuring Trust in Human Robot Interactions: Development of the “Trust Perception Scale-HRI,” Robust Intelligence and Trust in Autonomous Systems
, R.
Mittu
, D.
Sofge
, A.
Wagner
, and W.
Lawless
, eds., Springer, New York
, pp. 191
–218
.64.
Wheelan
, S. A.
, and Hochberger
, J. M.
, 1966
, “Validation Studies of the Group Development Questionaire
,” Small Group Res.
, 27
(1
), pp. 143
–170
. 65.
Sio
, U. N.
, Kotovsky
, K.
, and Cagan
, J.
, 2018
, “Silence Is Golden: The Effect of Verbalization on Group Performance
,” J. Exp. Psychol.
, 147
(6
), pp. 939
–944
. 66.
Patrashkova-Volzdoska
, R. R.
, McComb
, S. A.
, Green
, S. G.
, and Compton
, W. D.
, 2003
, “Examining a Curvilinear Relationship Between Communication Frequency and Team Performance in Cross-Functional Project Teams
,” IEEE Trans. Eng. Manag.
, 50
(3
), pp. 262
–269
. 67.
Mortensen
, M.
, and Hinds
, P. J.
, 2001
, “Conflict and Shared Identity in Geographically Distributed Teams
,” Int. J. Confl. Manag.
, 50
(3
), pp. 212
–238
. 68.
Katsma
, C.
, Amrit
, C.
, van Hillegersberg
, J.
, and Sikkel
, K.
, 2013
, “Can Agile Software Tools Bring the Benefits of a Task Board to Globally Distributed Teams?
” International Workshop on Global Sourcing of Information Technology and Business Processes
, Val d'Isère, France
, Mar. 11–14
, Springer
, Berlin/Heidelberg
, pp. 163
–179
.69.
Kruger
, J.
, and Dunning
, D.
, 1999
, “Unskilled and Unaware of It: How Difficulties in Recognizing One's Own Incompetence Lead to Inflated Self-Assessments
,” J. Person. Soc. Psychol.
, 77
(6
), p. 1121
. 70.
Karpen
, S. C.
, 2018
, “The Social Psychology of Biased Self-Assessment
,” Am. J. Pharm. Edu.
, 82
(5
), p. 6299
. 71.
De Jong
, B. A.
, Dirks
, K. T.
, and Gillespie
, N.
, 2016
, “Trust and Team Performance: A Meta-Analysis of Main Effects, Moderators, and Covariates
,” J. Appl. Psychol.
, 101
(8
), p. 1134
. 72.
Edmondson
, A.
, 1999
, “Psychological Safety and Learning Behavior in Work Teams
,” Admin. Sci. Quarter.
, 44
(2
), pp. 350
–383
. 73.
Mesmer-Magnus
, J. R.
, and DeChurch
, L. A.
, 2009
, “Information Sharing and Team Performance: A Meta-Analysis
,” J. Appl. Psychol.
, 94
(2
), pp. 535
–546
. 74.
Bear
, J. B.
, and Woolley
, A. W.
, 2011
, “The Role of Gender in Team Collaboration and Performance
,” Interdiscip. Sci. Rev.
, 36
(2
), pp. 146
–153
. 75.
Gyory
, J. T.
, Soria Zurita
, N. F.
, Cagan
, J.
, and McComb
, C.
, 2022
, “Comparing Nominal and Interacting Sub-Structured Teams in an Interdisciplinary Engineering Design Task
,” International Design and Engineering Technical Conferences
, St. Louis, MO
, Aug. 14–17
, pp. 1
–9
.Copyright © 2023 by ASME
You do not currently have access to this content.
