Abstract
The objective of this research is to understand how different representations of requirements influence idea generation in terms of quantity, addressment, novelty, and variety of conceptual sketches. Requirements are testable statements of need, desires, and wishes of the stakeholders that are used by engineers to frame the problem. Project success is highly dependent on well-defined requirements documents. An experimental study was conducted with 52 fourth-year mechanical engineering undergraduate students. Two design problems are used with three different representations: a problem statement with embedded requirements, a problem statement and a traditional requirement list, and a problem statement with contextualized scrum stories. Each student addressed both design problems with two different representations of requirements. It was found that the use of contextualized scrum story representations significantly affected the novelty of solution fragments and addressment of requirements, while no significant change in variety and quantity was seen. Finally, it was found that quantity is not directly related to the number of requirements addressed in the sketches.
Graphical Abstract Figure
References
1.
Ulrich
, K.
, and Eppinger
, S. D.
, 2008
, Product Design and Development
, McGraw-Hill
, New York
.2.
Ullman
, D. G.
, 2018
, The Mechanical Design Process
, David Ullman LLC
, Independence, OR
.3.
Dym
, C. L. L.
, and Little
, P.
, 2004
, Engineering Design: A Project-Based Introduction
, John Wiley and Sons
, New York
.4.
Dixon
, J. R.
, and Poli
, C.
, 1995
, Engineering Design and Design for Manufacturing: A Structured Approach: Text and Reference for Mechanical Engineers
, Field Stone Pub
, Conway, MA
.5.
Pew
, Richard W.
, and Mavor
, Anne S.
, 2007
, Human-System Integration in the System Development Process: A New Look
, National Research Council, National Academies Press
, Washington, DC
.6.
Shankar
, P.
, Morkos
, B.
, and Summers
, J. D.
, 2012
, “Predicting Requirement Change Propagation Using Higher Order Design Structure Matrices: An Industry Case Study
,” Res. Eng. Des.
, 23
(12
), pp. 905
–926
. 7.
Lam
, W.
, Loomes
, M.
, and Shankararaman
, V.
, 1999
, “Managing Requirements Change Using Metrics and Action Planning
,” Proceedings of the Third European Conference on Software Maintenance and Reengineering (Cat. No. PR00090)
, Amsterdam, The Netherlands
, Mar. 3–5
, IEEE, pp. 122
–128
.8.
Lam
, W.
, and Shankararaman
, V.
, 1999
, “Requirements Change: A Dissection of Management Issues
,” Proceedings of the 25th EUROMICRO Conference, 1999
, Milan, Italy
, Sept. 8–11
, IEEE, pp. 244
–251
.9.
Shankar
, P.
, Morkos
, B.
, and Summers
, J. D.
, 2012
, “Reasons for Change Propagation: A Case Study in an Automotive OEM
,” Res. Eng. Des.
, 23
(4
), pp. 291
–303
. 10.
Morkos
, B.
, Mathieson
, J.
, and Summers
, J. D.
, 2014
, “Comparative Analysis of Requirements Change Prediction Models: Manual, Linguistic, and Neural Network
,” Res. Eng. Des.
, 25
(2
), pp. 139
–156
. 11.
Hein
, P. H.
, Kames
, E.
, Chen
, C.
, and Morkos
, B.
, 2021
, “Employing Machine Learning Techniques to Assess Requirement Change Volatility
,” Res. Eng. Des.
, 32
(2
), pp. 245
–269
. 12.
Hein
, P. H.
, Kames
, E.
, Chen
, C.
, and Morkos
, B.
, 2022
, “Reasoning Support for Predicting Requirement Change Volatility Using Complex Network Metrics
,” J. Eng. Des.
, 33
(11
), pp. 811
–837
. 13.
Shah
, J. J.
, Smith
, S. M.
, and Vargas-Hernández
, N.
, 2003
, “Metrics for Measuring Ideation Effectiveness
,” Des. Stud.
, 24
(2
), pp. 111
–134
. 14.
Shah
, J. J.
, Kulkarni
, S. V.
, and Vargas-Hernandez
, N.
, 2000
, “Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments
,” ASME J. Mech. Des.
, 122
(4
), pp. 377
–384
. 15.
Chen
, C.
, and Morkos
, B.
, 2023
, “Exploring Topic Modelling for Generalising Design Requirements in Complex Design
,” J. Eng. Des.
, 34
(11
), pp. 922
–940
. 16.
Chen
, C.
, Carroll
, C.
, and Morkos
, B.
, 2023
, “From Text to Images: Linking System Requirements to Images Using Joint Embedding
,” Proc. Des. Soc.
, 3
, pp. 1985
–1994
. 17.
Spivey
, N.
, Ortiz
, J.
, Patel
, A.
, Davenport
, B.
, and Summers
, J. D.
, 2021
, “Analysis of the Impact of Requirement-Sketch Sequencing on Requirement Generation in Conceptual Design
,” ASME J. Mech. Des.
, 143
(12
), p. 121402
. 18.
Joshi
, S.
, Shankar
, P.
, and Summers
, J. D.
, 2012
, “Requirements in Engineering Design: What are we Teaching?
” Tools and Methods for Competitive Engineering
, Karlsrule, Germany
, May 7–11
, pp. 1319
–1326
.19.
Pahl
, G.
, Beitz
, W.
, Blessing
, L.
, Feldhusen
, J.
, Grote
, K.-H. H.
, and Wallace
, K.
, 2013
, Engineering Design: A Systematic Approach
, Springer-Verlag London Limited
, London
.20.
Buede
, D. M.
, and Miller
, W. D.
, 2016
, The Engineering Design of Systems: Models and Methods
, John Wiley & Sons
, Hoboken, NJ
.21.
Ullman
, D. G.
, 2019
, Scrum for Hardware Design: Supporting Material for the Mechanical Design Process
, David Ullman LLC
, Corvallis, OR
.22.
Rising
, L.
, and Janoff
, N. S.
, 2000
, “The Scrum Software Development Process for Small Teams
,” IEEE Softw.
, 17
(4
), pp. 26
–32
. 23.
Collopy
, P.
, 2007
, “Adverse Impact of Extensive Attribute Requirements on the Design of Complex Systems
,” 7th AIAA ATIO Conf., 2nd CEIAT International Conference on Innovation and Integration in Aero Sciences, 17th LTA Systems Tech. Conf.; Followed by 2nd TEOS Forum
, Belfast, Northern Ireland
, Sept. 18–20
, p. 7820
.24.
Collopy
, P. D.
, and Hollingsworth
, P. M.
, 2011
, “Value-Driven Design
,” J. Aircr.
, 48
(3
), pp. 749
–759
. 25.
Raviselvam
, S.
, Hölttä-Otto
, K.
, and Wood
, K. L.
, 2016
, “User Extreme Conditions to Enhance Designer Empathy and Creativity: Applications Using Visual Impairment
,” ASME 2016 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
, Charlotte, NC
, Aug. 21–24
.26.
Wong
, K.
, Norris
, R. L.
, Siddique
, Z.
, Altan
, M. C.
, Baldwin
, J.
, and Merchan-Merchan
, W.
, 2016
, “Cognitive Empathy in Design Course for a More Inclusive Mechanical Engineering
,” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
, Charlotte, NC
, Aug. 21–24
.27.
Gudur
, R. R.
, 2023
, “Teaching Empathetic Design Through the Pedagogy of Discomfort
,” Proceedings of the International Conference on Engineering and Product Design Education, E&PDE 2023
, Barcelona, Spain
, Sept. 7–8
, No. 1177
.28.
Alzayed
M. A.
, McComb
, C.
, Menold
, J.
, Huff
, J.
, and Miller
, S. R.
, 2021
, “Are You Feeling Me? An Exploration of Empathy Development in Engineering Design Education
,” ASME J. Mech. Des.
, 143
(11
), p. 112301
. 29.
Hernandez
, N. V.
, Schmidt
, L. C.
, Kremer
, G. O.
, and Lin
, C.-Y.
, 2014
, “An Empirical Study of the Effectiveness of Selected Cognitive Aids on Multiple Design Tasks
,” Design Computing and Cognition’12
, College Station, TX
, Springer, pp. 227
–246
.30.
Schmidt
, L. C.
, Vargas Hernandez
, N.
, Kremer
, G. L.
, and Linsey
, J.
, 2010
, “Pilot of Systematic Ideation Study With Lessons Learned
,” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
, Montreal, Canada
, Aug. 15–18
.31.
Liu
, S.
, Li
, Q.
, Liu
, J.
, Chen
, W.
, and Zhang
, Y.
, 2018
, “A Realization Method for Transforming a Topology Optimization Design Into Additive Manufacturing Structures
,” Engineering
, 4
(2
), pp. 277
–285
. 32.
McGown
, A.
, Green
, G.
, and Rodgers
, P. A.
, 1998
, “Visible Ideas: Information Patterns of Conceptual Sketch Activity
,” Des. Stud.
, 19
(4
), pp. 431
–453
. 33.
Veisz
, D.
, Namouz
, E. Z.
, Joshi
, S.
, and Summers
, J. D.
, 2012
, “Computer-Aided Design Versus Sketching: An Exploratory Case Study
,” AI EDAM
, 26
(3
), pp. 317
–335
. 34.
Westmoreland
, S.
, Ruocco
, A.
, and Schmidt
, L.
, 2011
, “Analysis of Capstone Design Reports: Visual Representations
,” ASME J. Mech. Des.
, 133
(5
), p. 051010
. 35.
Hannah
, R.
, Joshi
, S.
, and Summers
, J. D.
, 2012
, “A User Study of Interpretability of Engineering Design Representations
,” J. Eng. Des.
, 23
(6
), pp. 443
–468
. 36.
McKoy
, F. L.
, Vargas-Hernández
, N.
, Summers
, J. D.
, and Shah
, J. J.
, 2001
, “Influence of Design Representation on Effectiveness of Idea Generation
,” Proceedings of ASME Design Theory and Methodology Conference
, Pittsburg, PA
, Sept. 9–12
.37.
Martin-Erro
, A.
, Somonte
, M. D.
, and Escudero
, M. E.
, 2016
, “The Role of Sketching in Engineering Design and Its Presence on Engineering Education
,” Proceedings of INTED2016 Conference
, Valencia, Spain
, Mar. 7–9
.38.
Shah
, J. J.
, Vargas-Hernandez
, N.
, Summers
, J. D.
, and Kulkarni
, S.
, 2001
, “Collaborative Sketching (C-Sketch)—An Idea Generation Technique for Engineering Design
,” J. Creat. Behav.
, 35
(3
), pp. 168
–198
. 39.
Patel
, A.
, Elena
, M.-V.
, and Summers
, J.
, 2020
, “Designing Design Prompts: A Systematic Approach to Support Engineering Design Research
,” J. Des. Res.
, 18
(5–6
), pp. 327
–355
.40.
Chulvi
, V.
, Sonseca
, Á.
, Mulet
, E.
, and Chakrabarti
, A.
, 2012
, “Assessment of the Relationships Among Design Methods, Design Activities, and Creativity
,” ASME J. Mech. Des.
, 134
(11
), p. 111004
. 41.
Joshi
, S.
, and Summers
, J. D.
, 2014
, “Impact of Requirements Elicitation Activity on Idea Generation: A Designer Study
,” ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
, Buffalo, NY
, Aug. 17–20
.42.
Worinkeng
, E.
, Summers
, J. D.
, and Joshi
, S.
, 2013
, “Can a Pre-Sketching Activity Improve Idea Generation?
” CIRP Design
, Bochum, Germany
, Mar. 11–13
, Springer, New York, pp. 583–592
.43.
Wetmore
W. R.
III, Summers
, J. D.
, and Greenstein
, J. S.
, 2010
, “Experimental Study of Influence of Group Familiarity and Information Sharing on Design Review Effectiveness
,” J. Eng. Des.
, 21
(1
), pp. 111
–126
. 44.
Miller
, K. J.
, and Vanni
, M.
, 2005
, “Inter-rater Agreement Measures, and the Refinement of Metrics in the PLATO MT Evaluation Paradigm
,” Proceedings of Machine Translation Summit X: Papers
, Phuket, Thailand
, Sept. 13–15
, Springer, New York, pp. 125
–132
.45.
Worinkeng
, E.
, Joshi
, S.
, and Summers
, J. D.
, 2015
, “An Experimental Study: Analyzing Requirement Type Influence on Novelty and Variety of Generated Solutions
,” Int. J. Des. Creat. Innov.
, 3
(2
), pp. 61
–77
. 46.
Spivey
, N.
, Davenport
, B.
, Patel
, A.
, Ortiz
, J.
, and Summers
, J. D.
, 2020
, “Influence of Conceptual Sketches on Variety, Typology, and Novelty of Elicited Requirements
,” ASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
, Virtual
, Aug. 17–19
.47.
Chawla
, A.
, and Summers
, J. D.
, 2019
, “How Function Ordering Within Morphological Charts Influence Exploration
,” ASME J. Mech. Des.
, 141
(9
), p. 094502
. 48.
Smith
, G.
, Richardson
, J.
, Summers
, J. D.
, and Mocko
, G. M.
, 2012
, “Concept Exploration Through Morphological Charts: An Experimental Study
,” ASME J. Mech. Des.
, 134
(5
), p. 051004
. 49.
Nelson
, B. A.
, Wilson
, J. O.
, Rosen
, D.
, and Yen
, J.
, 2009
, “Refined Metrics for Measuring Ideation Effectiveness
,” Des. Stud.
, 30
(6
), pp. 737
–743
. 50.
Patel
, A.
, 2021
, “An Experimental Study Exploring the Influence of Different Representation of Requirements on Idea Generation
,” MS Thesis, Clemson University
, Clemson, SC
.51.
Chickarello
, D.
, Righter
, J.
, Patel
, A.
, and Summers
, J. D.
, 2018
, “Establishing a Protocol to Observe Leadership Behaviors Within Engineering Design Teams
,” International Design Engineering Technical Conferences
, Quebec City, Canada
, Aug. 26–29
.52.
Stidham
, H.
, Flynn
, M.
, Summers
, J. D.
, and Shuffler
, M.
, 2018
, “Understanding Team Personality Evolution in Student Engineering Design Teams Using the Five Factor Model
,” ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
, Quebec City, Canada
, Aug. 26–29
.53.
Righter
, J.
, Chickarello
, D.
, Stidham
, H.
, O'Shields
, S.
, Patel
, A.
, and Summers
, J.
, 2017
, “Literature Based Review of a Collaborative Design Taxonomy
,” Proceedings of the International Conference on Engineering Design, ICED
, Vancouver, Canada
, Aug. 24–29
, pp. 607
–616
.54.
Mullis
, J.
, Chen
, C.
, Morkos
, B.
, and Ferguson
, S.
, 2024
, “Deep Neural Networks in Natural Language Processing for Classifying Requirements by Origin and Functionality: An Application of BERT in System Requirements
,” ASME J. Mech. Des.
, 146
(4
), p. 041401
. 55.
Summers
, J. D.
, Joshi
, S.
, and Morkos
, B.
, 2014
, “Requirements Evolution: Relating Functional and Non-functional Requirement Change on Student Project Success
,” Proceedings of the ASME Design Engineering Technical Conference
, Buffalo, NY
, Aug. 17–20
.56.
Shankar
, P.
, Morkos
, B.
, Yadav
, D.
, and Summers
, J. D.
, 2020
, “Towards the Formalization of Non-functional Requirements in Conceptual Design
,” Res. Eng. Des.
, 31
(4
), pp. 449
–469
. 
