Abstract

Sketching is an important tool for engineers during concept generation. Sketch quantity during this early stage of design has been linked with eventual design outcomes and sketch quality has been linked with design perceptions. As such, both are important metrics to track. Prior work has also found gender differences in some of these sketch attributes, and considering gender imbalances in the field, it is important to assess whether there are differences in performance by gender during concept generation and if the use of digital tools exacerbate or mitigate any of these potential differences in performance by gender. Given the increase in use of digital tablets for sketching, it is important to assess how tablet use affects early stage engineering design sketches. This is especially important as tablets can automatically smooth lines and help perfect sketch features, but these features may also take longer to use and may result in fewer sketches produced. This study investigates differences in sketch quality, quantity, and understandability (the effectiveness of the sketch as a communication tool) between sketching on a tablet and sketching with pen on paper during an engineering design concept generation exercise. Results indicate that there is no difference in sketch quantity or understandability between the two tools. However, sketch quality, smoothness, and proportion/accuracy are all higher for the pen and paper condition than for the tablet condition. Finally, no gender differences in performance for either sketch quantity or quality were found.

Graphical Abstract Figure
Graphical Abstract Figure
Close modal

References

1.
Company
,
P.
,
Contero
,
M.
,
Varley
,
P.
,
Aleixos
,
N.
, and
Naya
,
F.
,
2009
, “
Computer-Aided Sketching as a Tool to Promote Innovation in the New Product Development Process
,”
Comput. Ind.
,
60
(
8
), pp.
592
603
.
2.
Goel
,
V.
,
1995
,
Sketches of Thought
,
MIT Press
.
3.
Saravi
,
M.
,
Newnes
,
L.
,
Mileham
,
A. R.
, and
Goh
,
Y. M.
,
2008
, “
Estimating Cost at the Conceptual Design Stage to Optimize Design in Terms of Performance and Cost
,”
Collaborative Product and Service Life Cycle Management for a Sustainable World: Proceedings of the 15th ISPE International Conference on Concurrent Engineering (CE2008)
,
London, UK
,
January
, pp.
123
130
.
4.
Barnhart
,
B.
, and
Walters
,
K.
,
2018
, “
The Hot Industrial Design Sketch: Perpetuating the Dominance of the Male Industrial Designer
,”
DS 93: Proceedings of the 20th International Conference on Engineering and Product Design Education (E&PDE 2018)
,
London, UK
,
September
.
5.
Das
,
M.
,
Huang
,
M.
, and
Yang
,
M. C.
,
2022
, “
Tablets, Pens, and Pencils: The Influence of Tools on Sketching in Early Stage Design
,”
International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
St. Louis, MO
,
Aug. 14–17
.
6.
Pearsall
,
M. J.
,
Ellis
,
A. P. J.
, and
Evans
,
J. M.
,
2008
, “
Unlocking the Effects of Gender Faultlines on Team Creativity: Is Activation the Key?
J. Appl. Psychol.
,
93
(
1
), pp.
225
234
.
7.
Toh
,
C. A.
, and
Miller
,
S. R.
,
2015
, “
How Engineering Teams Select Design Concepts: A View Through the Lens of Creativity
,”
Des. Stud.
,
38
, pp.
111
138
.
8.
Westmoreland
,
S.
,
Ruocco
,
A.
, and
Schmidt
,
L.
,
2011
, “
Analysis of Capstone Design Reports: Visual Representations
,”
ASME J. Mech. Des.
,
133
(
5
), p.
051010
.
9.
Das
,
M.
, and
Yang
,
M. C.
,
2021
, “
Assessing Early Stage Design Sketches and Reflections on Prototyping
,”
International Design Engineering Technical Conferences & Computers and Information in Engineering Conference
,
Virtual, Online
,
August 2021
.
10.
Yang
,
M. C.
,
2004
, “
An Examination of Prototyping and Design Outcome
,”
International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Salt Lake City, UT
,
Sept. 28–Oct. 2
, Vol. 46962, pp.
497
502
.
11.
Cham
,
J. G.
, and
Yang
,
M. C.
,
2005
, “
Does Sketching Skill Relate to Good Design?
International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Long Beach, CA
,
September 2005
, pp.
301
308
..
12.
Song
,
S.
, and
Agogino
,
A. M.
,
2004
, “
Insights on Designers' Sketching Activities in New Product Design Teams
,”
Vol. 3a: 16th International Conference on Design Theory and Methodology
,
Salt Lake City, UT
,
Sept. 24–28
, pp.
351
360
.
13.
Takai
,
S.
,
Esterman
,
M.
, and
Midha
,
A.
,
2015
, “
An Approach to Study Associations Between Design Concepts and Design Outcomes
,”
ASME J. Mech. Des.
,
137
(
4
), p.
041101
.
14.
Kudrowitz
,
B.
,
Te
,
P.
, and
Wallace
,
D.
,
2012
, “
The Influence of Sketch Quality on Perception of Product-Idea Creativity
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
26
(
3
), pp.
267
279
.
15.
Kwon
,
J.
, and
Kudrowitz
,
B.
,
2021
, “
The Sketch Quality Bias: Evaluating Descriptions of Product Ideas With and Without Visuals
,”
International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Anaheim, CA
,
Aug. 17–20
.
16.
Das
,
M.
, and
Yang
,
M.
,
2022
, “
Assessing Early Stage Design Sketches and Reflections on Prototyping
,”
ASME J. Mech. Des.
,
144
(
4
), p.
041403
.
17.
Weaver
,
M. B.
,
Buck
,
J.
,
Merzdorf
,
H.
,
Dorozhkin
,
D.
,
Douglas
,
K.
, and
Linsey
,
J.
,
2022
, “
Investigating Priming Effects of Sketch Evaluation Instructions on Idea Generation Productivity
,”
Volume 6: 34th International Conference on Design Theory and Methodology (DTM)
,
St. Louis, MO
,
Aug. 14–17
.
18.
McAlpine
,
H. C.
,
Hicks
,
B.
, and
Culley
,
S.
,
2009
, “
Improving Re-use of Informal Information Through the Creation of an Engineering Electronic Logbook (EEL): A Demonstrator
,”
Vol. 2: 29th Computers and Information in Engineering Conference, Parts A B
,
San Diego, CA
,
Aug. 30–Sept. 2
, pp.
843
850
.
19.
Lohani
,
V.
,
Castles
,
R.
,
Lo
,
J.
, and
Griffin
,
O.
,
2007
, “
Tablet Pc Applications in a Large Engineering Program
,”
2009 Annual Conference & Exposition
,
Honolulu, HI
,
June 14
.
20.
Häggman
,
A.
,
Tsai
,
G.
,
Elsen
,
C.
,
Honda
,
T.
, and
Yang
,
M. C.
,
2015
, “
Connections Between the Design Tool, Design Attributes, and User Preferences in Early Stage Design
,”
ASME J. Mech. Des.
,
137
(
7
), p.
071408
.
21.
Kudrowitz
,
B. M.
, and
Wallace
,
D.
,
2013
, “
Assessing the Quality of Ideas From Prolific, Early-Stage Product Ideation
,”
J. Eng. Des.
,
24
(
2
), pp.
120
139
.
22.
Yang
,
M. C.
,
2009
, “
Observations on Concept Generation and Sketching in Engineering Design
,”
Res. Eng. Des.
,
20
(
1
), pp.
1
11
.
23.
Yang
,
M. C.
,
2003
, “
Concept Generation and Sketching: Correlations With Design Outcome
,”
International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Chicago, IL
,
Sept. 13–16
, pp.
829
834
.
24.
Yang
,
M. C.
, and
Cham
,
J. G.
,
2007
, “
An Analysis of Sketching Skill and Its Role in Early Stage Engineering Design
,”
ASME J. Mech. Des.
,
129
(
5
), pp.
476
482
.
25.
Ferguson
,
E. S.
,
1994
,
Engineering and the Mind's Eye
,
MIT Press
.
26.
Radcliffe
,
D. F.
, and
Lee
,
T. Y.
,
1990
, “
Models of Visual Thinking by Novice Designers
,”
2nd International Conference on Design Theory and Methodology
,
Chicago, IL
,
Sept. 16–19
, pp.
145
152
.
27.
Bar-Eli
,
S.
,
2013
, “
Sketching Profiles: Awareness to Individual Differences in Sketching as a Means of Enhancing Design Solution Development
,”
Des. Stud.
,
34
(
4
), pp.
472
493
.
28.
Hilton
,
E.
,
Willifor
,
B.
,
Li
,
W.
,
McTigue
,
E.
,
Hammond
,
T.
, and
Linsey
,
J.
,
2016
, “
Consistently Evaluating Sketching Ability in Engineering Curriculum
,”
Fourth International Conference on Design Creativity
,
Atlanta, GA
,
Nov. 2–4
.
29.
Hammond
,
T.
,
Kumar
,
S. P. A.
,
Runyon
,
M.
,
Cherian
,
J.
,
Williford
,
B.
,
Keshavabhotla
,
S.
,
Valentine
,
S.
,
Li
,
W.
, and
Linsey
,
J.
,
2018
, “
It’s Not Just About Accuracy: Metrics That Matter When Modeling Expert Sketching Ability
,”
ACM Trans. Interact. Intell. Syst.
,
8
(
3
), pp.
1
47
.
30.
Letting
,
C.
,
Krishnakumar
,
S.
,
Johnson
,
E.
,
Zurita
,
N. S.
, and
Menold
,
J.
,
2023
, “
Investigating the Effect of Sketch Quality on the Shared Understanding of Design Dyads
,”
24th International Conference on Engineering Design (ICED23)
,
Bordeaux, France
,
July 24–28
.
31.
Linsey
,
J. S.
,
Clauss
,
E. F.
,
Kurtoglu
,
T.
,
Murphy
,
J. T.
,
Wood
,
K. L.
, and
Markman
,
A. B.
,
2011
, “
An Experimental Study of Group Idea Generation Techniques: Understanding the Roles of Idea Representation and Viewing Methods
,”
ASME J. Mech. Des.
,
133
(
3
), p.
031008
.
32.
Jia
,
M.
,
Jiang
,
S.
,
Hu
,
J.
, and
Qi
,
J.
,
2023
, “
Toward Understanding Sources and Influences of Design Fixation: A Focus on Example Stimuli and Background of Novice Designers
,”
ASME J. Mech. Des.
,
145
(
5
), p.
051402
.
33.
Hu
,
W.-L.
,
Booth
,
J.
, and
Reid
,
T.
,
2015
, “
Reducing Sketch Inhibition During Concept Generation: Psychophysiological Evidence of the Effect of Interventions
,”
Vol. 7: 27th International Conference on Design Theory and Methodology
,
Boston, MA
,
Aug. 2–5
.
34.
Koronis
,
G.
,
Chia
,
P. Z.
,
Siang
,
J. K. K.
,
Silva
,
A.
,
Yogiaman
,
C.
, and
Raghunath
,
N.
,
2019
, “
An Empirical Study on the Impact of Design Brief Information on the Creativity of Design Outcomes With Consideration of Gender, and Gender Diversity
,”
ASME J. Mech. Des.
,
141
(
7
), p.
071102
.
35.
Das
,
M.
, and
Yang
,
M.
,
2022
, “
Building Confidence and Embracing Failure Through Sketching Practice
,”
Int. J. Eng. Educ.
,
38
(
6
), pp.
1779
1790
.
36.
Roldan
,
W.
,
Hui
,
J.
, and
Gerber
,
E. M.
,
2018
, “
University Makerspaces: Opportunities to Support Equitable Participation for Women in Engineering*
,”
Int. J. Eng. Educ.
,
34
(
2(B)
), pp.
751
768
.
37.
George
,
S. M.
, and
Domire
,
Z. J.
,
2020
, “
A Six-Year Review of the Biomedical Engineering in Simulations, Imaging, and Modeling Undergraduate Research Experience
,”
ASME J. Biomech. Eng.
,
142
(
11
), p.
111012
.
38.
Reed
,
E. C.
,
Kain
,
D.
, and
George
,
S. M.
,
2021
, “
The Relationship Between Perceived Confidence, Gender, and Writing in a Biomedical Engineering Research Experience for Undergraduates Site
,”
ASME J. Biomech. Eng.
,
143
(
12
), p.
121010
.
39.
Oti
,
A.
, and
Crilly
,
N.
,
2021
, “
Immersive 3D Sketching Tools: Implications for Visual Thinking and Communication
,”
Comput. Graph
,
94
, pp.
111
123
.
40.
Song
,
I.
,
Yang
,
J.
, and
Shimada
,
K.
,
2014
, “
Development of Sketch-Based 3-D Modeling System for Rapid Generation and Evaluation of Automotive Seat Shape Using Reference Models
,”
ASME J. Mech. Des.
,
136
(
5
), p.
051001
.
41.
Bernhaupt
,
R.
,
Mueller
,
F.
,
Verweij
,
D.
,
Andres
,
J.
,
McGrenere
,
J.
,
Cockburn
,
A.
,
Avellino
,
I.
, et al
,
2020
, “
Live Sketchnoting Across Platforms: Exploring the Potential and Limitations of Analogue and Digital Tools
,”
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
,
Honolulu, HI
,
Apr. 25–30
.
42.
Orbay
,
G.
, and
Kara
,
L. B.
,
2012
, “
Shape Design From Exemplar Sketches Using Graph-Based Sketch Analysis
,”
ASME J. Mech. Des.
,
134
(
11
), p.
111002
.
43.
Robertson
,
B. F.
, and
Radcliffe
,
D. F.
,
2009
, “
Impact of CAD Tools on Creative Problem Solving in Engineering Design
,”
Comput. Aided Des.
,
41
(
3
), pp.
136
146
.
44.
Zhang
,
W.
,
Ranscombe
,
C.
,
Radcliffe
,
D.
, and
Jackson
,
S.
,
2019
, “
Creation of a Framework of Design Tool Characteristics to Support Evaluation and Selection of Visualisation Tools
,”
Proc. Des. Soc. Int. Conf. Eng. Des.
,
1
(
1
), pp.
1115
1124
.
45.
Elsen
,
C.
,
Demaret
,
J.-N.
,
Yang
,
M. C.
, and
Leclercq
,
P.
,
2012
, “
Sketch-Based Interfaces for Modeling and Users’ Needs: Redefining Connections
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
26
(
3
), pp.
281
301
.
46.
Macomber
,
B.
, and
Yang
,
M.
,
2011
, “
The Role of Sketch Finish and Style in User Responses to Early Stage Design Concepts
,”
Volume 9: 23rd International Conference on Design Theory and Methodology; 16th Design for Manufacturing and the Life Cycle Conference
,
Washington, DC
,
Aug. 28–31
, pp.
567
576
.
47.
Li
,
W. W.
,
Hilton
,
E.
,
Hammond
,
T.
, and
Linsey
,
J. S.
,
2016
, “
Persketchtivity: An Intelligent Pen-Based Online Education Platform for Sketching Instruction
,”
Electronic Visualisation and the Arts
,
London, UK
,
July 2016
, pp.
133
141
.
48.
Hilton
,
E.
,
Li
,
W.
,
Newton
,
S. H.
,
Alemdar
,
M.
,
Pucha
,
R.
, and
Linsey
,
J.
,
2016
, “
The Development and Effects of Teaching Perspective Free-Hand Sketching in Engineering Design
,”
Volume 3: 18th International Conference on Advanced Vehicle Technologies; 13th International Conference on Design Education; 9th Frontiers in Biomedical Devices
,
Charlotte, NC
,
Aug. 21–24
.
49.
Weaver
,
M. B.
,
Ray
,
S.
,
Hilton
,
E. C.
,
Dorozhkin
,
D.
,
Douglas
,
K.
,
Hammond
,
T.
, and
Linsey
,
J.
,
2022
, “
Improving Engineering Sketching Education Through Perspective Techniques and an AI-Based Tutoring Platform
,”
Int. J. Eng. Educ.
,
38
(
6
), p.
2013612
.
50.
Lau
,
K.
,
Oehlberg
,
L.
, and
Agogino
,
A.
,
2009
, “
Sketching in Design Journals: An Analysis of Visual Representations in the Product Design Process
,”
Eng. Des. Graph. J.
,
73
(
3
), pp.
23
28
.
51.
Evans
,
M.
, and
Aldoy
,
N.
,
2016
, “
Digital Design Sketching Using the Tablet PC
,”
Des. J.
,
19
(
5
), pp.
1
22
.
52.
Badam
,
S. K.
,
Chandrasegaran
,
S.
,
Elmqvist
,
N.
, and
Ramani
,
K.
,
2014
, “
Tracing and Sketching Performance Using Blunt-Tipped Styli on Direct-Touch Tablets
,”
Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces—AVI’14
,
Como, Italy
,
May 27–30
, pp.
193
200
.
53.
Peng
,
A.
,
Menold
,
J.
, and
Miller
,
S. R.
,
2020
, “
Does It Translate? A Case Study of Conceptual Design Outcomes With U.S. and Moroccan Students
,”
Vol. 3: 17th International Conference on Design Education (DEC)
,
Virtual, Online
,
August 2020
.
54.
Larkin
,
J. H.
, and
Simon
,
H. A.
,
1987
, “
Why a Diagram Is (Sometimes) Worth Ten Thousand Words
,”
Cogn. Sci.
,
11
(
1
), pp.
65
100
.
55.
Linsey
,
J. S.
,
Tseng
,
I.
,
Fu
,
K.
,
Cagan
,
J.
,
Wood
,
K. L.
, and
Schunn
,
C.
,
2010
, “
A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty
,”
ASME J. Mech. Des.
,
132
(
4
), p.
041003
.
56.
Zheng
,
X.
, and
Miller
,
S. R.
,
2021
, “
Out in the Field Versus Inside in the Lab: A Comparison of Design Professionals’ Concept Screening Practices
,”
ASME J. Mech. Des.
,
143
(
4
), p.
041401
.
57.
Toh
,
C. A.
, and
Miller
,
S. R.
,
2013
, “
Visual Inspection or Product Dissection? The Impact of Designer-Product Interactions on Engineering Design Creativity
,”
Volume 5: 25th International Conference on Design Theory and Methodology; ASME 2013 Power Transmission and Gearing Conference
,
Portland, OR
,
Aug. 4–7
.
58.
Thinkspace
,
2004
, “Thinkspace: PeanutSheller,” http://www.thinkcycle.org/tc-space/tspace?tspace_id 41963
59.
Tsenn
,
J.
,
Atilola
,
O.
,
McAdams
,
D. A.
, and
Linsey
,
J. S.
,
2014
, “
The Effects of Time and Incubation on Design Concept Generation
,”
Des. Stud.
,
35
(
5
), pp.
500
526
.
60.
Guilford
,
J. P.
,
1979
, “
Some Incubated Thoughts on Incubation
,”
J. Creat. Behav.
,
13
(
1
), pp.
1
8
.
61.
Landis
,
J. R.
, and
Koch
,
G. G.
,
1977
, “
The Measurement of Observer Agreement for Categorical Data
,”
Biometrics
,
33
(
1
), pp.
159
174
.
62.
Freelon
,
D. G.
,
2013
, “
ReCal OIR: Ordinal, Interval, and Ratio Intercoder Reliability as a Web Service
,”
Int. J. Internet Sci.
,
1
(
8
), pp.
10
16
.
63.
Freelon
,
D. G.
,
2010
, “
ReCal: Intercoder Reliability Calculation as a Web Service
,”
Int. J. Internet Sci.
,
1
(
5
), pp.
20
33
.
64.
Xu
,
K.
,
Wendell
,
D.
, and
Walsh
,
A. S.
,
2017
, “
Getting to Gender Parity in a Top-Tier Mechanical Engineering Department: A Case Study
,”
2017 ASEE Annual Conference & Exposition
,
Columbus, OH
,
June 25–28
.
You do not currently have access to this content.