creativity in humans and computerscogsci.uwaterloo.ca/lectures/creativity.plymouth.2016.pdf ·...
TRANSCRIPT
![Page 1: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/1.jpg)
1
CREATIVITY IN HUMANS AND COMPUTERS
Paul ThagardUniversity of Waterloo
![Page 2: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/2.jpg)
2
Outline1. Human creativity 2. Neural
mechanisms3. Computer
creativity4. Procedural
creativity
![Page 3: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/3.jpg)
What is Creativity?Instead of a definition, a concept can be
clarified by 3-analysis:
Exemplars: standard examples
Typical features: prototype
Explanatory roles: what creativity explains, and what explains creativity
Blouw, Solodkin, Thagard, and Eliasmith, forthcoming, Cognitive Science.
3
![Page 4: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/4.jpg)
Creativity ExemplarsScientific discovery
Technological invention
Social innovation
Artistic imagination
4
![Page 5: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/5.jpg)
Creativity FeaturesA creative product is:
1. new (novel, original), 2. valuable (important, useful, appropriate,
correct, accurate), and 3. surprising (unexpected, non-obvious).
Explanatory roles: Creativity explains individual and social success, but what explains creativity?
5
![Page 6: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/6.jpg)
Products of Creativity1. Concepts: atom, atomic bomb, hospital,
cubism
2. Hypotheses: evolution, fission, public education, atonal music
3. Things: moons of Jupiter, wheel, University of Bologna, Mona Lisa
4. Methods: experimentation, computer programming, universal health care, impressionism
6
![Page 7: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/7.jpg)
Human Creativity1. Combinatorial conjecture: Creativity
results from novel combinations of representations (Koestler, Boden, Dugald Stewart 1792, etc.). Thagard 2012, The Cognitive Science of Science.
2. Mental representations are patterns of neural activity. Multimodal: visual, etc.
4. All creativity results from combinations of semantic pointers.
7
![Page 8: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/8.jpg)
Apple CreativityProduct Year Concepts Images
Apple II 1977 Chip, motherboard, program, keyboard, television
Vision, touch, motion
Macintosh 1984 Computer, graphicalinterface, mouse, sound
Vision, touch, motion, sound
iMac 1998 Computer, translucent shell, egg-shaped, one-piece
Vision, touch, motion, sound
iPod 2001 Music player, small hard drive, iTunes, scroll wheel
Vision, touch, motion, sound
iPhone 2007 Telephone, music player, Internet appliance, multi-touch screen
Vision, touch, motion, sound
8
![Page 9: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/9.jpg)
Creativity Results from:1. Divine inspiration:
Muses
2. Platonic apprehension3. Computational
generation4. Neural mechanisms
9
![Page 10: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/10.jpg)
The New SynthesisThesis (1950s): Intelligence results from the
processing of physical symbols. (Herbert Simon, traditional AI)
Antithesis (1980s): Intelligence results from sub-symbolic processes in neural networks, operating with distributed representations.
Synthesis: Neural networks are capable of symbolic processes, using semantic pointers.
Chris Eliasmith: How to Build a Brain, Oxford U. Press, 2013. Eliasmith et al. (2012), Science.
10
![Page 11: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/11.jpg)
Neural Representation1. Local
representation with individual neurons
2. Distributed representations
3. Pattern of spiking activity in neural population
11
![Page 12: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/12.jpg)
Neural Representation in Theoretical Neuroscience
1. Neural populations have millions of neurons.
2. Firing patterns matter as well as rate of firing.
3. Populations are organized into brain areas whose interconnections matter more than modularity.
4. Neural populations encode sensory inputs and inputs from other neural populations. Multimodal.
See Eliasmith & Anderson, Neural Engineering, 2003.
Eliasmith et al., Science, Nov. 30, 2012.
Eliasmith, How to Build a Brain, 2013. 12
![Page 13: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/13.jpg)
Neural Representation(Chris Eliasmith, Terry Stewart)
13
![Page 14: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/14.jpg)
Binding in the BrainSynchrony: neurons fire in temporal coordination
Syntax: e.g. Shastri, HummelConsciousness: e.g. Crick, Engel, Scherer
Convolution: activity of neural populations becomes “twisted together”: convolve.
Representations are braided together.
Eliasmith has shown how neural populations can perform convolution.
14
![Page 15: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/15.jpg)
Convolution in Action(Thagard & Stewart, AHA!, Cognitive Science, 2011)
![Page 16: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/16.jpg)
Recursive Binding
Binding is recursive: binding of bindings of bindings ….
Binding using vectors can produce syntactic complexity (Eliasmith and Thagard, Cognitive Science, 2001).
Binding (via convolution) can produce semantic pointers that function syntactically, semantically, and pragmatically, with properties akin to both symbols and distributed neural representations.
16
![Page 17: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/17.jpg)
Semantic Pointers (Eliasmith 2013)
Semantic pointers are patterns of neural firing that:
1. provide shallow meaning through symbol-like relations to the world and other representations;
2. expand to provide deeper meaning with relations to perceptual, motor, and emotional information;
3. support complex syntactic operations; 4. help to control the flow of information
through a cognitive system to accomplish its goals. 17
![Page 18: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/18.jpg)
semantic pointer
sensory motor emotional verbal
bind bindbind
FORMATION
18
![Page 19: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/19.jpg)
sensory motor emotional verbal
semantic pointerinfer
unpack unpack unpack
FUNCTION
19
![Page 20: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/20.jpg)
sensory motor emotional verbal
COMPETITIONsemantic pointers
recurrent connections
bindings bindings bindings
20
![Page 21: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/21.jpg)
Binding ProcesessDiscovery results from binding representations
(Thagard & Stewart, Cognitive Science, 2011; Thagard, The Cognitive Science of Science, 2012; Thagard, artistic genius, 2014; Jiang and Thagard, social innovation, 2014).
Bind images into new images, concepts into new concepts, concepts into hypotheses.
Emotion results from binding cognitive appraisal and physiological perception (Thagard & Aubie, 2008; Thagard, The Brain and the Meaning of Life, 2010; Thagard & Schröder, 2014).
21
![Page 22: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/22.jpg)
22
!"#$%&'
()*"+)(,- ()*"+)(,.
/
0*"12
3*4"(5*1
$675($8$1(/,0*"12,3*4"(5*1
&99#&53&4
:*2;
!"#$
!"#$!"#$
%&'()*)
![Page 23: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/23.jpg)
Emotions and Creativity1. Emotions provide motivation. James
Watson: never do anything boring.
2. Emotions provide evaluation: excitement, elegance, disgust, etc.
3. Emotions communicate motivation and evaluation in social groups, including scientists.
23
![Page 24: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/24.jpg)
Imagery Operations1. Intensify: make stronger, e.g. louder sound
2. Focus: concentrate, e.g. zoom in
3. Combination: put together, e.g. sweet + salty
4. Juxtaposition: join in space or time, e.g. jump shot
5. Decomposition: take apart, e.g. song
24
![Page 25: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/25.jpg)
Imagery Mechanisms1. Intensify: increase firing in neural groups
2. Focus: competition among semantic pointers
3. Combination: binding
4. Juxtaposition: binding with spatial/temporal relations
5. Decomposition: decompress (unbind) semantic pointers
25
![Page 26: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/26.jpg)
Juxtapositionimage
bind
inside
bind
apple giraffe mouth
mouthgiraffe
bind
26
![Page 27: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/27.jpg)
Computer Creativity1. Painting: AARON (Harold Cohen)
2. Music: David Cope
3. Heuristics: Lenat’s Eurisko
4. Recipes: Chef Watson
5. Image processing and voice recognition: e.g. Google brain and deep learning -AlphaGo
27
![Page 28: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/28.jpg)
Increasing Computer Creativity
1. Multimodal representations
2. Recursive binding
3. Analogy: driven by semantics and pragmatics, not just syntax
4. Pragmatic evaluation by something like emotion
5. Procedural creativity: new methods
28
![Page 29: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/29.jpg)
Procedural Creativity: Scientific Examples
Naturalistic explanation (Thales, c. 600 BC).
Experimentation (Ibn al-Haytham, 1021).
Mathematical science (Galileo, 1590).
Telescope (Galileo, 1609). Microscope (Malpighi, 1660).
Calculus (Newton, 1666). Statistical inference (Bernoulli, 1689).
Taxonomy (Linnaeus, 1735).
Spectroscopy (Kirchoff and Bunson (1859).
Polymerase chain reaction (Mullis, 1983). 29
![Page 30: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/30.jpg)
Procedural Creativity: Other Examples
Technology: measuring density, movable type, lightning rod, vaccination, photography, Morse code, antiseptic surgery, FORTRAN, email, Web.
Art: perspective, opera, science fiction, impressionism, jazz, stream of consciousness, abstract sculpture, modern dance
Social: hospice, Facebook, prison reform, Habitat for Humanity, microfinance, distance learning, universal health care, affirmative action, pensions
30
![Page 31: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/31.jpg)
Procedural Creativity: Cognitive Representation
Methods can be represented as rules: IF you want to accomplish goal G, THEN follow procedure P.
Goals and procedures are not just verbal, but can be multimodal (visual, kinesthetic, auditory, touch, taste, smell, etc.).
So the IF and THEN parts of some rules need to be represented by neural patterns, or vectors as an approximation. E.g. <move mouse> -> <cursor>.
See the Semantic Pointer Architecture of Eliasmith (2013) How to Build a Brain.
31
![Page 32: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/32.jpg)
Cognitive Process: Goal Driven
Procedural generalization:
Inputs: Goal and a problem solution showing that using steps leads to accomplishment of the goal.
Output: A method with the structure: If you want to accomplish the goal, then use the steps.
Process: Identify the steps that led to the goal, and generalize them into the method, with multimodal representations.
32
![Page 33: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/33.jpg)
Additional Topics1. Values as emotional cognition
2. Multimodal rules
3. Analogy and metaphor
4. Emotions and evaluation
5. Inference
6. Communication and collaboration: social mechanisms
33
![Page 34: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/34.jpg)
Conclusions
1. Humans are creative because of brain mechanisms.
2. Neural binding of semantic pointers generates new images, concepts, etc.
3. Computer creativity can be enhanced.
34
![Page 35: CREATIVITY IN HUMANS AND COMPUTERScogsci.uwaterloo.ca/Lectures/creativity.plymouth.2016.pdf · Human Creativity 1. Combinatorial conjecture: Creativity results from novel combinations](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f938f99088c56752d69a0cf/html5/thumbnails/35.jpg)
35