using mapping and anchoring gestures to establish common...

18
3 rd Conference of the I i lS i f G S di International Society for Gesture Studies Panel: Common Ground Using Mapping and Anchoring Gestures to Establish Common Ground Robert F. Williams Lawrence University Appleton, Wisconsin [email protected]

Upload: vocong

Post on 16-Mar-2018

215 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

3rd Conference of theI i l S i f G S diInternational Society for Gesture Studies

Panel: Common Ground

Using Mapping and Anchoring Gestures to Establish Common Ground

Robert F. Williams

Lawrence UniversityAppleton, Wisconsin

[email protected]

Page 2: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

Do gestures communicate?

“G t i f ti ”?

“Gestures convey information”

The Conduit Metaphor (Reddy, 1979)

Page 3: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

Yes, gestures communicate

?

Gestures prompt conceptual operations through which we construct meaning

Conceptual Integration Theory (Fauconnier & Turner, 1998)

Page 4: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

Conceptual Integration

31

23

Arrangement Modelgof Bodies of Service

1 2 3

E t tEmergent property:The arrangement of bodies encodes the order of service(Hutchins, 2005)

Two things to notice:1. Conceptual mapping

Queuing orStanding in Line

2. Material anchors

Page 5: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

The Problem of Common Ground

1 2 31 2 3

?

1 2 3…

?

Page 6: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

Instruction

Page 7: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

Mapping Gestures(Williams, in press)

Mapping gestures guide conceptual mapping; i eMapping gestures guide conceptual mapping; i.e., they link conceptual entities with physical structures (or locations) that anchor those entities in the ensuing discourse.

Prototypically, mapping gestures are ‘environmentallyPrototypically, mapping gestures are environmentally coupled gestures’ (Goodwin, 2007) co-timed with speech profiling the entity to be mapped. The mapping gesture brings speech and setting into coordinationgesture brings speech and setting into coordination, establishing a material anchor for a conceptual entity.

Page 8: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

Mapping Gestures: Pointing

“fi t fift ”12 1

211

days... ...S

“five, ten, fifteen,…”

6

9 32

457

8

10hours

minutes

... ...

... ...G?SG

6

Time MeasurementCounting by Fives

12 1210

11“five”5

*

6

9 3

457

8

Counting on the Clock

Page 9: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

Mapping Gestures: Tracing

12 111

9 3

12

457

8

1011

6 57

Clock FaceCircle12

9 3

1210

11

64

578

Clock Quarters

Page 10: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

Mapping Gestures: Tracing

12 111

0

9 3

12

457

8

1011

90°

6 57

Clock FaceAngles 0

12

9 3

1210

11

g

90°

64

578

Clock Angles

Page 11: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

Anchoring Gestures

Anchoring gestures provide physical surrogates orAnchoring gestures provide physical surrogates or proxies for conceptual entities, anchoring those entities in the ensuing discourse.

Co-gesture speech prompts a conceptual mappingCo gesture speech prompts a conceptual mapping constrained by context; coupling of the gesture with the environment may provide further constraints on the mappingthe mapping.

Page 12: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

The Body Clock

12 111

9 3

1210

11

6

9 3

457

86 57

Page 13: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

The Thrombin Hand(Becvar, Hollan & Hutchins, 2005)

Page 14: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

‘Thrombin Hand’ as Moving Entity

Page 15: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

The Oak Tree(Wong, in prep)

Page 16: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

The Oak Tree Blend

Page 17: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

Conclusions

• Mapping and anchoring gestures contribute to common ground by giving conceptual content a physical presence in the discoursephysical presence in the discourse.

Once conceptual entities have been anchored• Once conceptual entities have been anchored, they can be directly referenced and manipulated to generate inferencesto generate inferences.

Page 18: Using Mapping and Anchoring Gestures to Establish Common ...faculty.lawrence.edu/wp-content/uploads/sites/18/2015/11/Common... · Using Mapping and Anchoring Gestures to Establish

References

Fauconnier, G. & Turner, M. 1998. Conceptual integration networks. C iti S iCognitive Science.

Goodwin, C. 2007. Environmentally coupled gestures. In S. Duncan, J. Cassell & E. Levy (eds.), Gesture and the Dynamic Dimension of Language [Gesture Studies 1]of Language [Gesture Studies 1].

Hutchins, E. 2005. Material anchors for conceptual blends. Journal of Pragmatics.

McNeill D 1995 Hand and Mind: What Gestures Reveal AboutMcNeill, D. 1995. Hand and Mind: What Gestures Reveal About Thought.

Reddy, M. 1979. The conduit metaphor. In A. Ortony (ed.), Metaphor and Thought.g

Williams, R. F. In press. Gesture as a conceptual mapping tool. In A. Cienki & C. Müller (eds.), Metaphor and Gesture [Gesture Studies 3], forthcoming from John Benjamins.