in search of the dream team - stanford university · in search of the dream team temporally...
TRANSCRIPT
![Page 1: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/1.jpg)
In Search of the Dream TeamTemporally Constrained Multi-Armed Bandits
For Identifying Effective Team Structures
Sharon Zhou, Melissa Valentine, Michael BernsteinStanford University
![Page 2: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/2.jpg)
What is the best way to organize teams?
![Page 3: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/3.jpg)
![Page 4: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/4.jpg)
![Page 5: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/5.jpg)
Rapidly try different strategies and converge on one
![Page 6: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/6.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 7: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/7.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 8: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/8.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 9: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/9.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 10: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/10.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 11: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/11.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 12: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/12.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 13: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/13.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 14: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/14.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 15: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/15.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 16: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/16.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 17: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/17.jpg)
Rapidly try different strategies and converge on one
DreamTeam
![Page 18: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/18.jpg)
Rapidly try different strategies and converge on one
![Page 19: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/19.jpg)
- There is no universally ideal way to structure all teams
Donaldson 1999Lawrence and Lorsch 1967
Rapidly try different strategies and converge on one
![Page 20: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/20.jpg)
- There is no universally ideal way to structure all teams
- It depends on the team members and their task
Donaldson 1999Lawrence and Lorsch 1967
Rapidly try different strategies and converge on one
![Page 21: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/21.jpg)
![Page 22: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/22.jpg)
- Novel algorithm to avoid overwhelming teams with deluge of different strategies
![Page 23: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/23.jpg)
- Novel algorithm to avoid overwhelming teams with deluge of different strategies
- Our system, DreamTeam, outperformed manager-led and self-managed teams by over 40% on performance
![Page 24: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/24.jpg)
Design
Design System Evaluation Discussion
![Page 25: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/25.jpg)
![Page 26: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/26.jpg)
Roles, norms, and interaction patterns that define how we collaborate are called
team structures
Ilgen 2005
![Page 27: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/27.jpg)
Donaldson 1999Lawrence and Lorsch 1967
There are no universally ideal team structures
![Page 28: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/28.jpg)
Donaldson 1999Lawrence and Lorsch 1967
- Structural contingency theory
There are no universally ideal team structures
![Page 29: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/29.jpg)
Donaldson 1999Lawrence and Lorsch 1967
- Structural contingency theory
- Effective team structures depend on the members and their task
There are no universally ideal team structures
![Page 30: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/30.jpg)
- Structural contingency theory
- Effective team structures depend on the members and their task
- Wrong structures lead to dysfunctional teams
Schippers et al. 2014Ilgen et al. 2005
Ancona et al. 2001Arrow 1997
There are no universally ideal team structures
![Page 31: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/31.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
![Page 32: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/32.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationOne configuration of team structures
![Page 33: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/33.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
![Page 34: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/34.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
![Page 35: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/35.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
![Page 36: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/36.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationHierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
![Page 37: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/37.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationHierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationHierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
![Page 38: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/38.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationHierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationHierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
![Page 39: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/39.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationHierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationHierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
![Page 40: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/40.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeam
![Page 41: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/41.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeam
![Page 42: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/42.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 43: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/43.jpg)
DreamTeamHierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationTime
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
![Page 44: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/44.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 45: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/45.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 46: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/46.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 47: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/47.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 48: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/48.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 49: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/49.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 50: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/50.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 51: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/51.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 52: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/52.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 53: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/53.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 54: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/54.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 55: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/55.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 56: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/56.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 57: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/57.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 58: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/58.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 59: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/59.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 60: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/60.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 61: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/61.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 62: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/62.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 63: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/63.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
DreamTeamTime
![Page 64: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/64.jpg)
Teams form on Slack
+
hakunahello
9:21 AM
![Page 65: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/65.jpg)
Teams form on Slack
+
matatahi
9:21 AM
hakunahello
9:21 AM
![Page 66: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/66.jpg)
Teams form on Slack
+
matatahi
9:21 AM
hakunahello
9:21 AM
Hi everyone!
![Page 67: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/67.jpg)
Teams form on Slack
+
matatahi
9:21 AM
simbaHi everyone!
9:21 AM
hakunahello
9:21 AM
![Page 68: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/68.jpg)
Teams form on Slack
+
matatahi
9:21 AM
simbaHi everyone!
INSTRUCTIONSgame-robot
SUBMISSION
APP
9:21 AM
9:21 AM
hakunahello
9:21 AM
![Page 69: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/69.jpg)
Teams form on Slack
+
matatahi
9:21 AM
simbaHi everyone!
INSTRUCTIONSgame-robot
SUBMISSION
APP
9:21 AM
9:21 AM
hakunahello
9:21 AM
maybe it’s the rising sun
![Page 70: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/70.jpg)
Teams form on Slack
+
matatahi
9:21 AM
simbaHi everyone!
INSTRUCTIONSgame-robot
SUBMISSION
APP
9:21 AM
9:21 AM
hakunahello
9:21 AM
simbamaybe it’s the rising sun
9:21 AM
![Page 71: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/71.jpg)
+
END OF ROUNDgame-robot APP 9:43 AM
Coordination-robot gives teams structural interventions
![Page 72: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/72.jpg)
+
END OF ROUNDgame-robot APP 9:43 AM
Coordination-robot gives teams structural interventions
coordina2on-robotThis round change the following…
Be super cheery! Make sure to write encouraging comments to all your teammates, despite any losses!
APP 9:43 AM
![Page 73: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/73.jpg)
+
END OF ROUNDgame-robot APP 9:43 AM
Coordination-robot gives teams structural interventions
coordina2on-robotThis round change the following…
Be super cheery! Make sure to write encouraging comments to all your teammates, despite any losses!
APP 9:43 AM
go team!
![Page 74: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/74.jpg)
+
END OF ROUNDgame-robot APP 9:43 AM
Coordination-robot gives teams structural interventions
coordina2on-robotThis round change the following…
Be super cheery! Make sure to write encouraging comments to all your teammates, despite any losses!
APP 9:43 AM
simbago team!
9:45 AM
![Page 75: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/75.jpg)
+
Across rounds, teams adapt to changing structures
![Page 76: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/76.jpg)
System
Design System Evaluation Discussion
![Page 77: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/77.jpg)
DreamTeam is powered by a network of multi-armed bandits
![Page 78: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/78.jpg)
DreamTeam is powered by a network of multi-armed bandits
Multi-armed bandits efficiently - explore different options (arms) - exploit the best arms over time
![Page 79: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/79.jpg)
DreamTeam is powered by a network of multi-armed bandits
Multi-armed bandits efficiently - explore different options (arms) - exploit the best arms over time
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationHierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
![Page 80: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/80.jpg)
DreamTeam is powered by a network of multi-armed bandits
Multi-armed bandits efficiently - explore different options (arms) - exploit the best arms over time
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationHierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
+ + + + =
+ + + + =.5 .9 .3 .6 .7
.3 .7 .1 .4 .5
E(Changes) = 3
Constraint = 2
E(Changes) = 2
—Reduce 1 total—Reduce .2 per bandit
![Page 81: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/81.jpg)
Gabillon et al. 2011Caron and Bhagat 2013
Cesa-Bianchi et al. 2013
DreamTeam is powered by a network of multi-armed bandits
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
+ + + + =
+ + + + =.5 .9 .3 .6 .7
.3 .7 .1 .4 .5
E(Changes) = 3
Constraint = 2
E(Changes) = 2
—Reduce 1 total—Reduce .2 per bandit
+ + + + =
+ + + + =.5 .9 .3 .6 .7
.3 .7 .1 .4 .5
E(Changes) = 3
Constraint = 2
E(Changes) = 2
—Reduce 1 total—Reduce .2 per bandit
+ + + + =
+ + + + =.5 .9 .3 .6 .7
.3 .7 .1 .4 .5
E(Changes) = 3
Constraint = 2
E(Changes) = 2
—Reduce 1 total—Reduce .2 per bandit
+ + + + =
+ + + + =.5 .9 .3 .6 .7
.3 .7 .1 .4 .5
E(Changes) = 3
Constraint = 2
E(Changes) = 2
—Reduce 1 total—Reduce .2 per bandit
![Page 82: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/82.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationBandits suggest an overwhelming
number of changes
![Page 83: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/83.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationBandits suggest an overwhelming
number of changes
![Page 84: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/84.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationBandits suggest an overwhelming
number of changes
![Page 85: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/85.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit ExplorationBandits suggest an overwhelming
number of changes
![Page 86: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/86.jpg)
How many changes can be made at once?
![Page 87: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/87.jpg)
How many changes can be made at once?
![Page 88: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/88.jpg)
- Teams’ receptiveness to structural change varied temporally
- Most receptive near the midpoint of their progress
Okhuysen and Waller 2002
How many changes can be made at once?
![Page 89: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/89.jpg)
ROUNDST
CHA
NG
ESE[
]
TOTAL CHANGES
LATEEARLY ONGOING
ROUNDSTTT
1
0
0
!- Teams’ receptiveness to structural change
varied temporally - Most receptive near the midpoint of their
progress
How many changes can be made at once?
![Page 90: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/90.jpg)
Use constraints to limit total changes across the network
![Page 91: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/91.jpg)
+ + + + =
+ + + + =.5 .9 .3 .6 .7
.3 .7 .1 .4 .5
E(Changes) = 3
Constraint = 2
E(Changes) = 2
—Reduce 1 total—Reduce .2 per banditE[changes] = 5
Use constraints to limit total changes across the network
![Page 92: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/92.jpg)
+ + + + =
+ + + + =.5 .9 .3 .6 .7
.3 .7 .1 .4 .5
E(Changes) = 3
Constraint = 2
E(Changes) = 2
—Reduce 1 total—Reduce .2 per banditE[changes] = 5
> Constraint = 2
ROUNDST
CHA
NG
ESE[
]TOTAL CHANGES
LATEEARLY ONGOING
ROUNDSTTT
1
0
0
!
Use constraints to limit total changes across the network
![Page 93: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/93.jpg)
+ + + + =
+ + + + =.5 .9 .3 .6 .7
.3 .7 .1 .4 .5
E(Changes) = 3
Constraint = 2
E(Changes) = 2
—Reduce 1 total—Reduce .2 per banditE[changes] = 5
> Constraint = 2
ROUNDST
CHA
NG
ESE[
]TOTAL CHANGES
LATEEARLY ONGOING
ROUNDSTTT
1
0
0
!
-.6 -.6 -.6 -.6 -.6
Use constraints to limit total changes across the network
![Page 94: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/94.jpg)
+ + + + =
+ + + + =.5 .9 .3 .6 .7
.3 .7 .1 .4 .5
E(Changes) = 3
Constraint = 2
E(Changes) = 2
—Reduce 1 total—Reduce .2 per bandit
-.6
Use constraints to limit total changes across the network
![Page 95: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/95.jpg)
Use constraints to limit total changes across the network
-.6
![Page 96: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/96.jpg)
Use constraints to limit total changes across the network
Thompson sampling probabilities represent likelihood of choosing arm
Agrawal and Goyal 2012
✓0i =
(✓i�, if i 6= c
✓i +P
j 6=c ✓j(1� �), if i = c
1
✓0i =
(✓i�, if i 6= c
✓i +P
j 6=c ✓j(1� �), if i = c
1
-.6
![Page 97: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/97.jpg)
Use constraints to limit total changes across the network
Thompson sampling probabilities represent likelihood of choosing arm
Agrawal and Goyal 2012
✓0i =
(✓i�, if i 6= c
✓i +P
j 6=c ✓j(1� �), if i = c
1
✓0i =
(✓i�, if i 6= c
✓i +P
j 6=c ✓j(1� �), if i = c
1
-.6
![Page 98: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/98.jpg)
Use constraints to limit total changes across the network
Thompson sampling probabilities represent likelihood of choosing arm
Agrawal and Goyal 2012
![Page 99: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/99.jpg)
Use constraints to limit total changes across the network
✓0i =
(✓i�, if i 6= c
✓i +P
j 6=c ✓j(1� �), if i = c
1
![Page 100: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/100.jpg)
+ + + + =
+ + + + =.5 .9 .3 .6 .7
.3 .7 .1 .4 .5
E(Changes) = 3
Constraint = 2
E(Changes) = 2
—Reduce 1 total—Reduce .2 per banditE[changes] = 5
> Constraint = 2
Use constraints to limit total changes across the network
![Page 101: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/101.jpg)
+ + + + =
+ + + + =.5 .9 .3 .6 .7
.3 .7 .1 .4 .5
E(Changes) = 3
Constraint = 2
E(Changes) = 2
—Reduce 1 total—Reduce .2 per banditE[changes] = 5
> Constraint = 2
E[changes] = 2
Use constraints to limit total changes across the network
![Page 102: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/102.jpg)
How do we prioritize what should change?
![Page 103: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/103.jpg)
ROUNDST
CHA
NG
ESE[
]
TOTAL CHANGES
LATEEARLY ONGOING
ROUNDSTTT
1
0
0
!
How do we prioritize what should change?
- Team are receptive to changes in some dimensions earlier, others later
Marks et al 2001
![Page 104: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/104.jpg)
ROUNDST
CHA
NG
ESE[
]
TOTAL CHANGES
LATEEARLY ONGOING
ROUNDSTTT
1
0
0
!
How do we prioritize what should change?
- Team are receptive to changes in some dimensions earlier, others later
![Page 105: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/105.jpg)
Evaluation
Design System Evaluation Discussion
![Page 106: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/106.jpg)
135 people from Amazon Mechanical Turk
![Page 107: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/107.jpg)
135 people from Amazon Mechanical Turk
45 teams on Slack
![Page 108: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/108.jpg)
135 people from Amazon Mechanical Turk
45 teams on Slack
Task adapted from Codenames
![Page 109: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/109.jpg)
1. Manager-chosen List of team structures given to an elected manager
![Page 110: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/110.jpg)
1. Manager-chosen List of team structures given to an elected manager
2. Collectively-chosen List of team structures given for teams to choose
![Page 111: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/111.jpg)
1. Manager-chosen List of team structures given to an elected manager
2. Collectively-chosen List of team structures given for teams to choose
3. Unconstrained bandit-chosen Team structures chosen by unconstrained bandits,
communicated with coordination-robot
![Page 112: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/112.jpg)
1. Manager-chosen List of team structures given to an elected manager
2. Collectively-chosen List of team structures given for teams to choose
3. Unconstrained bandit-chosen Team structures chosen by unconstrained bandits,
communicated with coordination-robot
4. Control No intervention
![Page 113: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/113.jpg)
1. Manager-chosen List of team structures given to an elected manager
2. Collectively-chosen List of team structures given for teams to choose
3. Unconstrained bandit-chosen Team structures chosen by unconstrained bandits,
communicated with coordination-robot
4. Control No intervention
5. DreamTeam Team structures chosen by temporally constrained bandits, communicated with coordination-robot
![Page 114: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/114.jpg)
DreamTeam teams significantly outperform other conditions
DreamTeam outperformed:
Unconstrained bandit-chosen
Manager-chosen
Collectively-chosen
Control
41%
46%
45%
38%
by
Repeated measures ANCOVA p<0.05, all post-hoc Tukey pairwise comparisons to Dreamteam p<0.05. N=45.We used a non-intervention training round as a covariate, to control for teams’ initial performance.
Measured performance using scores on 10 rounds of the task.
![Page 115: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/115.jpg)
Managers were risk-averse and hesitant to explore
lions1975Do you like the first way beTer?
3:30 PM
- 2 structures explored on average - At most 3 combinations explored, as
opposed to 8-9 in the bandit conditions - Managers also varied in involving team for
feedback or imposing recommendations
Tversky and Kahneman 1992
![Page 116: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/116.jpg)
Managers were risk-averse and hesitant to explore
chuchotant
chuchotant
joeyq
lol
sorry, I’m not a giffer
ok, for this round, if you have gifs, I love them
for fun
4:19PM
4:20PM
4:20PM
- 2 structures explored on average - At most 3 combinations explored, as
opposed to 8-9 in the bandit conditions - Managers also varied in involving team for
feedback or imposing recommendations
![Page 117: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/117.jpg)
Overwhelmed, teams under unconstrained bandits ignored changes
- 33% of teams ignored the chosen structures - Difficult to galvanize collective effort, e.g.
leadership election, round-robin participation
Take turns suggesXng answers. Make an order of who goes 1st, 2nd, 3rd.
This round, do the following differently from last round, please!coordina2on-robot APP
You’re a democracy. Vote on what to submit and respect the majority vote. Do notsubmit unXl there’s a majority on one of them.
Take Xme explaining the answers you suggest and reflect on why a previoussubmission was right or wrong.
Add some fun with images, emojis, and GIFs to your discussion. Spend Xme ge`ngto know your teammates.
![Page 118: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/118.jpg)
DreamTeam teams engaged with the exploration of novel structures
![Page 119: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/119.jpg)
DreamTeam teams engaged with the exploration of novel structures
anne_turkerI’m scared to type anything
1:40 PM
![Page 120: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/120.jpg)
DreamTeam teams engaged with the exploration of novel structures
Be super cheery! Make sure to write encouraging comments to all your teammates, despite
coordina2on-robot APP
other.
This round, do the following differently from last round, please!
Note: We’re trying to help your team work be7er with these guidelines. Please fulfill them as best affect compensa@on.)
anne_turker
anne_turker
loulou
nickbstackgo team!!!!
we are killin it
you guys are awesome!!!!
I’m scared to type anything
2:11 PM
2:11 PM
2:12 PM
2:11 PM
1:40 PM
![Page 121: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/121.jpg)
DreamTeam teams engaged with the exploration of novel structures
Be super cheery! Make sure to write encouraging comments to all your teammates, despite
coordina2on-robot APP
other.
This round, do the following differently from last round, please!
Note: We’re trying to help your team work be7er with these guidelines. Please fulfill them as best affect compensa@on.)
anne_turker
anne_turker
loulou
nickbstackgo team!!!!
we are killin it
you guys are awesome!!!!
I’m scared to type anything
2:11 PM
2:11 PM
2:12 PM
2:11 PM
1:40 PM
You guys were the best team ever! Thank2:55 PManne_turker
![Page 122: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/122.jpg)
Effective structures varied substantiallySupports structural contingency theory: There are no universally ideal structures
![Page 123: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/123.jpg)
Limitations & Opportunities
- Feedback focused on performance, not yet on self-reported metrics
- The same task iteratively, not yet the changing demands or tasks of a team
![Page 124: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/124.jpg)
Discussion
Design System Evaluation Discussion
![Page 125: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/125.jpg)
The future of work opens opportunities for computationally augmented teams
- Help overcome manager biases of team’s needs through exploration
![Page 126: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/126.jpg)
- Help overcome manager biases of team’s needs through exploration
- Represent a step toward a partnership between computation and collaboration
The future of work opens opportunities for computationally augmented teams
![Page 127: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/127.jpg)
- Help overcome manager biases of team’s needs through exploration
- Represent a step toward a partnership between computation and collaboration
The future of work opens opportunities for computationally augmented teams
![Page 128: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/128.jpg)
DreamTeam
![Page 129: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/129.jpg)
DreamAdvisor
Involvement
Meetingsevery day / every week / ad hoc
hands-on / hands-off
Level of feedback
???
STUDENT A STUDENT B
high-level / low-level / everything
![Page 130: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/130.jpg)
In Search of the Dream TeamTemporally Constrained Multi-Armed Bandits
For Identifying Effective Team Structures
Sharon Zhou, Melissa Valentine, Michael BernsteinStanford University
![Page 131: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/131.jpg)
1. Concept of computationally empowered identification of effective team structures
2. A system — DreamTeam — manifesting this concept
3. Temporal constraints which regulate exploration timing in a network of multi-armed bandits
4. An evaluation demonstrating that this approach outperforms traditional ones on a complex collaborative task
Contributions
![Page 132: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/132.jpg)
![Page 133: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/133.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
Multi-armed bandits overwhelm teams with simultaneous change
![Page 134: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/134.jpg)
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
HierarchyNone, Centralized, Decentralized
None, Professional, Informal
None, Encouraging, Critical
None, Divergent, Convergent, Informed, Rapid
Emergent, Round-robin, Equally distributed
TEAM STRUCTURES
Interaction Patterns
Norms of Engagement
Decision-Making Norms
Feedback Norms
TEAM A Bandit Exploration TEAM B Bandit Exploration TEAM C Bandit Exploration
Temporally constrained multi-armed bandits
![Page 135: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/135.jpg)
HCI systems have been designed for specific structures
![Page 136: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/136.jpg)
HCI systems have been designed for specific structures
![Page 137: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/137.jpg)
HCI systems have been designed for specific structures
![Page 138: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/138.jpg)
HCI systems have been designed for specific structures
![Page 139: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/139.jpg)
- Thompson sampling probabilities represent likelihood of choosing arm
Use constraints to shift the probability of exploring
ROUNDST
CHA
NG
ESE[
]
TOTAL CHANGES
LATEEARLY ONGOING
ROUNDSTTT
1
0
0
!
✓0i =
(✓i�, if i 6= c
✓i +P
j 6=c ✓j(1� �), if i = c
1
✓0i =
(✓i�, if i 6= c
✓i +P
j 6=c ✓j(1� �), if i = c
1
![Page 140: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/140.jpg)
- Thompson sampling probabilities represent likelihood of choosing arm
Use constraints to shift the probability of exploring
ROUNDST
CHA
NG
ESE[
]
TOTAL CHANGES
LATEEARLY ONGOING
ROUNDSTTT
1
0
0
!
✓0i =
(✓i�, if i 6= c
✓i +P
j 6=c ✓j(1� �), if i = c
1
✓0i =
(✓i�, if i 6= c
✓i +P
j 6=c ✓j(1� �), if i = c
1
![Page 141: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/141.jpg)
Teams demonstrated polarizing performance in other conditions
Collectively-chosen: - Lack of coordination, chaotic behavior - Members sometimes stepped up to lead
or coordinate
![Page 142: In Search of the Dream Team - Stanford University · In Search of the Dream Team Temporally Constrained Multi-Armed Bandits For Identifying Effective Team Structures ... -Our system,](https://reader034.vdocuments.us/reader034/viewer/2022043017/5f39939e87cddb4e80323e49/html5/thumbnails/142.jpg)