1. hurricane forecast model enron email corpus lcdr matt tabar lcdr william evans

59
1

Upload: alina-mallicoat

Post on 15-Jan-2016

225 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans
Page 2: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans
Page 3: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

Hurricane ForecastModel

Page 4: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

Enron Email Corpus

LCDR Matt TabarLCDR William Evans

Page 5: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

5

Outline

• History of ENRON• Email Corpus

–Makeup and Generation–Assumptions

• Graph construction• Time-series analysis

Page 6: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

6

BLUF

• Divided the network into time periods• Examined the communication between 7

executives• Compared the strength of the communications

by max-flow interdiction (four ways)

Page 7: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

7

ENRON Brief History

• 1932 - Northern Natural Gas Company, OK• 1979 - Reorganized as InterNorth • 1985

– Bought Houston Natural Gas– Moved to Houston, changed name to ENRON

• Lied, cheated, swindled• Sept. 9, 2001 - Scandal breaks out• Dec. 1, 2001 - Filed for bankruptcy

Page 8: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

8

How bad was it?

• ENRON – CalPERS venture• Joint Energy Development Investments – JEDI• Set up Chewco Investments Ltd. to buy it• ENRON has a positive bottom line

Page 9: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

9

The (really) bottom line

Page 11: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

11

Time Breakdown

CEO

COO

CFO

CAO

Block

Year

Lay

Lay

Lay

1 2 3 4 5 6

1999 2000 2001 2002

B

Page 12: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

12

Time Breakdown

CEO

COO

CFO

CAO

Block

Year

Lay

Skilling

Skilling

Lay

Lay

1 2 3 4 5 6

1999 2000 2001 2002

B

Page 13: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

13

Time Breakdown

CEO

COO

CFO

CAO

Block

Year

Lay

Skilling

Fastow

Skilling

Lay

Lay

1 2 3 4 5 6

1999 2000 2001 2002

B

Page 14: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

14

Time Breakdown

CEO

COO

CFO

CAO

Block

Year

Lay

Skilling

Fastow

Causey

Skilling

Lay

Lay

1 2 3 4 5 6

1999 2000 2001 2002

B

Page 15: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

15

Time Breakdown

CEO

COO

CFO

CAO

Block

Year

Lay

Skilling

Fastow

Causey

Skilling

Lay

Lay

Whalley

1 2 3 4 5 6

1999 2000 2001 2002

B

Page 16: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

16

Time Breakdown

CEO

COO

CFO

CAO

Block

Year

Lay

Skilling

Fastow

Causey

Skilling

Lay

Lay

Whalley

McMahon

1 2 3 4 5 6

1999 2000 2001 2002

B

Page 17: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

17

Time Breakdown

CEO

COO

CFO

CAO

Block

Year

Lay

Skilling

Fastow

Causey

Skilling

Lay

Lay

Whalley

McMahon Bowen

1 2 3 4 5 6

1999 2000 2001 2002

B

Page 18: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

18

Corpus Makeup

490,209 Emails

Page 19: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

19

Corpus Makeup

490,209 Emails

76,312 Unique To: addresses (58% external)

Page 20: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

20

Corpus Makeup

490,209 Emails

76,312 Unique To: addresses (58% external)

19,479 Unique From: addresses

Page 21: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

21

Corpus Makeup

490,209 Emails

76,312 Unique To: addresses (58% external)

19,479 Unique From: addresses

5,703 Unique internal addresses

Page 22: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

22

Corpus Makeup

490,209 Emails

76,312 Unique To: addresses (58% external)

19,479 Unique From: addresses

5,703 Unique internal addresses

150 Employee’s email folders

Page 23: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

23

Corpus Makeup

Message-ID: <3513531.1075852348029.JavaMail.evans@thyme>Date: Mon, 15 Oct 2001 17:39:14 -0700 (PDT)From: pr <[email protected]>To: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]: Reuters story on Dynegy 3Q earnings

We'll get pointed questions related to Europe and broadband thanks to Steve Bergstrom. Suggest we answer that we feel confident that the first mover advantage will give us superior returns in the long run.

Message-ID: <29382990.1075852344558.JavaMail.evans@thyme>Date: Sat, 27 Oct 2001 09:13:59 -0700 (PDT)From: [email protected]: [email protected], pr <[email protected]>, [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]: [email protected], [email protected]: [email protected], [email protected]: Saturday Articles

Enron taps credit line; stock slides

Message-ID: <10795837.1075852348240.JavaMail.evans@thyme>Date: Mon, 15 Oct 2001 02:06:41 -0700 (PDT)From: [email protected]: [email protected]: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]: Turkish industrialist Nuri Coalkoglu

Ken

I understand a Turkish industrialist named Nuri ?olakoglu has been in contact with you through Bill Miller and possibly Jerry Giest. Colakoglu is an extremely wealthy and well regarded Turkish industrialist who has aggressively expanded into the Turkish energy sector.

Page 24: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

24

Assumptions

• Strength of relationship based on email• Not all email is created equal• There are additional interesting people• Likely missing emails

Page 25: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

25

Graph Construction

Koffi

Cordell

Treml

Whelan

Cipperley

Fleischmann

Schramm

Ramert

Young

Kaymal-1

Dunham

Burton

Kaymal-2

Page 26: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

26

Graph Construction

Koffi

Cordell

Treml

Whelan

Cipperley

Fleischmann

Schramm

Ramert

Young

Kaymal-1

Dunham

Burton

Kaymal-2

Page 27: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

27

Graph Construction

Koffi

Cordell

Treml

Whelan

Cipperley

Fleischmann

Schramm

Ramert

Young

Kaymal

Dunham

Burton

Page 28: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

28

Graph Construction

Koffi

Cordell

Treml

Whelan

Cipperley

Fleischmann

Schramm

Ramert

Young

Kaymal

Dunham

Burton

Page 29: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

29

Graph Construction

Koffi

Cordell

Treml

Whelan

Cipperley

Fleischmann

Schramm

Ramert

Young

Kaymal

Dunham

Burton

Page 30: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

30

Graph Construction

Koffi

Cordell

Treml

Whelan

Cipperley

Fleischmann

Schramm

Ramert

Young

Kaymal

Dunham

Burton

Page 31: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

31

Graph Construction

Koffi

Cordell

Treml

Whelan

Cipperley

Fleischmann

Young

Kaymal

Dunham

Burton

Page 32: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

32

Graph Construction

Koffi

Cordell

Treml

Whelan

Cipperley

Fleischmann

Young

Kaymal

Dunham

Burton

Page 33: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

33

Graph Construction

Koffi

Cordell

Treml

Whelan

Cipperley

Fleischmann

Young

Kaymal

Burton

Page 34: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

34

Graph Construction

Koffi

Cordell

Treml

Whelan

Cipperley

Fleischmann

Young

Kaymal

Burton

Page 35: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

35

Graph Construction

Koffi

Cordell

Whelan

Cipperley

Fleischmann

Kaymal

Burton

Page 36: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

36

1999 2000 2001 Jan-Jun

2001 Jul-Sep 2001 Oct-Dec 2002

Graph Construction

Page 37: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

37

Period Distribution

2002

2001 Oct-Dec

2001 Jul-Sep

2001 Jan-Jun

2000

1999

0200004000060000

Edges

0 1000 2000 3000 4000 5000

Nodes

Page 38: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

38

Graph Analysis

Koffi

Cordell

Whelan

Cipperley

Fleischmann

Kaymal

Burton

Page 39: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

39

Graph Analysis

Koffi

Whelan

Fleischmann

Kaymal

Cipperley

Cordell

Burton

Page 40: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

40

Graph Analysis

Koffi

Cordell

Whelan

Cipperley

Fleischmann

Kaymal

Burton

Page 41: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

41

Graph Analysis

Koffi

Cordell

Whelan

Cipperley

Fleischmann

Kaymal

Burton

Page 42: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

42

Page 43: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

43

Page 44: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

44

Page 45: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

45

Page 46: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

46

Page 47: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

47

Page 48: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans
Page 56: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans
Page 57: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

57

JEDI Graph

Whalley

Lay

Skilling

CauseyFastow

McMahonBowen

Page 58: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans

58

Conclusions

• You too can analyze a social network• Ned has a large server available• Payoff for pre-GAMS data normalizing• Nothing deterministic / legally defensible

– Good starting point for follow-on investigation

• Good indicator of missing information• Trifecta: Lay, Skilling, and Fastow

Page 59: 1. Hurricane Forecast Model Enron Email Corpus LCDR Matt Tabar LCDR William Evans