eee 25 lec 1

39
EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability Statistics and Data Analysis, Probability Week 01 Lecture 01 EEE 25: Probability and Statistics for Electrical and Electronics Engineers 1

Upload: leiko-ravelo

Post on 10-Dec-2015

9 views

Category:

Documents


1 download

DESCRIPTION

EEE 25 Lecture 1

TRANSCRIPT

Page 1: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Statistics and Data Analysis, Probability

Week 01 Lecture 01 EEE 25: Probability and Statistics

for Electrical and Electronics Engineers

1

Page 2: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Today

•  Errors in Measurement

•  Descriptive Statistics

•  Frequency Distribution

•  Stochastic Experiments

•  Events

•  Probabilities

2

Page 3: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Population vs. Sample

•  Population –  Collection of all possible data

•  Sample –  Subset of the population –  Characteristics of the sample will vary depending on the

values and number of samples taken

•  Example –  Battery lifetime in hours –  Individuals who received a BS in engineering in the

previous academic year

3

Page 4: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Significant Figures

•  All the digits that are certain plus one digit which contains some uncertainty are said to be significant figures.

Examples: 1.00 0.25 0.05

4

Page 5: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Rounding Off

•  Rule 1: If the remainder beyond the last digit to be reported is less than 5, drop the last digit.

•  Rule 2: If the remainder beyond the last digit is greater than 5, increase the last digit by 1.

•  Rule 3: If the remainder is exactly 5, round off to the closest even number.

5

Page 6: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Kinds of Errors

•  Determinate –  can be attributed to definite causes –  methodic, operative or instrumental –  Example: weighing with uncalibrated weights

•  Indeterminate –  cannot be attributed to any known cause

6

Page 7: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Accuracy and Precision

•  Accuracy is how closely a result agrees with the true result –  The smaller the error, the greater the accuracy

•  Precision refers to the agreement among a group of experimental results.

* Image from http://googleimage.xyz/accuracy-and-precision 7

Page 8: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Descriptive Statistics

•  Descriptive statistics –  the analysis of data that helps describe, show or summarize

data in a meaningful way –  a way of describing the characteristics of a large

collection of data by using a subset of it

•  Numerical summary values –  Measure of central tendency –  Measure of variability

8

Page 9: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Measures of Central Tendency

•  The mean of a set of data is their arithmetic average.

•  Two flavors: –  Population mean, μ –  Sample mean

9

∑=

=n

iixn

x1

1

sample in then observatioth - thesample in the nsobservatio ofnumber

mean sample

ixnx

i=

=

=

Page 10: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Measures of Central Tendency

•  The median of a sample is the value of the middle item when the items are arranged in increasing order.

10

!x =x n+1( ) 2, if n is odd

12xn 2 + x n 2( )+1!"

#$, if n is even

%

&'

('

Page 11: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Measures of Central Tendency

•  The mode is the most common value in the sample.

•  If all values occur equally frequently, then there is no mode.

11

Page 12: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Example

20 20 80 40 10

60 60 100 80 70

10 10 70 40 90

50 100 70 60 10

10 60 10 50 70

80 50 80 50 60

70 20 90 60 70

60 10 80 60 60

20 20 30 40 70

50 70 100 10 60

12

Mean ? Mode ?

Median ?

Page 13: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Example

10 20 50 60 80

10 20 50 60 80

10 20 60 70 80

10 30 60 70 80

10 40 60 70 80

10 40 60 70 90

10 40 60 70 90

10 50 60 70 100

20 50 60 70 100

20 50 60 70 100

13

Mean 52.40 Mode 60

Median 60

Page 14: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Example

14

Mean ? Mode ?

Median ?

Page 15: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Example

15

VALUE FREQUENCY

1 2 2 7 3 4 4 4 5 1 6 7 7 9 8 7 9 4

10 7

Page 16: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Example

16

VALUE FREQUENCY VALUE × FREQ LAST POSITION

1 2 2 2 2 7 14 9 3 4 12 13 4 4 16 17 5 1 5 18 6 7 42 25 7 9 63 34 8 7 56 41 9 4 36 45

10 7 70 52 52 316

Page 17: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Example

17

Mean 6.08 Mode 7

Median 7

Page 18: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Measures of Variability

•  The measure of center reveals only partial information about a data set

•  Example: same mean/median, different spread

* Image taken from Devore 18

Page 19: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Measures of Variability

•  The range of a sample is the difference between the highest and the lowest values of data –  Sensitive to outliers

19

Page 20: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Measures of Variability

•  Population variance, σ2

•  Sample variance, s2

20

σ 2 =xi −µ( )2

i=1

N

∑N

s2 =xi − x( )2

i=1

n

∑n−1

Page 21: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Sample Spaces and Events

•  An experiment is any activity or process whose outcome is subject to uncertainty.

•  Examples –  Selecting a card from a deck –  Weighing a loaf of bread –  Obtaining blood types from a group of people

21

Page 22: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Sample Spaces and Events

•  The sample space of an experiment is the set of all possible outcomes of that experiment. –  Discrete: elements are countable –  Continuous: elements are uncountable

•  An event is any collection (subset) of outcomes contained in the sample space.

•  We can use elementary set theory to study events.

22

Page 23: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Set Definitions

•  a is an element of set A, a ∈ A

•  a is not an element of A, a ∈ A

•  B is a subset of A, B⊆A

•  B is a proper subset of A, B⊂A

•  ∅ is a null set

23

Page 24: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Set Definitions

•  A = {x|0 ≤ x ≤ 1} –  uncountable and infinite

•  B = {0,1} –  countable and finite

•  N = {0,1,2,...} –  countably infinite

24

Page 25: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Venn Diagram

25

S is the universal set D is disjoint from the other sets B⊂A A ∩ C = shaded region (intersection)

Page 26: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Set Operations

•  If A ⊆B and B ⊆A, then A = B (equal)

•  A – B contains all elements in A that are not in B (difference)

•  ~A (or A) is the set of all elements not in A (complement)

26

Page 27: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Set Operations

•  Commutative law

•  Distributive law

•  Associative law

27

A∩B = B∩AA∪B = B∪A

A∪ B∩C( ) = A∪B( )∩ A∪C( )A∩ B∪C( ) = A∩B( )∪ A∩C( )

A∩ B∩C( ) = A∩B( )∩CA∪ B∪C( ) = A∪B( )∪C

Page 28: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

DeMorgan’s Law

•  Duality Principle: If, in an identity, one replaces ∪ by ∩, ∩ by ∪, S by ∅, ∅ by S, and the sets by their complements, the identity is preserved.

28

A∪B( ) = A∩B

A∩B( ) = A∪B

Page 29: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Events

Description Notation using sets An event is certain to occur S An event that is impossible ∅

Event A does not occur ~A Both events A and B occur A∩B Either A or B or both occurs A∪B If A occurs then B must also occur A⊆B

A and B are disjoint A∩B= ∅

29

Page 30: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Probability

•  Given an experiment and a sample space S, the objective of probability is to assign to each event A a number P(A), called the probability of the event A, which will give a precise measure of the chance that A will occur.

30

Page 31: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Axioms of Probability

•  AXIOM 1: For any event A , 1 ≥ P(A) ≥ 0 .

•  AXIOM 2: P(S) = 1.

•  AXIOM 3: If A1, A2, A3, … is an infinite collection of disjoint events, then

31

P A1∪A2∪A3∪!( ) = P A1( )+P A2( )+P A3( )+!

Page 32: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

More Probability Properties

32

P E( ) =1−P E( )

E

S

x

y

Page 33: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

More Probability Properties

33

P E∪F( ) = P E( )+P F( )−P E∩F( )

E

S

F

x y

z

w

Page 34: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

More Probability Properties

34

P E1∪E2∪E3( ) = P E1( )+P E2( )+P E3( )−P E1∩E2( )−P E2∩E3( )−P E3∩E1( )+P E1∩E2∩E3( )

S E2

a b

c

d j

f

g h E3

E1

Page 35: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Example

•  A coin is tossed twice. –  What is the sample space?

–  What is the probability that at least 1 head occurs?

35

Page 36: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Example

•  What is the probability of getting a total of 7 or 11 when a pair of fair dice is tossed? –  What is the sample space?

–  Let event A = total is 7. What is P(A)?

–  Let event B = total is 11. What is P(B)?

–  What is P(A or B)?

36

Page 37: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Homework

•  A box contains three 9-V batteries and two 1.5-V batteries. A second box contains three 1-kΩ resistors and seven 10-kΩ resistors. The voltages and resistances are exact.

•  A battery from the first box and a resistor from the second box are picked at random. The two are connected to form a working circuit.

37

Page 38: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Homework

•  What is the probability that the battery chosen is 9V?

•  What is the probability that the resistor chosen is 10kΩ?

•  What is the probability that the current is equal to 1.5 mA?

•  What is the probability that the current through the circuit is less than 1 mA?

38

Page 39: EEE 25 Lec 1

EEE 25: Probability and Statistics for E&E Engineers Week 01 Lecture 01: Statistics & Data Analysis, Probability

Statistics and Data Analysis, Probability

Week 01 Lecture 01 EEE 25: Probability and Statistics

for Electrical and Electronics Engineers

39