week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf ·...

13
Administrative HW2 will be graded and statistics posted by the end of today HW3 due next Friday Recitation next Friday cancelled due to the midsemester break Office hours next Friday cancelled because I’m out of town Find me by next Monday for inperson questions on the homework

Upload: others

Post on 03-Sep-2019

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

Administrative

• HW2  will  be  graded  and  statistics  posted  by  the  end  of  today

• HW3  due  next  Friday• Recitation  next  Friday  cancelled  due  to  the  mid-­‐semester  break

• Office  hours  next  Friday  cancelled  because  I’m  out  of  town– Find  me  by  next  Monday  for  in-­‐person  questions  on  the  homework  

Page 2: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

HW2  Statistics

Mean 86Median 86

Standard Deviation 5.5Max 94Min 73

Page 3: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

18734  Recitation

Differential  Privacy  and  theLaplace  Mechanism

Page 4: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

Database  Sanitization

Noise  injection

Page 5: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

Differential  Privacy

Does  smoking  increase   your  chances  of  getting  cancer?

Control

Experimental

Does  smoking  increase   your  chances  of  getting  cancer?

Control

Experimental

Page 6: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

Differential  Privacy:  Definition

xi X’i

Dataset  X

Function  K  runs  on  X  to  produce  K(X)

Dataset  X’

K  is  ε-­‐differentially  privacy  if  for  any  two  neighbor  datasets   X,  X’  that  differ  in  just  one  element   at  position   i:

For  all  outcomes   v,

𝑒"# ≤ %&  () * +,)%&  () *. +,)

≤ 𝑒#

Page 7: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

Approximate  Differential  Privacy:  Definition

xi X’i

Dataset  X

Function  K  runs  on  X  to  produce  K(X)

Dataset  X’

K has  ε-­‐differentially  privacy  if  for  any  two  neighbor  datasets   X,  X’  that  differ  in  just  one  element   at  position   i:

For  all  outcomes   v,

1 − 𝜀 ≈ 𝑒"# ≤ %& ) * +,%& ) *. +,

≤ 𝑒# ≈ 1 + 𝜀

Page 8: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

Laplace  Mechanism

8Slide:  Adam  Smith

Page 9: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

Laplace  Distribution

9

PDF  =  

Source:  Wikipedia

Page 10: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

Laplace  Distribution

10

Change  of  notation  from  previous  slide:μà 0b  à λ

Page 11: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

Laplace  Mechanism:  Proof  Idea

11

Page 12: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

Laplace  Mechanism:  Proof

• To  Prove:  Pr[A(x)∈ S  ]  ≤  eε Pr[A(x’)∈ S  ]  

– A(x)  =  f(x)  +  Laplace(GSf/ε)– A(x’)  =  f(x’)  +  Laplace(GSf/ε)

• Steps:– Distribution  of  A(x):  Laplace(f(x),  GSf/ε)– Distribution  of  A(x’):  Laplace(f(x’),  GSf/ε)

Page 13: week7 laplace oct14 - archive.ece.cmu.eduece734/fall2016/recitations/week7_laplace_oct14.pdf · Administrative • HW2/will/be/graded/and/statistics/posted/by/ the/end/of/today •

Laplace  Mechanism:  Proof