detecting tampered image regions - site.ieee.org · previous work. 2005. determined that a digital...
TRANSCRIPT
![Page 1: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/1.jpg)
Detecting Tampered Image Regions
Victoria A GunningMIT Computer Vision Lab
MIT Edgerton Center
![Page 2: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/2.jpg)
Previous Work2005Determined that a digital image’s origin can be identified.2009Determined that portions of an digital image can be identified as tampered.
![Page 3: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/3.jpg)
Noise SourcesPRNU (Photoresponse Non-uniformity)DSNU (Dark Signal Non-uniformity)Shot NoiseReadout NoiseQuantization
![Page 4: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/4.jpg)
Denoising & Noise ExtractionFlat Fielding
Filters for Estimation: Box, Median, Gaussian, Bilateral, Bilateral Grid, ...
![Page 5: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/5.jpg)
Denoising & Noise ExtractionPrevious work used a combination of a Wiener filter and 8-tap Daubechies wavelet.
![Page 6: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/6.jpg)
Gaussian FilterSmooth change in dependency on neighbors as the distance increases
![Page 7: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/7.jpg)
Bilateral FilterTakes the pixel value distance in account as well as physical distance
![Page 8: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/8.jpg)
Modeling CamerasGenerate synthetic imagesModel the noise sources
![Page 9: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/9.jpg)
Deadleaf Images
![Page 10: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/10.jpg)
PRNU
![Page 11: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/11.jpg)
Gaussian Noise
![Page 12: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/12.jpg)
Quantization Noise
![Page 13: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/13.jpg)
Extracting K
![Page 14: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/14.jpg)
Averaging K
![Page 15: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/15.jpg)
D200 Images Frequencies
![Page 16: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/16.jpg)
D200 Extracted K
![Page 17: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/17.jpg)
Classifying Images
![Page 18: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/18.jpg)
Tampered RegionsThe first test was using patch correlation. The middle of the image was from a different camera.
![Page 19: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/19.jpg)
Tampered RegionsMasking the tampered and original areas, the mean and variance of each pixel region can be calculated.
![Page 20: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/20.jpg)
Tampered RegionsThe first test was using patch correlation. The middle of the image was from a different camera.
![Page 21: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/21.jpg)
Tampered RegionsMasking the tampered and original areas, the mean and variance of each pixel region can be calculated.
![Page 22: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/22.jpg)
Markov Random FieldsThe last tests used MRF and Loopy Belief Propagation.
![Page 23: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/23.jpg)
Markov Random Fields
![Page 24: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/24.jpg)
References
[1] Fridrich, J. (2009). Digital image forensics using sensor noise.[2] Hirakawa, K. and Parks, T. W. (2005). Adaptive homogeneity-directed demosaicing algorithm.[3] Luk, J., Fridrich, J., and Goljan, M. (2005). Determining digital image origin using sensor imperfections. Technical report, Binghamton University.[4] Paris, S. and Durand, F. (2006). A fast approximation of the bilateral filter.[5] Tomasi, C. and Manduchi, R. (1998). Bilateral filtering for gray and color images. In Sixth International Conference on IEEE.
![Page 25: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital](https://reader034.vdocuments.us/reader034/viewer/2022042202/5ea30a45c988175bdf1acca9/html5/thumbnails/25.jpg)
Thanks to my mentor Katie Bouman and advisor Bill Freeman.