![Page 1: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/1.jpg)
AI and ARGodfrey Nolan
![Page 2: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/2.jpg)
![Page 3: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/3.jpg)
![Page 4: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/4.jpg)
01.Experience
![Page 5: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/5.jpg)
Experience
• FieldMap
• Create waypoints
• Rolling shutter vs global shutter
• Automated flight around field
• Tile images on iPad
• Stitch images using OpenCV.
9/5/2019 Counting Sheep 5
![Page 6: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/6.jpg)
9/5/2019 Counting Sheep 6
![Page 7: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/7.jpg)
Experience
• Secure Drones Labs
• No data leakage
• Tamper resistant
• Self destruct button
9/5/2019 Counting Sheep 7
![Page 8: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/8.jpg)
02.Counting Sheep??
![Page 9: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/9.jpg)
Counting Sheep
• Requirements
• Semi-practical example
• Using existing experience
• Move to Drone 2.0
• Answer the age old question‘Do Androids dream ofElectric Sheep’
9/5/2019 Counting Sheep 9
![Page 10: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/10.jpg)
03.Plug and Play
![Page 11: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/11.jpg)
Components
• DJI Mobile SDK
• Google Tensorflow
• Google Cloud Platform
• Docker
9/5/2019 Counting Sheep 11
![Page 12: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/12.jpg)
Components
• DJI Mobile SDK
• Google Tensorflow
9/5/2019 Counting Sheep 12
![Page 13: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/13.jpg)
Components
• DJI Mobile SDK
• Google Tensorflow
9/5/2019 Counting Sheep 13
![Page 14: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/14.jpg)
Components
• DJI Mobile SDK
• Google Tensorflow
9/5/2019 Counting Sheep 14
![Page 15: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/15.jpg)
Components
• DJI Mobile SDK
• Google Tensorflow
9/5/2019 Counting Sheep 15
![Page 16: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/16.jpg)
Components
• DJI Mobile SDK
• Google Tensorflow
9/5/2019 Counting Sheep 16
![Page 17: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/17.jpg)
Components
• DJI Mobile SDK
• Google Tensorflow
9/5/2019 Counting Sheep 17
![Page 18: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/18.jpg)
04.Machine Learning Workflow
![Page 19: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/19.jpg)
Workflow
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 19
![Page 20: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/20.jpg)
Workflow
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 20
![Page 21: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/21.jpg)
Workflow
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 21
![Page 22: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/22.jpg)
Workflow
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 22
![Page 23: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/23.jpg)
Workflow
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 23
![Page 24: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/24.jpg)
Workflow
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 24
![Page 25: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/25.jpg)
Workflow
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 25
![Page 26: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/26.jpg)
05.Implementation
![Page 27: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/27.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 27
![Page 28: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/28.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 28
![Page 29: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/29.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 29
![Page 30: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/30.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 30
![Page 31: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/31.jpg)
Train and Test
• Prepare the Dataset
• Set Up Google Cloud Account
• Set Up Docker
• Configure Google Cloud
• Set Up Object Detection API
• Train Your Model
• Evaluate Your Model
9/5/2019 Counting Sheep 31
![Page 32: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/32.jpg)
Train and Test
![Page 33: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/33.jpg)
Train and Test
• Prepare the Dataset
• Set Up Google Cloud Account
• Set Up Docker
• Configure Google Cloud
• Set Up Object Detection API
• Train Your Model
• Evaluate Your Model
9/5/2019 Counting Sheep 33
![Page 34: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/34.jpg)
Train and Test
• Prepare the Dataset
• Set Up Google Cloud Account
• Set Up Docker
• Configure Google Cloud
• Set Up Object Detection API
• Train Your Model
• Evaluate Your Model
9/5/2019 Counting Sheep 34
![Page 35: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/35.jpg)
Train and Test
• Prepare the Dataset
• Set Up Google Cloud Account
• Set Up Docker
• Configure Google Cloud
• Set Up Object Detection API
• Train Your Model
• Evaluate Your Model
9/5/2019 Counting Sheep 35
![Page 36: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/36.jpg)
Train and Test
• Prepare the Dataset
• Set Up Google Cloud Account
• Set Up Docker
• Configure Google Cloud
• Set Up Object Detection API
• Train Your Model
• Evaluate Your Model
9/5/2019 Counting Sheep 36
![Page 37: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/37.jpg)
Train and Test
• Prepare the Dataset
• Set Up Google Cloud Account
• Set Up Docker
• Configure Google Cloud
• Set Up Object Detection API
• Train Your Model
• Evaluate Your Model
9/5/2019 Counting Sheep 37
![Page 38: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/38.jpg)
Train and Test
• Prepare the Dataset
• Set Up Google Cloud Account
• Set Up Docker
• Configure Google Cloud
• Set Up Object Detection API
• Train Your Model
• Evaluate Your Model
9/5/2019 Counting Sheep 38
![Page 39: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/39.jpg)
Train and Test
• Prepare the Dataset
• Set Up Google Cloud Account
• Set Up Docker
• Configure Google Cloud
• Set Up Object Detection API
• Train Your Model
• Evaluate Your Model
9/5/2019 Counting Sheep 39
![Page 40: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/40.jpg)
Train and Test
• Prepare the Dataset
• Set Up Google Cloud Account
• Set Up Docker
• Configure Google Cloud
• Set Up Object Detection API
• Train Your Model
• Evaluate Your Model
9/5/2019 Counting Sheep 40
![Page 41: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/41.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 41
![Page 42: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/42.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 42
![Page 43: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/43.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 43
![Page 44: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/44.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 44
![Page 45: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/45.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 45
![Page 46: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/46.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 46
![Page 47: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/47.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 47
![Page 48: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/48.jpg)
Implementation
• Get Data
• Train & Test
• Adjust
• Deploy
• Test & Validate
9/5/2019 Counting Sheep 48
![Page 49: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/49.jpg)
![Page 50: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/50.jpg)
06.Resources Q&A
![Page 51: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/51.jpg)
Lessons Learned
• Crowdsource earlier
• Choose more practical example
• Create your own images
• Image quality
9/5/2019 Counting Sheep 51
![Page 52: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/52.jpg)
Lessons Learned
• Dyed sheep
• Streamline config. with Docker
• Tensorflow works on iOS
9/5/2019 Counting Sheep 52
![Page 53: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/53.jpg)
Future Plans
• Cattle
• Horses
• Deer
• Polar Bear (thermal)
• Parking Lots
• Plants
• Pallets
9/5/2019 Counting Sheep 53
![Page 54: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/54.jpg)
Future Plans
• Animal Tracking
• AR and AI
• Amazon’s Mechanical Turk
• Automate
9/5/2019 Counting Sheep 54
![Page 55: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/55.jpg)
Resources
• http://developer.dji.com
• https://www.tensorflow.org/install/
• https://github.com/tzutalin/labelImg
• https://github.com/tensorflow/models/tree/master/research/object_detection
• https://becominghuman.ai/
• https://towardsdatascience.com/how-to-train-your-own-object-detector-with-tensorflows-object-detector-api-bec72ecfe1d9
• https://docs.bazel.build
• https://t.co/uUTWuPw1ve (whitepaper) and https://github.com/nickdonnellyriis/sheep_demo (code)
9/5/2019 Counting Sheep 55
![Page 56: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/56.jpg)
Q&A
• @godfreynolan
• riis.com/blog
• slides.com/godfreynolan
9/5/2019 Counting Sheep 56
![Page 57: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/57.jpg)
07.Extras
![Page 58: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/58.jpg)
Prepare the Dataset
• Gather images
• Label the images with LabelImg found at https://github.com/tzutalin/labelImg
• Generate CSV files from your labeled dataset using script found at https://github.com/datitran/raccoon_dataset/blob/master/xml_to_csv.py
• Convert the CSV files into your TFRecord Dataset using script found at https://github.com/datitran/raccoon_dataset/blob/master/generate_tfrecord.py
• Create your label map file.
9/5/2019 Counting Sheep 58
![Page 59: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/59.jpg)
Prepare the Dataset
9/5/2019 Counting Sheep 59
![Page 60: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/60.jpg)
Set Up Google Cloud Account
• Sign up for a Google Cloud Account
• Set up a project named CountingSheep
• Enable ML Engine for your project https://console.cloud.google.com/flows/enableapi?apiid=ml.googleapis.com
• Click “Storage” on the side bar, and then create a new bucket called CountingSheepData
• Create a sub-directory called “data” in your storage bucket
9/5/2019 Counting Sheep 60
![Page 61: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/61.jpg)
Set Up Your Docker Environment
• Download Docker from docker.io
• Download the Dockerfilehttps://github.com/tensorflow/models/blob/master/research/object_detection/dockerfiles/android/Dockerfile
• docker build .
• docker images
• docker run -it IMAGE_ID
9/5/2019 Counting Sheep 61
![Page 62: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/62.jpg)
Configure your local Google Cloud environment
• Login - gcloud auth login
• Set your google cloud project - gcloud config set project YOUR_PROJECT_NAME
• Set your storage bucket - gsutil mb gs://YOUR_UNIQUE_BUCKET_NAME
• Export Google Cloud project/bucket names - export PROJECT="YOUR_PROJECT_ID"
export YOUR_GCS_BUCKET="YOUR_UNIQUE_BUCKET_NAME"
9/5/2019 Counting Sheep 62
![Page 63: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/63.jpg)
Configure your local Google Cloud environment
• Get the name of your service account:-curl -H "Authorization: Bearer $(gcloud auth print-access-token)" https://ml.googleapis.com/v1/projects/${PROJECT}:getConfig
• Using the tpuServiceAccount value from the response. Export the TPU service account with the following command:-
- export TPU_ACCOUNT=your-service-account
• Grant ML service agent to TPU service account:-gcloud projects add-iam-policy-binding $PROJECT --member serviceAccount:$TPU_ACCOUNT --role roles/ml.serviceAgent
9/5/2019 Counting Sheep 63
![Page 64: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/64.jpg)
Set up Object Detection API
• Ensure your local copy of object detection API works with following commands:cd /tensorflow/models/researchpython object_detection/builders/model_builder_test.py
9/5/2019 Counting Sheep 64
![Page 65: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/65.jpg)
Set up Object Detection API
• Move your TFRecord files and label map from your host machine into your docker imagedocker cp train.record CONTAINERNAME:/train.recorddocker cp test.record CONTAINERNAME:/test.recorddocker cp sheep_label_map.pbtxt CONTAINERNAME:/ sheep_label_map.pbtxt
• Copy the data over to your bucket (from your docker container)gsutil -m cp -r /train.record gs://${YOUR_GCS_BUCKET}/data/gsutil -m cp -r /test.record gs://${YOUR_GCS_BUCKET}/data/gsutil cp /sheep_label_map.pbtxt gs://${YOUR_GCS_BUCKET}/data/
9/5/2019 Counting Sheep 65
![Page 66: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/66.jpg)
Set up Object Detection API
• Download the object detection model:curl –O http://download.tensorflow.org/models/object_detection/ssd_mobilenet_v1_0.75_depth_300x300_coco
14_sync_2018_07_03.tar.gztar xzf ssd_mobilenet_v1_0.75_depth_300x300_coco14_sync_2018_07_03.tar.gz
• Upload it to Google cloudgsutil cp /tmp/ssd_mobilenet_v1_0.75_depth_300x300_coco14_sync_2018_07_03/model.ckpt.*
gs://${YOUR_GCS_BUCKET}/data/
9/5/2019 Counting Sheep 66
![Page 67: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/67.jpg)
Set up Object Detection API
• Update the following values in the config file:/tensorflow/models/research/object_detection/samples/configs/ssd_mobilenet_v1_0.75_depth_quantized_300x300_pets_sync.config
Upload file to Google Cloud bucket with the following command:gsutil cp
/tensorflow/models/research/object_detection/samples/configs/ssd_mobilenet_v1_0.75_depth_quantized_300x300_pets_sync.config gs://${YOUR_GCS_BUCKET}/data/pipeline.config
• Package the object detection API with the following commands:bash object_detection/dataset_tools/create_pycocotools_package.sh /tmp/pycocotoolspython setup.py sdist
9/5/2019 Counting Sheep 67
![Page 68: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/68.jpg)
Train your model
• Start your training job on Google Cloud TPU with the following command:cd /tensorflow/models/researchgcloud ml-engine jobs submit training `whoami`_object_detection_`date +%s` --job-dir=gs://${YOUR_GCS_BUCKET}/train --packages dist/object_detection-0.1.tar.gz,slim/dist/slim-
0.1.tar.gz,/tmp/pycocotools/pycocotools-2.0.tar.gz --module-name object_detection.model_tpu_main--runtime-version 1.9 --scale-tier BASIC_TPU --region us-central1--model_dir=gs://${YOUR_GCS_BUCKET}/train --tpu_zone us-central1 --pipeline_config_path=gs://${YOUR_GCS_BUCKET}/data/pipeline.config
•9/5/2019 Counting Sheep 68
![Page 69: AI and AR - Amazon S3 · • Streamline config. with Docker • Tensorflow works on iOS 9/5/2019 Counting Sheep 52. Future Plans](https://reader031.vdocuments.us/reader031/viewer/2022041015/5ec5f138d2b31741e6002d81/html5/thumbnails/69.jpg)
Train your model
• Start your training job on Google Cloud TPU with the following command:cd /tensorflow/models/researchgcloud ml-engine jobs submit training `whoami`_object_detection_`date +%s` --job-dir=gs://${YOUR_GCS_BUCKET}/train --packages dist/object_detection-0.1.tar.gz,slim/dist/slim-
0.1.tar.gz,/tmp/pycocotools/pycocotools-2.0.tar.gz --module-name object_detection.model_tpu_main--runtime-version 1.9 --scale-tier BASIC_TPU --region us-central1--model_dir=gs://${YOUR_GCS_BUCKET}/train --tpu_zone us-central1 --pipeline_config_path=gs://${YOUR_GCS_BUCKET}/data/pipeline.config
•9/5/2019 Counting Sheep 69