data scraping with mozenda
TRANSCRIPT
![Page 1: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/1.jpg)
![Page 2: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/2.jpg)
A modern tale
delivered by
Cap’n Mike Veitch
![Page 3: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/3.jpg)
Even pirates
are now on
a database
![Page 4: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/4.jpg)
Enter Name
Search
Pirate Locator
Current Ship
![Page 5: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/5.jpg)
Enter Name
Search
Jack Sparrow
Current Ship
Pirate Locator
![Page 6: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/6.jpg)
Enter Name
Search
Jack Sparrow
Current Ship
Pirate Locator
![Page 7: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/7.jpg)
Enter Name
Clear
Jack Sparrow Black Pearl
Current Ship
Pirate Locator
![Page 8: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/8.jpg)
Enter Name
Search
Current Ship
Pirate Locator
![Page 9: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/9.jpg)
Enter Name
Search
Davy Jones
Current Ship
Pirate Locator
![Page 10: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/10.jpg)
Enter Name
Search
Davy Jones
Current Ship
Pirate Locator
![Page 11: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/11.jpg)
Enter Name
Clear
Davy Jones Flying Dutchman
Current Ship
Pirate Locator
![Page 12: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/12.jpg)
![Page 13: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/13.jpg)
Ok to find a few locations
![Page 14: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/14.jpg)
Ok to find a few locations
If we knew all the pirates?
![Page 15: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/15.jpg)
Ok to find a few locations
If we knew all the pirates?
Getting 10…
![Page 16: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/16.jpg)
Ok to find a few locations
If we knew all the pirates?
Getting 10… 100…
![Page 17: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/17.jpg)
Ok to find a few locations
If we knew all the pirates?
Getting 10… 100… 1000…
![Page 18: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/18.jpg)
Ok to find a few locations
If we knew all the pirates?
Getting 10… 100… 1000…
We need automation
![Page 19: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/19.jpg)
Enter Name
Search
Pirate Locator
Current Ship
![Page 20: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/20.jpg)
Enter Name
Search
Pirate Locator
Current Ship
Fill in the search box
Cap’n Veitch
![Page 21: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/21.jpg)
Enter Name
Search
Pirate Locator
Current Ship
Press the button
Cap’n Veitch
![Page 22: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/22.jpg)
Enter Name
Search
Pirate Locator
Current Ship
Copy the response
Cap’n Veitch On Shore Leave
![Page 23: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/23.jpg)
Enter Name
Search
Pirate Locator
Current Ship
1
2 3
Repeat this process for a list of pirates
![Page 24: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/24.jpg)
Automation Solutions
![Page 25: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/25.jpg)
Automation Solutions
browser cut and paste (lots of)
![Page 26: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/26.jpg)
Automation Solutions
browser cut and paste (lots of)
Browser based software (Javascript)
![Page 27: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/27.jpg)
Automation Solutions
browser cut and paste (lots of)
Browser based software (Javascript)
Server based software (PHP, perl etc)
![Page 28: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/28.jpg)
Automation Solutions
browser cut and paste (lots of)
Browser based software (Javascript)
Server based software (PHP, perl etc)
SaaS - Software as a Service company
![Page 29: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/29.jpg)
![Page 30: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/30.jpg)
![Page 31: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/31.jpg)
![Page 32: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/32.jpg)
A simple question
How many Brava members
are in each ward in Brent?
![Page 33: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/33.jpg)
7
2
19
20
9
1017
18
14
3
10 174
6
6
22 17
6
4 5
33
Distribution of BRAVA Membersin London Borough of Brent
![Page 34: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/34.jpg)
How is done?
![Page 35: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/35.jpg)
How is done?
Who the Brava members are
![Page 36: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/36.jpg)
How is done?
Who the Brava members are
The address of each member
![Page 37: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/37.jpg)
How is done?
Who the Brava members are
The address of each member
The mapping of address to ward
![Page 38: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/38.jpg)
How is done?
Who the Brava members are
The address of each member
The mapping of address to ward
Count members in each ward
![Page 39: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/39.jpg)
![Page 40: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/40.jpg)
![Page 41: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/41.jpg)
![Page 42: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/42.jpg)
![Page 43: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/43.jpg)
![Page 44: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/44.jpg)
![Page 45: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/45.jpg)
276 Organisations
![Page 46: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/46.jpg)
![Page 47: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/47.jpg)
![Page 48: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/48.jpg)
![Page 49: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/49.jpg)
![Page 50: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/50.jpg)
![Page 51: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/51.jpg)
![Page 52: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/52.jpg)
![Page 53: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/53.jpg)
![Page 54: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/54.jpg)
![Page 55: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/55.jpg)
![Page 56: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/56.jpg)
![Page 57: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/57.jpg)
![Page 58: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/58.jpg)
![Page 59: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/59.jpg)
Loop through a list of postcodes
![Page 60: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/60.jpg)
![Page 61: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/61.jpg)
![Page 62: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/62.jpg)
![Page 63: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/63.jpg)
![Page 64: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/64.jpg)
![Page 65: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/65.jpg)
![Page 66: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/66.jpg)
![Page 67: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/67.jpg)
276 Organisations in Brent
![Page 68: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/68.jpg)
276 Organisations in Brent
![Page 69: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/69.jpg)
276 Organisations in Brent
What happened to the other 27?
![Page 70: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/70.jpg)
7
2
19
20
9
1017
18
14
3
10 174
6
6
22 17
6
4 5
33
Distribution of BRAVA Membersin London Borough of Brent
![Page 71: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/71.jpg)
![Page 72: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/72.jpg)
![Page 73: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/73.jpg)
![Page 74: Data Scraping with Mozenda](https://reader034.vdocuments.us/reader034/viewer/2022042515/5552c1cfb4c90581158b4818/html5/thumbnails/74.jpg)