![Page 1: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/1.jpg)
Introduction to Mechanical TurkArtificial Artificial Intelligence
AWS User Group BerlinThomas Metschke25.03.2010Peritor GmbH
![Page 2: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/2.jpg)
Amazon Mechanical Turkis a marketplace for work.
2
![Page 3: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/3.jpg)
Mechanical Turk Marketplace
400,000+ Workers
In 100+ Countries
Available 24/7
ProgrammaticallyAccessible
3
http://www.flickr.com/photos/diamond_rain/2543837414/
![Page 4: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/4.jpg)
Workers Requesters
4
So there are basically
http://www.flickr.com/photos/saad/1968774 http://www.flickr.com/photos/chicagobart/4181533461
![Page 5: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/5.jpg)
Workers
5
Mechanical Turk as a Worker
http://www.flickr.com/photos/saad/1968774
Make money by working on Human Intelligence Tasks
Workers can work from home and choose their own work hours
![Page 6: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/6.jpg)
Your Dashboard
6
![Page 7: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/7.jpg)
Your Dashboard
7
The number of available tasks.
![Page 8: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/8.jpg)
Your Dashboard
8
Total Earnings and Bonuses.
![Page 9: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/9.jpg)
Your Dashboard
9
HIT Status and Totals.
![Page 10: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/10.jpg)
How do I get the money?
U.S. Bank account
Amazon Gift
Certificate
Bank Checks in Rupees
10
![Page 11: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/11.jpg)
Have access to a global,on-demand, 24 x 7 workforce
Can get thousands of HITs completed in minutes
Pay only when they are satisfied with the results
Requesters
11
Mechanical Turk as a Requester
http://www.flickr.com/photos/chicagobart/4181533461
![Page 12: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/12.jpg)
Requesting HITs
Requesters
• define and create your HITs
• load HITs to Mechanical Turk
Workers
• work on your HITs
• submit results
Requesters
• approve and pay for completed HITs
• use the results
12
![Page 13: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/13.jpg)
Design HITs
13
Enter Properties Design Layout
![Page 14: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/14.jpg)
Design HITs - faster
Take developer and useCSV filesSOAP / REST orAmazon Mechanical Turk developer tools
14
![Page 15: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/15.jpg)
What would it look like
http://mechanicalturk.amazonaws.com/?Service=AWSMechanicalTurkRequester&AWSAccessKeyId=[the Requester's Access Key ID]&Version=2008-08-02&Operation=CreateHIT&Signature=[signature for this request]&Timestamp=[your system's local time]&Title=Location%20and%20Photograph%20Identification&Description=Select%20the%20image%20that%20best%20represents&Reward.1.Amount=5 &Reward.1.CurrencyCode=USD&Question=[URL-encoded question data]&AssignmentDurationInSeconds=30&LifetimeInSeconds=604800 &Keywords=location,%20photograph,%20image,%20identification,%20opinion
15
![Page 16: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/16.jpg)
Publish HITs
credit card debit card
Amazon Payments account
U.S. bank account
HITs have to be paid in advance
Amazon takes 10% on top
16
![Page 17: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/17.jpg)
Use Mechanical Turk for
Work that requires Human Judgment
Work that algorithms cannot completely solve
Work that has unpredictable or spiky volume
17
![Page 18: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/18.jpg)
Improving Data Quality
Are these two businesses the same?
Peritor GmbH
Blücherstraße 2210961 Berlin
http://peritor.com
YES
Peritor Consulting
Blücherstraße 22Hof III Aufgang 6
10961 Berlin
NO
Background Data is the company’s business
Accuracy and breadth are key to differentiation
Process 1 MM data points to ingest each day
200 data sources
Problem Data needs to be normalized,
enhanced and de-dupped
Algorithms could get data about 70% clean
18
![Page 19: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/19.jpg)
YES NO
Moderating UserGenerated Content
Background User generated content is a key part
of a web 2.0 experience
Process Millions of photos uploaded every
day
Problem Need to ensure user generated
content meets site guidelines
19
Is this image explicit?
http://www.flickr.com/photos/cmak/1521356521/
![Page 20: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/20.jpg)
Categorization
What kind of dress is this?
Cocktail
Bridal dress
Background Consumers need to be able to
quickly find a product when shopping online
The Business Process Millions of new products are
introduced everyday
Products are sourced from hundreds of merchants and manufacturers, each with their own taxonomy
Problem Need to properly categorize new
products quickly in order to monetize
20
http://www.flickr.com/photos/34801476@N00/296743627/
![Page 21: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/21.jpg)
Optimizing your HITs for
Price
SpeedAccuracy
21
![Page 22: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/22.jpg)
Check it out!
http://mturk.comhttp://turkers.proboards.com
22
![Page 23: AWS User Group Berlin - Introduction To Amazon Mechanical Turk](https://reader033.vdocuments.us/reader033/viewer/2022051514/548472d8b4af9fbd5d8b46ea/html5/thumbnails/23.jpg)
© Peritor GmbH - Alle Rechte vorbehalten
Peritor GmbHBlücherstr. 22, Hof III Aufgang 610961 Berlin
Tel.: +49 (0)30 69 20 09 84 0Fax: +49 (0)30 69 20 09 84 9
Internet: www.peritor.comE-Mail: [email protected]
Thank you for your attention