SMS Message Collection for a Public Research Corpus

Tao Chen14 January 2011

Outline

• Collection in AMT• Android SMS Backup• Problem & Future Work

2

3

Collection in AMT

• Re-design HIT– Elaborate instruction– Informed Consent– Emphasis on “Sent Message” only

• Batch submission – For Nokia user using Nokia PC Suite– Export SMS as a .CSV file – Minimal Messages: 10 and 100

4

Collection in AMT

• Worker’s submissionMinimal SMS

BasePayment

Bonus/SMS

CAP ApprovalRate

10 $ 0.1 $ 0.01 $ 1.0 21.4% (3/17)

100 $1.0 $ 0.01 $ 4.0 18.2% (8/44)

Time period # of SMS

26/10/2010 - 6/11/2010 468

27/12/2010 – Now 2, 555

Total 3, 023

5

Android SMS Backup

• Backup SMS to Gmail•Auto Backup•Manual Backup

6

Android SMS Backup

• Backup SMS to Gmail• Auto Backup• Manual Backup

• Advanced Setting• Mark as a read• Gmail Label• Maximum # /backup

7

Donation with SMS Backup

• Modify code– Generate a draft email as well• Subject: SMS for Donation [Time]• To: SMS.Donation@gmail.com• Body: Sent messages

• Donator sends the email – Remove any message he wants if needed

8

Privacy Protection !!!

Privacy Protection

Encrypt

Replace

9

Meta Data Encryption

• Data Encryption Standard (DES)– 64 bits Key: • 56 bits: significant bits• 8 bits: parity bits

• Device Id as a unique Key– IMEI(International Mobile Equipment Identity)– 15 bytes

10

Meta Data Encryption

• DES Advantage– Donators can be differentiated– Faster than AES( 128bits key)– Safer than Hash(SHA)

11

Body text Replacement

• Rules of replacementCategory Code

Email address <EMAIL>

URL <URL>

IP <IP>

Time <TIME>

Decimal <DECIMAL>

Other Number <#>

12

Example• Msg 1: from <47536f04e43da72878f82fc6172adb10> , to

<daad01ef32a9e37ba5db0399786bf1f1> , "13 Jan 2011 07:00:52 GMT"• "Hi, I want 2 go 2 school now"• ----------------------------------------------

• Msg 2: from <47536f04e43da72878f82fc6172adb10> , to <daad01ef32a9e37ba5db0399786bf1f1> , "13 Jan 2011 07:01:03 GMT"

• "My email address is <EMAIL> "• ----------------------------------------------

• Msg 3: from <47536f04e43da72878f82fc6172adb10> , to <daad01ef32a9e37ba5db0399786bf1f1> , "13 Jan 2011 07:01:44 GMT"

• "My homepage url is <URL> "• ----------------------------------------------

13

Future Work

• HIT in AMT– Continued collection– Publish Chinese version• Chinese workers are few

• Web-based collection– Mainly for Chinese SMS

14

Trial !!!

Future Work

• Our SMS Backup software– Testing on device– Chinese version– Publish on Android market: • $25 registration fees

15

Future Work

• Release corpus on the internet– Show the gradual achievement– Make our work more convincing– Attract more donators

16

Thank you!

Any comments are welcomed!

17