crm114 - classification made easy

16

Click here to load reader

Upload: jonathan-julian

Post on 17-May-2015

1.616 views

Category:

Technology


2 download

DESCRIPTION

Presented to Bmore on Rails December 14, 2010. bmoreonrails.org hatesitlovesit.com jonathanjulian.com

TRANSCRIPT

Page 1: CRM114 - Classification made easy

CRM114Classification made easy

Tuesday, December 14, 2010

Page 2: CRM114 - Classification made easy

“CRM114 is a system to examine incoming e-mail, system log streams, data files or other data streams, and to sort, filter, or alter the

incoming files or data streams according to the user's wildest desires.”

Tuesday, December 14, 2010

Page 3: CRM114 - Classification made easy

“Ruby interface to the CRM114 Controllable Regex Mutilator, an advanced and fast text classifier that

uses sparse binary polynomial matching with a Bayesian Chain Rule evaluator and a hidden

Markov model to categorize data with up to a 99.87% accuracy”

Tuesday, December 14, 2010

Page 4: CRM114 - Classification made easy

Classification?

Tuesday, December 14, 2010

Page 5: CRM114 - Classification made easy

Bayesian Filtering

Tuesday, December 14, 2010

Page 6: CRM114 - Classification made easy

Paul GrahamA Plan for Spam

Tuesday, December 14, 2010

Page 7: CRM114 - Classification made easy

•every email client

•replyz.com

•hatesitlovesit

Tuesday, December 14, 2010

Page 8: CRM114 - Classification made easy

Tuesday, December 14, 2010

Page 9: CRM114 - Classification made easy

apt-get install crm114

Tuesday, December 14, 2010

Page 10: CRM114 - Classification made easy

gem install crm114

Tuesday, December 14, 2010

Page 11: CRM114 - Classification made easy

crm = Classifier::CRM114.new([:spam,:ham])

crm.train!(:spam “Buy a Watch as a gift at a discount!”)crm.train!(:ham, "I'll see you all tomorrow morning.")

crm.classify(“It seems I have to be at the New York office tomorrow.”)

Tuesday, December 14, 2010

Page 12: CRM114 - Classification made easy

-rwxr-xr-x 1 jjulian staff 588696 Jul 8 17:41 /usr/local/bin/crm

spam.cssham.css

Tuesday, December 14, 2010

Page 13: CRM114 - Classification made easy

live coding demo?

Tuesday, December 14, 2010

Page 14: CRM114 - Classification made easy

hatesitlovesit.com

Tuesday, December 14, 2010

Page 15: CRM114 - Classification made easy

Jonathan Julian@jonathanjulian

jonathanjulian.com

Tuesday, December 14, 2010

Page 16: CRM114 - Classification made easy

Resources• http://crm114.sourceforge.net/

• https://github.com/bendiken/crm114

• http://www.elegantchaos.com/node/132

• http://www.paulgraham.com/spam.html

• http://replyz.com

• http://hatesitlovesit.com

• http://www.youtube.com/watch?v=dm7yAWpX1Mc

Tuesday, December 14, 2010