filtering twitter noise

36
Filtering Twitter Noise The problem, and some solutions using TalkingPuffin and Scala. Dave Briccetti @dcbriccetti

Upload: dcbriccetti

Post on 07-May-2015

2.415 views

Category:

Technology


0 download

DESCRIPTION

The problem, and some solutions using TalkingPuffin and Scala. Related blog post and screencast: http://briccetti.blogspot.com/2009/11/talkingpuffin-075-released-with-better.html

TRANSCRIPT

Page 1: Filtering Twitter Noise

Filtering Twitter Noise

The problem, and some solutions using TalkingPuffin and Scala.

Dave Briccetti@dcbriccetti

Page 2: Filtering Twitter Noise

What is Twitter noise?

Page 3: Filtering Twitter Noise
Page 4: Filtering Twitter Noise

How can I mute everything from Foursquare?

Page 5: Filtering Twitter Noise
Page 6: Filtering Twitter Noise

Nothing more from Foursquare.

If we wanted, we could just exclude Foursquare tweets from individual users.

Page 7: Filtering Twitter Noise

What about noisy retweeters?

Page 8: Filtering Twitter Noise
Page 9: Filtering Twitter Noise
Page 10: Filtering Twitter Noise

No more retweets from this user. This leaves her original, primary tweets, which we value.

Page 11: Filtering Twitter Noise

How does TalkingPuffin store these filters?

Let’s look at the filters dialog.

Page 12: Filtering Twitter Noise
Page 13: Filtering Twitter Noise

These are “compound filters.”

Page 14: Filtering Twitter Noise
Page 15: Filtering Twitter Noise

Contains a List of these:

Page 16: Filtering Twitter Noise
Page 17: Filtering Twitter Noise

Tags

Page 18: Filtering Twitter Noise

Tags may be assigned to people, and tweets may be included or excluded by tags.

Tags can be exported to Twitter lists.

Page 19: Filtering Twitter Noise

Here we just want to look at Twitter employees.

Page 20: Filtering Twitter Noise
Page 21: Filtering Twitter Noise
Page 22: Filtering Twitter Noise

Tags are managed by a TagUsers object.

Page 23: Filtering Twitter Noise
Page 24: Filtering Twitter Noise

CompoundFilters and tags are stored in InOutFilters.

Page 25: Filtering Twitter Noise
Page 26: Filtering Twitter Noise

InOutFilters are stored in a FilterSet, along with some general, boolean options.

Page 27: Filtering Twitter Noise
Page 28: Filtering Twitter Noise

Detecting retweets with regular expressions

Page 29: Filtering Twitter Noise
Page 30: Filtering Twitter Noise

A shared repository of regular expressions or other filters that can be used in a community to

identify and filter out noise.

External Noise Filters

Page 31: Filtering Twitter Noise

General Filters Pane

Page 32: Filtering Twitter Noise

Delivered Via a Web Service on Google App Engine

Page 33: Filtering Twitter Noise

Loaded into a List of regular expressions

Page 34: Filtering Twitter Noise

And used to find noise tweets

Page 35: Filtering Twitter Noise

Summary

● There is a lot of noise on Twitter● With the right tools you can control it● TalkingPuffin is one such tool● Scala is a great language for creating such

tools

Page 36: Filtering Twitter Noise

More

● Learn more about ● TalkingPuffin at TalkingPuffin.org● Scala at scala-lang.org

● Consider joining the TalkingPuffin open source development effort

● Contact● Dave Briccetti, @dcbriccetti