analyzing social media with python and other tools (4/4)
DESCRIPTION
TRANSCRIPT
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Hands-on-WorkshopBig (Twitter) Data
Damian Trilling
[email protected]@damian0604
www.damiantrilling.net
Afdeling CommunicatiewetenschapUniversiteit van Amsterdam
31 January 20149.30
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
In this session (4/4):
1 Looking back: Yesterday
2 Network analysis and visualizationNetwork analysis?Preparing the dataGephi
3 Exercise
4 Questions?
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Yesterday
We did a lot of stuff. . .
• Future plans?• What do you still need?• Don’t forget to have a look at the sample script (maybe copythe whole beehub-folder)
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Network analysis?
Network analysis?
Why?
• Often used to visualize social media data• But you can also calculate a lot of interesting statistics• Today: No intro to network analysis as a method, but firststeps to get the data and software working
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Preparing the data
Network analysis and visualization:Preparing the data
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Preparing the data
Twitter networks
Types of networks we could analyze
• RT-networks• @mention-networks• Follower-following-networks• . . .
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Preparing the data
Twitter networks
Think of the CSV-files from yesterday
• We could strip everything from the tweet-column except theusername (if someone is mentioned) . . .
• and then get a directed network: a column with senders and acolumn with the user the sender addresses.
• Countless variations possible
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Preparing the data
Twitter networks
Think of the CSV-files from yesterday
• We could strip everything from the tweet-column except theusername (if someone is mentioned) . . .
• and then get a directed network: a column with senders and acolumn with the user the sender addresses.
• Countless variations possible
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Preparing the data
Twitter networks
Think of the CSV-files from yesterday
• We could strip everything from the tweet-column except theusername (if someone is mentioned) . . .
• and then get a directed network: a column with senders and acolumn with the user the sender addresses.
• Countless variations possible
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Preparing the data
Twitter networks
Think of the CSV-files from yesterday
• We could strip everything from the tweet-column except theusername (if someone is mentioned) . . .
• and then get a directed network: a column with senders and acolumn with the user the sender addresses.
• Countless variations possible
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Preparing the data
Twitter networks
Useful ressources:• http://dfreelon.org/t2g/t2g.py: Twitter-to-Gephiconverter by Dan Freelon (but hey, with your knowledge fromyesterday you could have written that one yourself!)
• . . . and indeed, there is an improved version on beehub.
• http://mappingonlinepublics.net/resources/: AxelBruns’ processing tools for your Twapperkeeper-data
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Preparing the data
Twitter networks
Useful ressources:• http://dfreelon.org/t2g/t2g.py: Twitter-to-Gephiconverter by Dan Freelon (but hey, with your knowledge fromyesterday you could have written that one yourself!)
• . . . and indeed, there is an improved version on beehub.• http://mappingonlinepublics.net/resources/: AxelBruns’ processing tools for your Twapperkeeper-data
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Preparing the data
Facebook-networks
Gephi-networkfiles you can get from netvizz
• personal network – extracts your friends and the friendshipconnections between them
• personal like network – creates a network that combines yourfriends and the objects they liked
• group data – creates networks and tabular files for bothfriendships and interactions in groups
• page like network – creates a network of pages connectedthrough the likes between them
• page data – creates networks and tabular files for pages
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Gephi
Network analysis and visualization:Gephi
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Exercise
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Make your own network visualiztion
Steps to take
1 Collect a Facebook-network with netvizz OR use thePython-script to extract a network from one of yesterday’sTweet-datasets. It would be even more elegant, of course, tointegrate the code in your script from yesterday, so that it alsoproduces a gephi output file.
2 Open the file in gephi. Pay attention to the correct options(directed vs undirected network).
3 Visualize + calculate interesting statistics.
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Recap
1 Looking back: Yesterday
2 Network analysis and visualizationNetwork analysis?Preparing the dataGephi
3 Exercise
4 Questions?
#bigdata Damian Trilling
Looking back: Yesterday Network analysis and visualization Exercise Questions?
Vragen of opmerkingen?
Damian Trilling
[email protected]@damian0604
www.damiantrilling.net
#bigdata Damian Trilling