webo naver manual(24 dec2009)sj

27
WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E- RESEARCH TOOLS Understanding WeboNaver : API-based search tool for the Naver search engine Han Woo PARK Associate Professor Dept of Media & Communication, YeungNam University, S.Korea Director of WCU Webometrics Institute http://english-webometrics.yu.ac.kr han [email protected] http://www.hanpark.net Se Jung Park Ph.D. Student, Dept of Media and Communication, YeungNam University. S.Korea David Stuart Honorary Research Fellow, Statistical Cybermetrics Research Group, University of Wolverhampton, Wulfruna Street, Wolverhampton, UK. Seung Wook Lee MA Student, Dept of Information and Communication of Engineering, YeungNam University, S.Korea 박박박 , 박박박 , David Stuart, 박박박 (2010). API 박 박박박 박박 박박박박 WeboNaver 박 박박박 박박 : 18 박 박박박박박 박 박박박 박박 . Journal of the Korean Data Analysis Society. 11 박 6 박 (B).

Upload: wcu-webometrics-institute

Post on 22-Apr-2015

1.213 views

Category:

Technology


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Webo Naver Manual(24 Dec2009)Sj

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Understanding WeboNaver: API-based search tool for the Naver search engine

Han Woo PARKAssociate Professor

Dept of Media & Communication, YeungNam University, S.KoreaDirector of WCU Webometrics Institute

http://english-webometrics.yu.ac.kr [email protected]

http://www.hanpark.net

Se Jung ParkPh.D. Student, Dept of Media and Communication, YeungNam University. S.Korea

David StuartHonorary Research Fellow, Statistical Cybermetrics Research Group, University of Wolverhampton, Wulfruna Street, Wolverhampton, UK.

Seung Wook LeeMA Student, Dept of Information and Communication of Engineering, YeungNam University, S.Korea

박한우 , 박세정 , David Stuart, 이승욱 (2010). API 를 활용한 검색 프로그램 WeboNaver 의 이해와 적용 : 18 대 국회의원의 웹 가시성 분석 . Journal of the Korean Data Analysis Society. 11 권 6 호 (B).

Page 2: Webo Naver Manual(24 Dec2009)Sj

2

The purpose of this paper is to introduce the API-based webometrics tool created for the Korean search engine Naver

This non-commercial software is designed to collect large amounts of data automatically and can easily distinguish between different types of information on the web, which was impossible before.

(Image Source: Newsweek, 5 Nov 2007)

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Webonaver (Webometrics Tool for Naver)Webonaver (Webometrics Tool for Naver)

Page 3: Webo Naver Manual(24 Dec2009)Sj

3

Rationale for the Naver

• “Republic of Naver” (Kim & Sohn, 2007)

• CEO Google, 30 May 2007)• “Korea is a great laboratory of the digital age.”

(Eric Schmidt,

• “Korea’s Naver is now the world’s 5th search service provider, behind Google, Yahoo, Baidu and Microsoft.” (The AP, 9 Oct 2007)

(Image Source: Newsweek, 5 Nov 2007)

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Page 4: Webo Naver Manual(24 Dec2009)Sj

4

Rationale for the Naver

• “Google left behind as Koreans Naver-gate the internet” (Financial Times, 2 Jan 2008)

• “IN SOUTH KOREA People who want to looksomething up on the internet don’t “Google it”. Instead they “ask Naver”. (Economist, 30 Feb 2009)

• Yeon-Ok Lee and Park. H. W., (2008). "The Importance of Search Engines in Digital News Consumption A Comparative Study Between South Korea and the UK". refereed paper presented at the Workshop “Gatekeepers in a Digital Asian-European Media Landscape: The rising structural power of Internet search engines”(2008).

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Page 5: Webo Naver Manual(24 Dec2009)Sj

5

Component of Naver

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Log-in

The articles title (changing automatically)

The press linkedToday’s issues

Quick menubrowser window

Page 6: Webo Naver Manual(24 Dec2009)Sj

6

Terms of Use

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Page 7: Webo Naver Manual(24 Dec2009)Sj

7

Interface

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

The interface is fairly self-explanatory:

-Tick or untick to collect either only hit number or the title, URL, and description of the results

- Select which of the search options you want to include

- Click on the '...' button to select the text file that contains the queries you wish to run

- Click 'Run Queries'

The interface is fairly self-explanatory:

-Tick or untick to collect either only hit number or the title, URL, and description of the results

- Select which of the search options you want to include

- Click on the '...' button to select the text file that contains the queries you wish to run

- Click 'Run Queries'

Page 8: Webo Naver Manual(24 Dec2009)Sj

8

Getting an API key

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

URL : http://dev.naver.com/openapi/register**This page need the Login

Page 9: Webo Naver Manual(24 Dec2009)Sj

9

Search query limit

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

API Key

Search query limit per day: 25,000

Page 10: Webo Naver Manual(24 Dec2009)Sj

10

Input file

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

*.txt file must encoded by UTF-8 type

Page 11: Webo Naver Manual(24 Dec2009)Sj

11

Output file

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

When you tick it to collect only hit number, it shows the number of web pages containing search query

Page 12: Webo Naver Manual(24 Dec2009)Sj

Pilot comparison between API and Manual Webpage search

12

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Comparison was done using randomly selected Korean politicians as of 12 Aug 2009

Page 13: Webo Naver Manual(24 Dec2009)Sj

13

• There are always differences between the

API’s results and the normal search results, but these are miniscule differences in comparison with the APIs of Google, Yahoo and Bing

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Pilot comparison between API’s and Manual

Page 14: Webo Naver Manual(24 Dec2009)Sj

14

Output file

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

When you tick it to parse the title, URL, and description of theresults (except for images which doesn’t have) the number of web pages containing search query

Page 15: Webo Naver Manual(24 Dec2009)Sj

15

Issues in multiple hits

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

The multiple hits reflect the numbers displayed in pages of the Naver. It’s not program error. The Webonaver show actual different numbers of the results from the Naver. The last hits show actual results Webonaver can extract. It’s not the only case of the Naver, but also other search engines such as yahoo display different results as an each webpage.

Page 16: Webo Naver Manual(24 Dec2009)Sj

16

Issues in multiple hits example

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Page 17: Webo Naver Manual(24 Dec2009)Sj

17

Issues in multiple hits example

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Page 18: Webo Naver Manual(24 Dec2009)Sj

18

Issues in multiple hits example

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Page 19: Webo Naver Manual(24 Dec2009)Sj

19

Output file

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

The Naver API doesn't provide the real URL. Rather it supplies a 'Naver API’. But, user can visit an actual site when they put the api-based URL to the window browser of the Naver.

Page 20: Webo Naver Manual(24 Dec2009)Sj

There are programming and time issues, but there are also issues regarding how service provider responds.

Naver is more protective of handing out API keys, in comparison with yahoo or Bing which provide Open APIs.

It is important that services are not abused.

20

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Ethical issues

Page 21: Webo Naver Manual(24 Dec2009)Sj

Korean National Assembly Members’ web presence

• Web presence of Korean 18th congressman between 27th August and 24th September is automatically collected using WeboNaver at an interval of a week.

• 20 members’ web presence including blog, scholar, news and web documents is visualized.

21

Page 22: Webo Naver Manual(24 Dec2009)Sj

22

Page 23: Webo Naver Manual(24 Dec2009)Sj

• web presence of the term H1N1 is examined using Webonaver. We tested the usability and reliability of this tool.

Queres: 신종플루 (A virus subtype H1N1) 신종 인플루엔자 (Influenza A virus subtype H1N1) 신종인플루엔자 (Influenza A virus subtype H1N1)

• Users can get same results from certain words containing space character and the one without space using WeboNaver.

• But, it can not assume similar words as same. Users should consider which specific data they want to extract before using this tool.

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS Web presence of the term H1N1

23

Page 24: Webo Naver Manual(24 Dec2009)Sj

24

Page 25: Webo Naver Manual(24 Dec2009)Sj

• API-based search tool such as WeboNaver enables researchers to capture massive web data automatically and systemically.

• This software can help researchers improve efficiency of data analysis within a specified timeframe.

• Web data gathered using this tool can also be visualized to describe online trend.

25

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Conclusion

Page 26: Webo Naver Manual(24 Dec2009)Sj

• Mayr, Philipp; Tosques, Fabio (2005).

Google Web APIs - An instrument for webometric analyses? pp. 677-678. In: Ingwersen, Peter; Larsen,Birger (eds.): 10th International Conference of theInternational Society for Scientometrics and informetrics.Stockholm (Sweden)

http://www.ib.hu-berlin.de/~mayr/arbeiten/ISSI2005_Mayr_Toques.pdf

• The project site with the APIs demos is offline thesedays. But they are recovering the demos soon. http://bsd119.ib.hu-berlin.de/%7Eft/

26

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Reference (Web APIs)

Page 27: Webo Naver Manual(24 Dec2009)Sj

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

This tool is publicly available. Please check out WWI official website.http://english-webometrics.yu.ac.kr

27