CNGI-CERNET2 Operation

Oct 21, 2008

Outline

1. CNGI-CERNET2 updates

2. CPN Measurement

3. Research Project of NOC

4. Challenges

1. CNGI-CERNET2 updates

Deploy Topology of CNGI-CERNET2 (2004-12)Point2point link address IPv4range: 202.38.120.0/25start: 202.38.120.4/30IPv6range: 2001:DA8:1::/48start: 2001:DA8:1:1::/64

Loopback addressIPv4range: 202.38.120.192/27start: 202.38.120.192/32IPv6range: 2001:DA8:1:ff::/64start: 2001:DA8:1:ff::/128

北京

郑州

西安

武汉

合肥

上海

杭州

成都

沈阳

天津

重庆

济南

大连

长春

长沙

南京

厦门

兰州

哈尔滨

广州

2.5G

155M

juniper

bitway

huawei

CNGI-CERNET2 is Started to provide service at the end of 2004.

25 POPs, 1 core router for each POP. The speed of backbone link is from 155M to 2.5G

Due Topology of CNGI-CERNET2 (2006-8) topology when CNGI-CERNET2 project is finished

Still 25 POPs.2 core routers for each POP.1 or 2 edge routers for each CPN.Speed of backbone linkis from 2.5G to 10G.

10GPOS

2.5GPOS

比威 BE12016

华为 NE80

华为 NE5000

Juniper T640

CiscoCRS

Hitachi GR4000

北京－清华

西安武汉

合肥

上海－交大

广州

成都

沈阳

天津

重庆

厦门

南京

兰州

大连

哈尔滨长春

济南

杭州长沙

郑州

北京－北大北京－北邮

北京－北航

上海－复旦

上海－同济

CNGI-6IX上海

CNGI-6IX北京

Current State of CNGI-CERNET2

All on-line core routers are from single vendor to optimize advanced service support like multicast and MPLS.

Currently more than 200 customer networks, about 2M end users.

Statistics of Tickets and Traffic(2006-08 ~ 2008-08)

• Statistics of Tickets of 2007

• Statistics of Tickets of 2008

• Statistics of Backbone traffic of 2007

• Statistics of Backbone traffic of 2008

• Assigned IPv6 Address Blocks

Statistics of Tickets of 2007Stati sti cs of Ti ckets of 2007

(Total 604)

39%

25%

19%

5%

12%

Li nkMai ntai n

Li nkFai l ure

RouterMai ntai n

RouterFai l ure

POP

Router failure is 19%.

We find many bugs of routers of different vendors.

Statistics of Tickets of 2008Stati sti cs of Ti ckets of 2008

(Total 427)

43%

16%

15%1%

25%

Li nkMai ntai n

Li nkFai l ure

RouterMai ntai n

RouterFai l ure

POP

Router failure is cut down.

IPv6 goes more mature.

Statistics of Backbone traffic of 2007

64%

3%

4%

4%

8%

4%3% 2%

清华 武汉 广州

南京 上交 郑州

天津 济南 沈阳

大连 长春 哈尔滨

北大 北邮 北航

西安 成都 重庆

兰州 合肥 杭州

厦门 长沙 复旦

同济

18%

5%

7%

3%

3%

5%

2%

3%

3%

5%3%2%4%

3%

1%

2%

4%

4%

3%3%

4%

4%

3%

2%

3%

清华 武汉 广州

南京 上交 郑州

天津 济南 沈阳

大连 长春 哈尔滨

北大 北邮 北航

西安 成都 重庆

兰州 合肥 杭州

厦门 长沙 复旦

同济

Border Backbone

Inbound Traffic of Backbone Outbound Traffic of Backbone

Backbone traffic is 1.8G. Border traffic is low, the major traffic is generated by DVTS.

Information source is not balanced. Shanghai contribute the most. They have trial IPTV service.

Statistics of Backbone traffic of 2008

2%2%

3% 2%

2%

5%

29%

42%

3%

3%

清华 武汉 广州

南京 上交 郑州

天津 济南 沈阳

大连 长春 哈尔滨

北大 北邮 北航

西安 成都 重庆

兰州 合肥 杭州

厦门 长沙 复旦

同济

Border Backbone

Inbound Traffic of Backbone Outbound Traffic of Backbone

8%

9%

2%

3%

2%2%

2%

2%

11%

13%3%2%

3%

3%

6%

2%

3%

6%

3%3%

3%

3%

3%

3%

2%

清华 武汉 广州

南京 上交 郑州

天津 济南 沈阳

大连 长春 哈尔滨

北大 北邮 北航

西安 成都 重庆

兰州 合肥 杭州

厦门 长沙 复旦

同济

Backbone traffic doubled. Border traffic increased dramatically. Besides Shanghai, there are other POPs contribute much traffic, such as BUPT, Shenyang and Hefei.

Assigned IPv6 Address Blocks

IPv6 address space continue to grow.

Route Prefix

There are about 1100 IPv6 items.属于 2001:da8::/32且前缀长度为 48的BGP路由条数： 156

There are about 1100 IPv6 items.156 BGP route table items belong to 2001:da8::/32 and with prefix length48

CERNET2 NOC

• Team– NOC Director (1)– Engineers(2)– help-desk(6) – dedicated for CERNET2 operation

• 365*24 Service– 365×24 helpdesk– 365×24 On-Call Engineer

• Operation Procedure– Home-made ticket system for operation management– Documents– Ticket– Report(Daily, Weekly, Monthly)

The picture of cernet2 NOC

Research Activities

• Softwire (4o6)

• SAVA (Source Address Authentication)

• Applications

• …..

Currently, there are a lot of research activities on CERNET2.

CERNET 主干网

上海交大华南理工

北大

东南大学

北邮

华中科技

清华

CERNET2主干网

IPv6网

IPv4网

4over6网关

Softwire

Softwire is a 4o6 solution.They deployed 8 testing nodes around 7 universities of 5 cities.They have now set up a working group in IETF and published RFC4925.

SAVA

SAVA is a source address authentication solution. They deployed 14 testing nodes on CERNET2.They also set up a working-group in IETF and published RFC5210.

6PlanetLab

6PlanetLab is another popular project which is cooperated with planetlab project.

Currently they have developed 50 nodes around china in 25 cities.

IPv6 based IPTVIPv6 based IPTV

Currently IPTV is the most popular application in CERNET2. Currently IPv6 network has no so much traffic as IPv4 network, but it may be a good situation for high bandwidth application.

3TNet connected to CNGI-CERNET2， transferring CCTV programs.

IPv6 IMSIPv6 IMS

IPv6 IMS system.

Support IP to phone based on SIP.

Currently, there are about 1000 on-line users.

ipv6.beijing2008.cnCERNET2 host official IPv6 website for Olympics Games 2008 at Beijing.This is the 1st official IPv6 website in the history of Olympics.

2. CPN Test

• Test 100 CPNs of 100 famous universities in China

• Focus on connectivity, Web and DNS services, Scale of IPv6 users

Test method

• Ping all CPN from a server on NOC

• Dig DNS of all CPN from a server on NOC

• Wget webpage of all CPN from a server on NOC

• Setup a website and ask for sign on– http://6rank.edu.cn/

Some Result

• There are more than 200,000 IPv6 users access our test website

• DNS Configuration is a major source of Problems – Availability

• Some websites are not reachable due to DNS miss configuration.

– Performance• DNS miss configuration may also cause long latency and thus cause low

performance of web access.

• IPv6 Performance of Unix is much better than Windows

I Pv6填写验证码的独立 地址增长曲线

0

50000

100000

150000

200000

250000

时间

IPv6地址数

1系列

i pv6填写验证码的独立 访问范围统计

3% 5%

87%

5%

>80004000-80001000-4000<1000

There are more than 200,000 persons visit testing websites.Most of CPN has more than 1000 users.During testing, the backbone traffic increased.

3. Research Project of NOC

• GPERF

• TRC

• BGP-Grid

CERNET2 NOC also involved in some research projects.

GPERF(http://gperf.edu.cn)

They develop a global active measurement system named GPERF. Currently GPERF has near 1000 probes covering more than 270 ASes.From Apr 2008, GPERF is used to monitor important information systems of Olympics.We will appreciate if any one would like host a gperf node.Gperf is very lightweight. It does not need a dedicated server.

TRC(http://dragonlab.org)

To support research of IPv6, CERNET2 NOC generate and publish IPv6 traffic trace.We also develop a IP anonymousized tools and open source.

BGP-Grid

We always meet much problems on inter-domain routing. However, it is not convenient to investigate them. It is hard to do emulation. And the testing works are very costly.The idea of BGP-grid is to construct a network by servers. This network has the same topology as real AS interconnection network. Use tunnel links to connect servers together. Inside each AS, the server learns routing information and policy from border router.We can do testing works in this BGP-grid without any affecting of commodity network.

• bgpgrid-113:~# bgping -c 1 203.91.120.0

• BGPING 203.91.120.0...

• Ping route => 203.91.120.0 [seq=0]• <- AS 24489 202.179.241.49• -> AS 23911 202.179.241.50• <- AS 23911 210.25.189.65• -> AS 23910 210.25.189.68• <- AS 23910 202.38.120.189• -> AS 24575 202.38.120.190• Pong route <= 203.91.120.0 [seq=0]• <- AS 24575 202.38.120.190• -> AS 23910 202.38.120.189• <- AS 23910 210.25.189.68• -> AS 23911 210.25.189.65• <- AS 23911 202.179.241.50• -> AS 24489 202.179.241.49

• bgpgrid-113:~# bgping -c 1 166.111.8.0

• BGPING 166.111.8.0...

• Ping route => 166.111.8.0 [seq=0]• <- AS 24489 202.179.241.49• -> AS 23911 202.179.241.50• <- AS 23911 210.25.189.65• -> AS 23910 210.25.189.68• Pong route <= 166.111.8.0 [seq=0]• <- AS 23910 210.25.189.68• -> AS 23911 210.25.189.65• <- AS 23911 202.179.241.50• -> AS 24489 202.179.241.49

This is a tool of BGP-grid named bgping.

It can show round-trip path and AS number.

4. Challenges

• The old question “what is the killer application”

• Interconnection between IPv4 and IPv6– IPv6 user access IPv4 resources– IPv4 user access IPv6 resources– For a user to set up tunnel himself is not a

good solution

• Self-sufficiency of current IPv6 infrastructure

Thanks!