clara advanced networking in latin america and the clara initiative lishep 2004 rio de janeiro,...

ClaraClaraAdvanced networking in Latin America and the CLARA initiative

LISHEP 2004Rio de Janeiro, Brazil February 2004

Michael StantonCLARA Technical CommitteeRede Nacional de Ensino e Pesquisa do Brasil - [email protected]

Michael Stanton - LISHEP 20042

ClaraClaraA Brief Story of Networking in Latin America

• Political, linguistic and cultural considerations have traditionally led to considerable interaction between countries within the region

However, networking has not followed this model:• First connections (BITNET) starting 1986 using satellite

links between the US and each country separately• Same topology inherited with transition to Internet• Even multilateral initiatives (RedHUCyT in mid 90s and

AMPATH from 2001) have used traffic hubs in the US.


ClaraClaraFirst global conections from LA countries

Two “classical” phases of connectivity:

• e-mail networks (BITNET, UUCP)

• full Internet (IP) connectivity

• Table shows the dates of the first connections for each LA NREN (National Research and Education Network)

MX CL BR NI UY PY VE AR CR

e-mail 86 86 88 88 88 89 90 90 90

IP 89 92 91 94 94 95 92 93 93

CO EC PE BO CU PA GT SV HN

e-mail 90 91 91 91 91 92 92 94 94

IP 94 92 94 95 96 94 95 96 95


ClaraClara


ClaraClaraInfluence of telecommunications infrastructure

• Until very recently, the only available telecom infrastructure for data communication was by satellite– cost independent of distance– no incentive for establishing links within the region, as all

countries were mainly interested in access to global Internet

• Recent important changes (since late 1990s):– end of state telecom monopoly in many countries

• competition and lower prices• most LA NRENs replaced by commodity IP providers

(for economic or political reasons)– building out of new infrastructure based on submarine

fibre optical cables


ClaraClaraOptical cable infra-structure

• Advances in optical transmission technologies have recently made it possible to build very long distance undersea communications systems based on DWDM

• In the late 1990s, several new DWDM (Dense Wavelength Division Multiplexing) cable systems were built, vastly increasing the installed capacity

• Principal new undersea cable operators in Latin America:– Global Crossing– Telecom Italia – Sparkle – Telefonica International Wholesale Services - TIWS

(E-mergia)– New World Networks (ARCOS cable)


ClaraClaraNew Optical Cables in Latin America

E-mergia (TIWS)Global Crossing & TI SparkleGlobal Crossing ImpSatTransandinoUniSur

San Juan, Puerto Rico

Miami

to New York

to California


ClaraClaraNew cables in the Caribbean (Maya & Arcos)

Curacao

North Miami

Cat Island

Crooked Island

Providenciales(Turks & Caicos Islands)

Puerto Plata

San Juan

Punta Cana

WillemstadPunto Fijo

Riohacha

UstupoMariaChiquita

PuertoLimon

Bluefields

PuertoCabezas

PuertoLempira

Trujillo

PuertoCortes

PuertoBarrios

Ladyville

Cancun

Tulum

271km

309km

319km

376km

258km

325km 291km

1006km

242km372km

351km

314km301km371km

270km

279km

258km

339km

241km294km

363km

165km

114km

474km

521km Maya

Arcos(festoon)


ClaraClaraPresent Advanced R&E Connectivity in Latin America

AmPath• uses Global Crossing• connects AR, BR (2), CL,

VE• 45 Mbps (one size fits all)• all connections are point to

point from Miami, and thence to Abilene

Mexico• cross-border connections to

USA (TX and CA)

AmPath


ClaraClaraPresent State of Latin American NRENs

Established education and research networks:

• With dedicated Advanced R&E connections: Argentina, Brazil, Chile, Mexico, Venezuela

• Some with dedicated int’l connectivity:Costa Rica, Cuba, Uruguay

Education and research networks being re-established(present nat’l/int’l connectivity through commercial ISPs)

• Bolivia, Colombia, Ecuador, Guatemala, Panama, Peru, Paraguay, El Salvador

No education/research network (most connected to Internet via commercial ISPs):

• Nicaragua, Honduras, Dominican Republic, Haiti, rest of Caribbean


ClaraClara

Abundant

Medium

Narrow

Argentina - RETINA (www.retina.ar)

•4 with advanced connectivity

•8 in the near future

•57 with low connectivity

- 45 Mbps to AmPath


ClaraClara- ATM backbone

- 14 nodes- 300 Mbps total b/w

- FR to other PoPs- 15 state networks- Aggregate int’l b/w over

500 Mbps (incl. 90 Mbps to AmPath)

- new RNP backbone in 2004 – 1.8 Gbps total b/w (6x increase)

Brazil - RNP (www.rnp.br/en)


ClaraClaraBrazil – RNP: probable 2004 backbone topology

RJSP

SC

PR

RS

DF

MG

STM-1 (155 Mbps)

E3 (34 Mbps)

CE

PE

BA

STM-4 (622 Mbps)

ES

MA

PB

TO

AC

RO

MT

MS

GO

E1 (2 Mbps)PA

AM

RN

PI SE AL

RR

AP

Pop alreadytendered

Future tender


ClaraClara

Iquique

Antofagasta

Copiapó

La Serena

ValparaísoSantiago

Talca

Con cepción

TemucoValdivia

Arica

Osorno

Chile - REUNA (www.reuna.cl)

u t f s mre u n a

u ch ile

u m ce

u fro

u a ch

u te m

V a lpa ra ís o

S a n t ia g o

C o n ce pció n

Te m u co

V a ldiv ia

u n a p u ta

u cn

u a n to f

I qu iqu e

A n to fa g a s ta

C o pia pó

u s e re n a

L a S e re n a

Ta lca

u ta lca

u dau da

u de c

u bio bio

u la g o s

S witch de B a ck bo n e

S witch de A cce s o

R o u te r de A cce s o

Tra m a S D HFO M u lt im o doFO M o n o m o do

u dp

u n a p Un iv e rs ida d A rtu ro Pra tu ta Un iv e rs ida d de Ta ra pa cáu cn Un iv e rs ida d C a tó lica de l No rteu a n to f Un iv e rs ida d de A n to fa g a s tau da Un iv e rs ida d de A ta ca m au s e re n a Un iv e rs ida d de la S e re n au t f s m Un iv e rs ida d Técn ico Fe de rico S a n ta M a ríau ch ile Un iv e rs ida d de C h ileu te m Un iv e rs ida d Te cn o ló g ica M e tro po lita n au m ce Un iv e rs ida d M e tro po lita n a de C s . de la Edu ca ció nu dp Un iv e rs ida d D ie g o Po rta le su ta lca Un iv e rs ida d de Ta lcau de c Un iv e rs ida d de C o n ce pció nu bio bio Un iv e rs ida d de l B ío B íou fro Un iv e rs ida d de la Fro n te rau a ch Un iv e rs ida d A u s tra l de C h ileu la g o s Un iv e rs ida d de lo s L a g o s

- ATM backbone- 10

nodes- 10/60

Mbps- 45 Mbps to

AmPath


ClaraClaraMexico - CUDI (www.cudi.edu.mx)

• Internal links at 155 Mbps

• 400 Mbps of int’l connectivity


ClaraClaraWhere do we go from here?

• AMPATH´s achievements– Initial boost for Advanced Networking in LA– Stimulus for advanced connectivity inside each country– Motivation for collaborative projects– Connectivity needs, delayed till now due to high costs, being

solved

BUT

• Why does LA communicate internally through Miami?

• Why does LA communicate with other parts of the world through the US?


ClaraClaraAnother paradigm: Pan-European R&E networking

• In Europe, global networking also began with direct BITNET and IP links to the US from separate countries

• Since the early 1990s great efforts have been invested in pan-European networking, through the creation of a series of regional backbone networks:

• These networks have been built and managed by DANTE (Delivering Advanced Networking Technology to Europe), with financing by European NRENs and the EU

• Four versions of the pan-European backbone network– EuropaNET (1992-1997)– TEN-34 (1997-1998)– TEN-155 (1998-2001)– GÉANT (2002- )


ClaraClaraTEN-34

• Trans-European Network at 34 Mbps

• 20 countries• operational in 1997• backbone speed inferior to

internal NREN links(cost of int’l links)


ClaraClaraTEN-155

• Set up after liberalisation and harmonisation of European telecom industry

• Much cheaper int’l connectivity within Europe

• In some countries liberalisation delayed


ClaraClaraGÉANT

• First network of the “Bandwidth Age”

• 20-fold increase in capacity over TEN-155 for the same cost

• Principal connections are 10 and 2.5 Gbps wavelengths

• Currently the largest capacity operational IP network in the world


ClaraClaraThe @LIS iniciative

• Through GÉANT, the European R&E community enjoys high bandwidth connectivity with N. America

• Initiatives already taken to improve connectivity to Asian-Pacific, Mediterranean and Latin American regions, with support from the European Commission

• @LIS: Alliance for the Information Society (2003-2005)– 62.5 Million Euros for EU-LA on Information Society

Issues– 10 Million Euros for Interconnecting Europe & Latin

American Researchers


ClaraClara

CAESAR: Connecting All European and South American Researchers.

European initiative to prepare for the @LIS program• Promote EU-LA connectivity through regional connectivity within

LA plus a large pipe to Europe• Participants: DANTE, NRENs of Spain and Portugal

• CAESAR Workshop 2002 in Toledo became starting point for CLARA – cooperative organisation for advanced networking in LA– regional network:

feasibility study showed that @LIS budget sufficient to establish advanced connectivity to all LA countries

• EU has agreed to 80% - 20% cost sharing between EU and LA


ClaraClara

• Association of NRENs in LA open to all LA Countries– constituted in Uruguay (like LACNIC)

• CLARA is not limited to @LIS/CAESAR time scale and restrictions

• Will connect LA to Europe and to other regions• Cost to connect to the backbone will be the same for every

country at equal bandwidth• Improve Internet2 connectivity by optimising LA

participation in AMPATH


ClaraClara

• Argentina• Brasil• Bolivia (*)• Chile• Colombia (*)• Costa Rica• Cuba (*)• Dominican Republic (*)• Ecuador• El Salvador

• Guatemala• Honduras (*)• Mexico• Nicaragua• Panama• Paraguay• Peru• Uruguay• Venezuela

(*) expected future member

CLARA Members


ClaraClaraComments about CLARA

• CLARA responds to long-standing need for coordination between LA NRENs.

• Builds on trust-building already carried out between major partners

• Offers support for NREN building in other LA countries by provision of support and int’l connectivity


ClaraClaraALICE project: May 2003 to April 2006

ALICE - América Latina Interconectada Con Europa (2003-2006)

• Successor project to CAESAR

• Coordinated by DANTE, with participation of NRENs from Italy, France, Spain, Portugal and the CLARA countries, and eventually CLARA itself

• February 2003: technical definitions complete

• June 2003: Open tender for provisioning of links

• March 2004: Link contracts assigned

• May 2004: Network operational

Notes:

• DANTE is the project coordinator and will sign contracts with users and providers

• CLARA is expected to represent interests of LA users in the medium term (one year)


ClaraClaraSuggested network topology (tender document)

• Major connectivity between Argentina, Brazil, Chile and Mexico (at least 45 Mbps)

• Other countries connect to major nodes (between 10 and 45 Mbps)

• Large pipe to Europe (at least 155 Mbps)


ClaraClaraProbable topology of CLARA network

Operator A

Operator B

Operator C

Operator D

Operator E

Bandwidth characteristics:

•155 Mbps backbone ring

•622 Mbps to Europe

•10 to 45 Mbps spur links

•satellite link to Cuba


ClaraClaraThe Digital Divide in Latin America – the cost of access circuits to the CLARA network

Annual cost for access circuits from CLARA backbone to country point of entry

Internal country costs for access circuits

2 Mbps € 347.780 € 1.051.077

10 Mbps € 982.033 € 5.061.526

34 Mbps € 3.310.757 € 9.932.272

•The proposed costs of access connections from NRENs to the CLARA backbone were initially extremely high in the case of Central America and Colombia

•This has required that these countries’ NRENs negotiate better pricing with their national provider


ClaraClara

Final comments on the CLARA network

• The network will provide connectivity for R&E collaboration traffic (i.e. Internet 2 traffic) within the region and to other regions– Initially connected to GÉANT (Europe)– Expected soon to be connected via Tijuana (MX) to US networks

via Los Angeles peering point (agreement with CENIC)• this also will provide access to APAN (Pacific Rim), as well

as other connected R&E networks

• Initial backbone ring bandwidth of 155 Mbps (connecting BR-AR-CL-PA-MX)

• Initial connection to Europe at 622 Mbps from São Paulo – RNP will use 155 Mbps of access capacity initially

• CLARA network expected to be upgraded soon to support international scientific collaborations between US and South America


ClaraClaraExperimental networking in Latin America

• Advanced R&E networks provide for today’s connectivity needs of the R&E community

• In future, with the growth of this community and its needs, new solutions will need to be provided

• Such solutions are currently being developed and demonstrated in experimental networking testbeds

• NSF 2002 classification of networking testbeds (beyond Internet2)– Experimental Infrastructure Networks (EIN)

• provides stable networking infrastructure for application development and demonstration

– Networking Research Testbeds (NRT)• permits development of networking technology


ClaraClara

Some current experimental optical networking projects in Latin America

• Chile:G-REUNA - Advanced Applications Testbed

• Brazil:Project GIGA - Optical Networking and Applications Testbed

Both of these are a mixture of EIN and NRT


ClaraClara

G-REUNA (Chile) experimental network (2002-2003)

• Phase I of G-REUNA:• R&D in optical

networking and advanced applications

• IP/DWDM• govt. and telco support• 250 km network between

Santiago and Valparaiso• participation of leading

research universities and national academic network (REUNA)

• http://redesopticas.reuna.cl


ClaraClaraProject GIGA (Brazil)

Partnership between – RNP (Brazilian NREN) www.rnp.br – CPqD (telco industry R&D centre in Campinas, SP)

www.cpqd.com.br– R&D community in industry and universities

• Build an advanced networking laboratory (GIGA network) for development and demonstration purposes

• Support R&D subprojects in optical and IP networking technology and advanced applications and services

• Industry participation (telcos provide the fibres; technology transfer of products and services required)

• Government funding for 3 years - started December 2002


ClaraClaraGIGA network: objectives

• explore user control of optical fibre infrastructure– interconnect 20 academic R&D centres in S.E. Brazil– use of IP/DWDM with Ethernet framing

• provide Networking Research Testbed (NRT) for optical and IP network development

• provide Experimental Infrastructure Network (EIN) for development and demonstration of applications in several research areas

• expected to operate in April 2004.


ClaraClara

GIGA network: geographical localisation(states of São Paulo and Rio de Janeiro)

telcosUNIFESP

USP - IncorUSP -

C.Univ.

CPqDLNLS

Unicamp

LNCC

CPTEC UFF

CTAINPE

CBPFLNCC

FiocruzIME

IMPA-RNPPUC-Rio

telcosUERJUFRJ

UniversitiesIMEPUC-RioUERJUFFUFRJUnicampUNIFESPUSP

R&D CentresCBPF - physicsCPqD - telecomCPTEC - meteorologyCTA - aerospaceFiocruz - healthIMPA - mathematicsINPE - space sciencesLNCC - HPCLNLS - physics

About 600 km extension - not to scale


ClaraClaraGIGA Project: Initial design of the network

• DWDM WAN between Campinas and Rio de Janeiro• WDM MANs in Rio,

S. Paulo and Campinas• Switches between WAN

and MANs for IP packets and lambdas (under study)

• later: redundant topologyand optical switching

Campinas

São Paulo

S.J. dos Campos

C. Paulista

Rio de Janeiro

Campinas

São Paulo S. José dosCampos

Rio de Janeiro

CachoeiraPaulista

MANCP

MANSP

MANRJ

Petrópolis

Niterói


ClaraClaraSome GIGA R&D subprojects

• Networking technologies

– intelligent optical network with monitoring and control of physical parameters

• optical amplification, dispersion, equalisation, SNR, ...

– optical switching architecture

• control plane: dynamical bandwidth provisioning and mesh restoration

• provisioning end-to-end optical circuits for specific applications

– IP over WDM: unified control plane and integrated network management

• Applications:

– high performance distributed applications, including in HEP, astrophysics, meteorology, health sciences, engineering, biodiversity, etc.

– advanced multimedia applications


ClaraClaraWhat comes next in Latin America?

• For RNP and REUNA, experimental networking projects are important for two reasons:

– it provides a testbed network for R&D

– provides experience in setting up and running a “facilities-based network”, instead of one based on service offerings from telcos.

• only need the raw physical medium, or perhaps access to lambdas (wavelengths)

• perhaps the only feasible way to build and use really high capacity networks

• Next step for RNP and REUNA is to transfer this experience to their production networks

– Many well-known examples from other countries

• A logical consequence is to seek Gbps or lambda networking services for international collaboration.


ClaraClaraConclusion

• Both international cooperation (through AmPath and CLARA) and development of experimental networking have percussions:– they provide valuable opportunities for academic user

community in LA to collaborate with peer groups in other countries

– they permit the acquiring and diffusion of experience in advanced networking technologies, often absent in LA countries

– they lead to the provision of high capacity infrastructure networks for scientific cooperation


ClaraClaraAcknowledgements and references

• With thanks to many colleagues from both Europe and Latin America, too many all to be mentioned here individually. Some of the LA maps are by Florencio Utreras, from REUNA (Chile).Material on European networks provided by Cathrin Stöver from DANTE.

• ALICE website:www.dante.net/server/show/nav.009

• ALICE brochure (in English, Spanish and Portuguese):www.dante.net/alice/ALICEbrochure.pdf

• RNP and REUNA websites:www.rnp.br/enwww.reuna.cl

clara advanced networking in latin america and the clara initiative lishep 2004 rio de janeiro,...

Documents

clara michael stanton

clara initiative lishep

clara advanced networking

california slide

new cables

new infrastructure

latin america ampath

new optical cables