globus ftp evaluation test catania – 10/04/2001antonio forte – infn torino
TRANSCRIPT
Globus FTPEvaluation test
Catania – 10/04/2001 Antonio Forte – INFN Torino
Globus FTP
GlobusFTP is the Globus implementation of the GridFTP Protocol.
The GridFTP protocol is a superset of a GSI-enabled FTP protocol.
Catania – 10/04/2001 Antonio Forte – INFN Torino
Globus FTP Features• A high throughput, reliable, secure and robust data transfer mechanism
• GSSAPI security (PKI and Kerberos) support
• Automatic negotiation of TPC buffer/window sizes
• Parallel data transfer
• Third-party control of data transfer
• Partial file transfer
• Reliable data transfer
• Replica catalogs mechanisms
Catania – 10/04/2001 Antonio Forte – INFN Torino
Globus FTP ImplementationGlobus Data Grid Alpha Release 2:a particular version of Globus containing a set of production libraries and tools that allow the use of GridFTP protocol.
GSI WUFTP v0.4b5:a modified version of the wu-ftpd server, enhanced with GridFTP's security plus the GridFTP partial file transfer and parallel transfer capabilities.
GSI NCFTP v0.3:a modified version of the ncftp client tools, enhanced with GridFTP's GSI-based security.
Catania – 10/04/2001 Antonio Forte – INFN Torino
Test INFN sites and resources
INFN CNAF Pentium II 400MHz WAN link 12Mbps
INFN PADOVA Pentium III 450MHz WAN link 16Mbps
INFN NAPOLI Pentium 200MHz WAN link 8Mbps
INFN TORINO Pentium Pro 200MHz WAN link 12Mbps
Catania – 10/04/2001 Antonio Forte – INFN Torino
Test layout
Catania – 10/04/2001 Antonio Forte – INFN Torino
Tests
BASELINE MEASUREMENTROUND TRIP TIME (RTT)• Measurement of RTT with 500 icmp packets
THROUGHPUT WITH STANDARD FTP (GET and PUT)• Variable file size (1, 10, 50, 100, 500 MB)
TESTS WITH GSIFTP PROTOCOL (using globus-url-copy command)
COMPARISON BETWEEN STANDARD GSI FTP AND PARALLEL GSI FTP (GET and PUT)• streams (1, 2, 4, 8, 16, 32, 64), fixed file size (100MB)• streams (1, 2, 4, 8, 16, 32, 64), fixed file size (500MB)• fixed streams (8), variable file size (1, 10, 50, 100, 500 MB)
Catania – 10/04/2001 Antonio Forte – INFN Torino
Tests
EVALUATION OF GSIFTP PERFORMANCES VARING TCP BUFFER SIZE (GET and PUT)(Parameter: -tcp-bs buffer-size) • fixed streams (1), variable TCP buffer size (4, 8, 16, 32, 64, 128,
256 KB)• fixed streams (8), variable TCP buffer size (4, 8, 16, 32, 64, 128,
256 KB)
EVALUATION OF GSIFTP PERFORMANCES VARING BLOCK SIZE (GET and PUT)(Parameter: -bs block size) • fixed streams (1), variable block size (4, 8, 16, 32, 64, 128, 256 KB)• fixed streams (8), variable block size (4, 8, 16, 32, 64, 128, 256 KB)
Catania – 10/04/2001 Antonio Forte – INFN Torino
Results
min/avg/max globus-url-copy with variable parallel streamsData path: Torino-Padova - fixed file size 100 MB
4000
5000
6000
7000
8000
9000
10000
11000
12000
1 2 4 8 16 32 64
parallel streams
tran
sfe
r ra
te (
kb
ps)
PUT
GET
• asymmetrical throughput in different directions• throughput increases for up to 16 streams and then keeps constant or, alternatively, decreases
COMPARISON BETWEEN STANDARD GSI FTP AND PARALLEL GSI FTP (GET and PUT)
Catania – 10/04/2001 Antonio Forte – INFN Torino
ResultsWAN Link statistics
• the asymmetrical throughput depends on the different data path
INFN Padova – Link 16 Mbps
Saturation with 500 MB file sizeINFN Torino – Link 12 Mbps
Catania – 10/04/2001 Antonio Forte – INFN Torino
Results
• asymmetrical throughput in different directions• throughput increases for up to 8 streams, then decreases
COMPARISON BETWEEN STANDARD GSI FTP AND PARALLEL GSI FTP (GET and PUT)
min/avg/max globus-url-copy with variable parallel streamsData path: Torino-Napoli - fixed file size 100 MB
4000
4500
5000
5500
6000
6500
7000
7500
1 2 4 8 16 32 64
parallel streams
tra
ns
fer
rate
(k
bp
s)
PUT
GET
Catania – 10/04/2001 Antonio Forte – INFN Torino
Results
• no significative throughput for 1 MB file size• throughput slighty decreases for transfer of very large files (500 MB)
COMPARISON BETWEEN STANDARD GSI FTP AND PARALLEL GSI FTP (GET and PUT)
min/avg/max globus-url-copy with variable file sizeData path: Napoli-Torino - 8 fixed parallel streams
4000
4500
5000
5500
6000
6500
7000
7500
1 10 50 100 500
file size (MB)
tra
ns
fer r
ate
(k
bp
s)
PUT
GET
Catania – 10/04/2001 Antonio Forte – INFN Torino
Results
• Optimal TCP buffer size is 32 KB
EVALUATION OF GSIFTP PERFORMANCES VARING TCP BUFFER SIZE (GET and PUT)
min/avg/max globus-url-copy with variable tcp buffer sizeData path: Torino-Napoli - fixed 100MB file size
and 1 fixed stream
0
1000
2000
3000
4000
5000
6000
7000
8000
tcp-bs (byte)
tra
ns
fer
rate
(k
bp
s)
PUT
GET
Catania – 10/04/2001 Antonio Forte – INFN Torino
Results
• Optimal TCP buffer size is 32 KB• Similar results in symmetrical tests (TO-NA, NA-TO)
EVALUATION OF GSIFTP PERFORMANCES VARING TCP BUFFER SIZE (GET and PUT)
min/avg/max globus-url-copy with variable tcp buffer sizeData path: Napoli-Torino - fixed 100MB file size
and 1 fixed stream
0
1000
2000
3000
4000
5000
6000
7000
8000
tcp-bs (byte)
tran
sfe
r ra
te (
kb
ps)
PUT
GET
Catania – 10/04/2001 Antonio Forte – INFN Torino
Results
• No influence on the performance with 8 parallel streams
EVALUATION OF GSIFTP PERFORMANCES VARING TCP BUFFER SIZE (GET and PUT)
min/avg/max globus-url-copy with variable tcp buffer sizeData path: Torino-Napoli - fixed 100MB file size
and 8 fixed parallel streams
4000
4500
5000
5500
6000
6500
7000
7500
tcp-bs (byte)
tran
sfe
r ra
te (
kb
ps)
PUT
GET
Catania – 10/04/2001 Antonio Forte – INFN Torino
Results
• No influence on the performance (no CPU bottleneck)
EVALUATION OF GSIFTP PERFORMANCES VARING BLOCK SIZE (GET and PUT)
min/avg/max globus-url-copy with variable block sizeData path: Napoli-Torino - fixed 100MB file size
and 1 fixed stream
4000
4500
5000
5500
6000
6500
7000
7500
block size (byte)
tran
sfe
r ra
te (
kb
ps)
PUT
GET
Catania – 10/04/2001 Antonio Forte – INFN Torino
ResultsEVALUATION OF GSIFTP PERFORMANCES VARING BLOCK SIZE (GET and PUT)
min/avg/max globus-url-copy with variable block sizeData path: Napoli-Torino - fixed 100MB file size
and 8 fixed parallel streams
4000
4500
5000
5500
6000
6500
7000
7500
block size (byte)
tran
sfe
r ra
te (
kb
ps)
PUT
GET
• No influence …
Catania – 10/04/2001 Antonio Forte – INFN Torino
Advantages
Catania – 10/04/2001 Antonio Forte – INFN Torino
• No further authentication required (only grid-proxy-init needed)
• Throughput increases with parallel streams
• Third-party control of data transfer is possible
• Partial and realible transfer works fine with GSI FTP client (GSINCFTP)
Troubles• No stable release (very frequently updated, we used the
version downloaded on the 9th Jan 2001)
• System crash with globus-url-copy, 64 streams and 500 MB of data
• Network interface sometimes in down state after parallel transfers of large files (500 MB) which frequently freeze; problems encountered with 16 streams between CNAF and Padova, with 32 or 64 streams between Torino and Napoli. These problems probably depend on bugs in the Linux kernel (we used 2.2.12)
• Production WAN links negatively influenced the tests: dedicated links need!!!
Catania – 10/04/2001 Antonio Forte – INFN Torino
Latest release
Globus Data Grid Alpha Release 3 released on the 26th March 2001 (annunced by Lee Liming) not tested yet!!!
Available at the following URL:http://www.globus.org/gsiftp-alpha/release-alpha3.html
Catania – 10/04/2001 Antonio Forte – INFN Torino
Available at theWorkPackage 5 (Network) - INFN GRID Project homepage:
http://www.infn.it/netgrid
More info
Catania – 10/04/2001 Antonio Forte – INFN Torino