web infrastructure team
DESCRIPTION
Web Infrastructure Team. Our Services and our Hardware Owen Le Blanc. Outline. Services we provide Hardware we manage Virtual machines Software Managing it all. AFS Xen External Hosting Virtual Hosts Minor services Development. Summary of Services. Web services Portal service - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/1.jpg)
Web Infrastructure Team
Our Services and our Hardware
Owen Le Blanc
![Page 2: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/2.jpg)
Outline
Services we provide Hardware we manage Virtual machines Software Managing it all
![Page 3: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/3.jpg)
Summary of Services
Web services Portal service Information Publication Load balancing Databases
AFS Xen External Hosting Virtual Hosts Minor services Development
![Page 4: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/4.jpg)
Web Services
Apache Software ESD Tomcat Content
Managemt User admin (ssl)
20 servers 2 servers 3 servers? 3 servers
+ devel + test
1 server
![Page 5: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/5.jpg)
Portal service
Web servers Development Mysql
8 servers 9 servers 2 servers
![Page 6: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/6.jpg)
Information Services
Anonymous FTP rsync ntp Request Tracker Web Log
processing, anal
1 server 2 servers 1 server 2 servers 2 servers
![Page 7: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/7.jpg)
Publication Services
ssh sftp
ftp
3 servers
2 servers
![Page 8: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/8.jpg)
Load Balancing
ipvsadm heartbeat,
pacemaker ssh
2 servers
![Page 9: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/9.jpg)
Databases, etc
MySQL Postgres Subversion CVS
9 servers 2 servers 3 servers 1 server
![Page 10: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/10.jpg)
Andrews File System
Kerberos servers Database servers
File servers special file servers
Backup servers
3 servers 12 servers
2 servers
2 servers
![Page 11: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/11.jpg)
![Page 12: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/12.jpg)
Xen
Xen hosts (ours) Portal EPS Manc City Art G
49 machines 4 machines 2 machines 1 machine
![Page 13: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/13.jpg)
External Servers (1)
Ensembl Phoenix Access Grid
Recording service NCESS EMU
2 servers 1 server 1 server
1 server 1 server
![Page 14: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/14.jpg)
External Servers (2)
MACE Azura Group EPS Intranet Equella project Genetic Research
Museum java devel
1 server 3? servers 6 servers 2 servers 1 server 1 server
![Page 15: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/15.jpg)
Virtual Hosts
Email development
Physics web site Status web site
1 servers 1 server 2 servers
![Page 16: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/16.jpg)
Minor Services
AFS mail Web Farm mail tftp administration cron jobs mirroring
1 server 1 server 1 server 1 server 1 server 1 server
![Page 17: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/17.jpg)
Development
Compilation Testing
AFS Java MySQL Xen IPVS/Heartbeat
4 servers
3 servers 2 servers 1 server 2 servers 2 servers
![Page 18: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/18.jpg)
Machines
Development Xen servers Other servers Portal servers External (!xen) Total
11 49 16 5 18 99 machines
![Page 19: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/19.jpg)
Virtual Hosts
151 virtual hosts under Xen: 1 fully virtualised
![Page 20: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/20.jpg)
Disk Format (Xen, standalone)
unmounted partition
/
/var
swap
LVM
![Page 21: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/21.jpg)
Software
Debian lenny,squeeze ipvsadm, heartbeat, pacemaker Xen, LVM OpenAFS Closely parallel machines Rapid deployment “Daily” security patching
![Page 22: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/22.jpg)
Documentation (1)
Mirrors of package documents http://orgs.man.ac.uk/documentation/
Wiki http://wiki.manchester.ac.uk/websupport/
My web site http://people.man.ac.uk/~zlsiial/docs/
Software and configuration area /afs/mcc.ac.gb/common/config/
![Page 23: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/23.jpg)
Documentation (2)
System backup area /afs/mcc.ac.gb/ftp/.private/misc/backups/
admin folder .../web/farm/Admin/
Email various places in /afs/
![Page 24: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/24.jpg)
Documentation (2)
System backup area /afs/mcc.ac.gb/ftp/.private/misc/backups/
admin folder .../web/farm/Admin/
Email various places in /afs/
![Page 25: Web Infrastructure Team](https://reader030.vdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/25.jpg)
Managing It All
Database of machines Automate as much as possible Use standard versions
As little local compilation as possible As little locally written software as possible
Revise and rethink