there are 6 research councils in total: epsrc – engineering and physical sciences research council...
TRANSCRIPT
There are 6 Research Councils in total:
EPSRC – Engineering and Physical Sciences Research Council
NERC – Natural Environment Research Council
PPARC – Particle Physics and Astronomy Research Council
BBSRC – Biotechnology and Biological Science Research Council
ESRC – Economic and Social Research Council
MRC – Medical Research Council
And:
CCLRC – Council for the Central Laboratory of the Research Councils
Funding Sources for Academic Research
Nearly all academic research in the UK is funded by the government through Research Councils.
The UK e-Science Programme
Kerstin Kleese van Dam
(For Tony Hey
Director of UK e-Science Core Programme
e-Science and the Grid
‘e-Science is about global collaboration in key areas of science, and the next generation of infrastructure that will enable it.’
John Taylor Director General of Research Councils Office of Science and Technology
GRID Vision
Computing resources
Data
Knowledge
Instruments
PeopleSolution
Complex problem
GRID
The Grid as an Enabler for Virtual Organisations
Ian Foster, Carl Kesselman and Steve Tueke• ‘The Grid is a software infrastructure that
enables flexible, secure, coordinated resource sharing among dynamic collections of individuals, institutions and resources’
• - includes computational systems and data storage resources and specialized facilities
• Enabling infrastructure for transient ‘Virtual Organisations’
UK e-Science Initiative: First Phase • £120M Programme over 3 years from April 2001
• £75M is for Grid Applications in all areas of science and engineering
• £10M as first installment for UK HPC(X)
• £35M ‘Core Program’ to encourage development of generic ‘industrial strength’ Grid middleware
Require £20M additional ‘matching’ funds from industry
Collaborative projects
Director’s Management Role
Director’sAwareness and Co-ordination Role
Generic Challenges EPsrc (£15M), DTI (£20M)
Industrial Collaboration (£20M)
Pilot ApplicationProgramme
PPARC (£26M) BBsrc (£8M) MRC (£8M) NERC (£7M) Esrc (£3M) EPsrc (£17M) CLRC (£5M)
Research Councils (£74M)
UK e-Science Programme TechnicalAdvisory
Group
UK e-Science Management
e-Science Steering Committee
Research Councils e-Science Directors
Relevant National/ International bodies:
e.g. JISC, CERN
e-Science Support Based at EPsrc
and at DTI
Core Programme Project Teams
Technical AdvisoryGroup
Directore-Science Core
Programme
DGRC/CERCs CEO/EPsrc
Excerpt from e-Science CP Director’s job objectives
‘Develop effective collaborative Core Programme projects between the science base, industry and national funding agencies, and ensure the application and outcomes from the projects.’
UK e-Science Projects£75M for e-Science Grid Application ‘pilots’
- spanning all sciences and engineering
Particle Physics and Astronomy (PPARC)- £17M GridPP and £5M AstroGrid
Engineering and Physical Sciences (EPSRC)- funding 6 projects at around £3M each
Biology, Medical and Environmental Science- funding projects with total value of £23M
UK Grid Projects: First Phase (1)Particle Physics and Astronomy (PPARC)• GRIDPP • ASTROGRID
Engineering and Physical Sciences (EPsrc)• Comb-e-Chem • DiscoveryNet • GEODISE • myGrid • RealityGrid
Comb-e-Chem Project
X-Raye-Lab
Analysis
Properties
Propertiese-Lab
SimulationVideo
Diff
ract
omet
er
Grid Middleware
StructuresDatabase
APPLICATION SERVICE
PROVIDERCOMPUTATION
GEODISE PORTAL
OPTIMISATION
Engineer
Parallel machinesClusters
Internet Resource ProvidersPay-per-use
Optimisation archive
Intelligent Application Manager
Intelligent Resource Provider
Licenses and code
Session database
Design archive
OPTIONSSystem
Knowledge repository
Traceability
Visualization
Globus, Condor, SRB
Ontology for Engineering,
Computation, &Optimisation and
Design Search
CAD SystemCADDSIDEASProE
CATIA, ICAD
AnalysisCFDFEMCEM
ReliabilitySecurity
QoS
GEODISE Project
Computational science
• Molecular dynamics
• Mesoscale modelling
• High throughput experiments
• High performance visualization
• Computational steering
• Terascale parallel computing
myGrid Project
• Imminent ‘deluge’ of data
• Highly heterogeneous• Highly complex and
inter-related• Convergence of data
and literature archives
Using Distributed Resources
ScientificInformationScientific
InformationScientific Discovery
In Real Time
LiteratureLiterature
DatabasesDatabases
OperationalData
OperationalData
ImagesImages
InstrumentData
InstrumentData
Discovery Net Project
Real Time Integration
Dynamic ApplicationIntegration
Workflow Construction
Interactive Visual Analysis
Nucleotide Annotation Workflows
How It Works
Download sequence
from Reference
Server
Save to Distributed Annotation
Server
InteractiveEditor &
Visualisation
Execute distributed annotation workflow
NCBIEMBL
TIGR SNP
InterPro
SMART
SWISSPROT
GO
KEGG
1800 clicks 500 Web access200 copy/paste 3 weeks work in 1 workflow and few second execution
UK Grid Projects: First Phase (2)
Natural Environment Applications (NERC)• Climateprediction.com • Oceanographic Grid • Molecular Environmental Grid • NERC DataGrid (with CP)
Biotechnology and Biological Sciences (BBsrc)• Biomolecular Grid • Proteome Annotation Pipeline • High-Throughput Structural Biology • Global Biodiversity
BioSim GRID
Structure of the proposed biosimulation database
1st Level Metadata – Describing the Simulation Data…
2nd Level Metadata – Describing the Results of Generic Analyses…
…
distributed ‘raw’ data
York
Nottingham
Birmingham
OxfordRAL
Southampton
London
A biosimulation GRID for the UK
Integrating Different Levels of Simulation
An e-science challenge – non-trivial
NASA IPG as a possible paradigm
Need to integrate rigorously if to deliver accurate & hence biomedically useful results
Noble (2002) Nature Rev. Mol. Cell.Biol. 3:460
Sansom et al. (2000) Trends Biochem. Sci. 25:368
molecular
cellular
organism
UK Grid Projects: First Phase (3)
Medical Applications (MRC)
• Biology of Ageing (with BBsrc)
• Sequence and Structure Data
• Molecular Genetics
• Cancer Management (with PPARC)
• Clinical e-Science Framework
• Neuroinformatics Modeling Tools
CLEF - Clinical e-Science Framework
Partners:
• AstraZeneca, GSK, BMJ Publishing Group • CSW Informatics, iSoft plc, Sun Microsystems Limited • UK National Health Service
– NHS Information Authority Stakeholder Relations
– Camden & Islington Health Authority
– Central Manchester and Manchester Childrens' Health Authority
– Royal Brompton and Harefield NHS Trust
• Universities of Cambridge, Manchester, Freiburg and University College London
• High quality, integrated clinical information is key to:
– clinical research
– evidence-based health care
– the clinical application of genetic and genomic research
• Capture, integration, and presentation of descriptive information is a major barrier to achieving an integrated framework
• Data includes:– clinical histories
– radiology and pathology reports
– annotations on genomic and image databases
– technical literature and Web based resources
CLEF - Integrating information
e-Science and Grid Middleware
‘e-Science is about global collaboration in key areas of science, and the next generation of infrastructure that will enable it.’
John Taylor
Requirements of e-Science Grid Application Projects determine services required by Grid middleware
UK Projects focus more on Grid Data Services than Teraflop/s HPC systems
e-Science Core Program: First Phase
£15M OST + £20M DTI + £20M Industry
1. Network of e-Science Centres UK e-Science Grid
2. Support for e-Science Applications3. Grid Network Issues4. Generic/Industrial Grid Middleware5. e-Health Grid ‘Grand Challenges’ 6. Outreach/International Activities
Cambridge
Newcastle
Edinburgh
Oxford
Glasgow
Manchester
Cardiff
Southampton
London
BelfastDL
RAL Hinxton
UK e-Science Grid
UK e-Science Grid • All e-Science Centres donating resources plus four
dedicated compute/data clusters– Supercomputers, clusters, storage, facilities
• All Centres run same Grid Software– Starting point is Globus 2 and Condor: Storage
Resource Broker (SRB) • Standard Grid middleware supported
– e-Science Grid now at ‘Level 2’: moving towards production Grid with real users
Access Grid – Group Conferencing
Multi-site group-to-group conferencing system
Continuous audio and video contact with all participants
Globally deployed
All UK e-Science Centres have AG rooms
Widely used for technical and management meetings
Support for e-Science Projects• Grid Support Centre in operation
– supported Grid middleware & users– see www.grid-support.ac.uk
• National e-Science Institute – Research Seminars– Training Programme – See www.nesc.ac.uk
• National Certificate Authority– Issue digital certificates for projects– Goal is ‘single sign-on'
Anatomy of a Digital Certificate
ABCDEFGHIJKLMNOPQRSTUV
Signature from CA’s private key
Validity Data
Public Key
A text string
Extensions
How a certificate is issued
• The Registration Authority (RA) approves a request for a certificate. The RA is local to the users.• The CA then issues the corresponding certificate.
How does it work?
1. Scientist wishes to access a resource, so he sends a copy of the certificate to the resource
2. Resource says: prove it’s yourcertificate
3. Scientist proves that he has the corresponding private key4. Resource is convinced thatscientist is who he claims to be and decides to give him access
Private Key
Challenge
Response
UK CA Statistics, February 2003
• 250 valid certificates issued
• 24 RAs (more waiting for approval/training etc)
• Issuing 60 certificates /month
• Adding 3 RAs / month
• Adding 6 RA operators /month
• UK certificates recognized by EU and US projects
Grid Network Team• Expert group to identify end-to-end network
bottlenecks and other network issues
- e.g. problems with multicast for Access Grid
• Identify e-Science project requirements
• Funding (with PPARC and EPSRC) a number of network QoS, scheduling and monitoring projects
• ‘UKLight’ lambda connection to Chicago and Amsterdam now approved
UK Backbone Infrastructure
• Based on SuperJANET4 academic network run by UKERNA for JISC
• WorldCom(!) providing national backbone for SJ4 – now at 20Gbps
• Connections to universities via MANs at up to 2.5Gbps
• ‘Last mile’ problem?
• Research network use versus teaching, web-searching, email – differential services?
SuperJANET4
One source sending same data to 3 receivers only has to have one copy of data (more copies are made only when necessary)
Multicast
Access Grid
Networking Research Projects
Network Infrastructure
GRS, GRID resource management
MB-NG, QoS Features
GRIDprobe, backbone passive monitoring at 10Gbps
‘FutureGRID, P2P architecture
GridMcast, Multicast-enabled data distribution
GRID Infrastructure
Service Infrastructure
CP Collaborative Industrial Projects: First Phase
• 9 Centres with ring-fenced allocations
• £11M CP + £11M Industry funding
• £5M Open Call Projects
• All First Phase funds now committed
• Over 60 Companies involved
CP Centre Projects
6 projects CeSC, 4 OeSC 5 NEReSC 4 NeSC), 5 SeSC 2 LeSC5 WeSC7 eSNW5 BeSCTotal of 43 projects
68 different companiesRange of disciplines (IT, Engineering, Pharma, Environmental etc)New sectors engaged (broadcasting, defence, banking etc)Industrial Funds more than match DTI fundsAll Centres have spent money allocated or have projects under consideration
CP Open Call Projects
Visualization Middleware for e-Sciencee-Science Technologies in the Simulation of Complex MaterialsPerformance-based Middleware for Grid ComputingA scalable monitoring platform for the GRID (GridProbe)eDiamond distributed mammographic archiveEnd-to-End traffic management servicesInformation eXtraction from Images (IXI)Deductive Synthesis Techniques to the Rapid Assembly of Grid ApplicationsTrustworthy GRID Resource ManagementA Grid-based approach to the validation and testing of lubrication modelsSelf-Organising GRID Resource ManagementJigsaw: Distributed and dynamic visualisation generationFutureGRID: a program for long-term research into GRID systems architecture Total of 13 projects
OGSA – DAI Project
• Design Specification completed– Papers for GGF WG on Database Access and
Integration Services• Three Prototypes delivered:
– Distributed Query Service– XML Database Interface– Relational Database Interface
• Alpha versions delivered January 2003– Integrate with Globus GT3
Open Grid Services Architecture • Development of Web Services• OGSA will provide
Naming /Authorization / Security / Privacy/… Projects looking at higher level services: Workflow,
Transactions, DataMining, Knowledge Discovery… Exploit Synergy: Commercial Internet
with Grid Services
• Equator: Technological innovation in physical and digital life
• AKT: Advanced Knowledge Technologies
• DIRC: Dependability of Computer-Based Systems
• MIAS: From Medical Images and Signals to Clinical Information
IRC ‘Grand Challenge’ Projects
e-Health Grid ‘Grand Challenges’ • Grid-Enabled Knowledge Services for Medical
Informatics
- Triple Assessment in Breast Cancer:
Clinical, Radiological and Cytological data fusion
• Grid-based Medical Devices for Everyday Health
- Patient sensors, mobile wireless communication
• eDiamond Digital Mammography
- Normalized archive of mammograms
- Oxford, IBM (£2M), Mirada and Hospitals
Mammograms have different appearances, depending on image settings and acquisition systems
SMF is a normalised representation independent of scanner settings
eDiamond
eDiamond Applications of SMF
Training and Differential Diagnosis “Find one like it”
Teleradiology and QC VirtualMammo
Epidemiology SMFcomputed breast density
?
Advanced CAD SMF-CAD workstation
International Involvement
• Funding UK participation in the Global Grid Forum Research/Working Groups
• Funding for International CS ‘Grid Fellowships’– CERN DataGrid and USA iVDGL
• International members on TAG• Participation in EU FP5 Grid Activities
– e.g. EU DataGrid and DataTAG projects • Development of FP6 Grid Projects
– First call closes April/May– EGEE, EU Open Middleware Infrastructure Institute?
e-Science Demonstrators
• Dynamic Brain Atlas• Biodiversity• Chemical Structures• Mouse Genes• Robotic Astronomy• Collaborative Visualisation • Climateprediction.com• Medical Imaging/VR• Seamless Access to Multiple Databases
UK e-Science Funding
First Phase: 2001 –2004• Application Projects
– £74M– All areas of science
and engineering• Core Programme
– £35M– Collaborative
industrial projects
Second Phase: 2003 –2006• Application Projects
– £96M– All areas of science and
engineering• Core Programme
– £16M + £25M (?)– Core Grid Middleware
Core Programme 2
Overall Rationale: Four major functions of CP
– Assist development of essential, well-engineered, generic, Grid middleware usable by both e-scientists and industry
– Provide necessary infrastructure support for UK e-Science Research Council projects
– Collaborate with the international e-Science and Grid communities
– Work with UK industry to develop industrial-strength Grid middleware
Core Programme 2
6 Key Activities for Second Phase
1. UK e-Science Grid/Centres and e-Science Institute
2. Grid Support Centre and Network Monitoring
3. Core Middleware engineering
4. National Data Curation Centre
5. e-Science Exemplars/New Opportunities
6. Outreach and International involvement
Core Grid Middleware
• Need to develop open source, open standard compliant, Grid Middleware stack that will integrate and federate with industrial solutions
• Software Engineering focus as well as R&D
Aim is to produce robust, well-documented, re-usable software that is maintainable and can evolve to embrace emerging Grid Service standards
Major focus of Core Programme 2
National Data Curation Centre
• In next 5 years e-Science projects will produce more scientific data than has been collected in the whole of human history
• In 20 years can guarantee that the operating and spreadsheet program and the hardware used to store data will not exist
Need to research and develop technologies and best practice for curating digital data
Need to liaise closely with individual research communities and data archive centres
DIRECTORCORE PROGRAMME National
CentreProgramme
EPsrc/DTIFinance
Grid Network
Team
e-ScienceSteering
CommitteeCCLRCProjects
GridSupportTeam
Director GeneralOST
e-ScienceOperations Committee
Research CouncilPilots
HPCCentres
4 IRC+Projects
Open Call Projects
9 GridDemos
ReportsInternational
Deputy DirectorTechnical Advisory
Group
Information
International
DirectorCore Programme National
Centre
e-ScienceInstitute
Data BaseTaskforce
ArchitectureTaskforce
8 RegionalCentres
SecurityTaskforceUKERNA
EPsrc/DTIFinance
Grid Network
Team
Global Grid Forum
e-ScienceSteering
CommitteeCCLRCProjects
NERCPilots
GridSupportTeam
Dir GenOST
e-ScienceOperations Committee
EsrcPilots
MRCPilots
BBsrcPilots
PPARCPilots
EPsrcPilots
HPCCentres
CERN
OtherInternational
Projects
EUFramework
Projects
USPlayers
4 IRCs5 Projects
GridUSERS
ICTSuppliers
JISC
Open Call Projects
SR2002Bid
9 GridDemos
DTIOutreach
Reports
Hinxton
NetworkMonitoring
Gridnet
NHSNet
GridFellowships
Publicity
Keyworth
GEANT
£20M of50 Projects
CCLRCRAL & DL
Web sites
Deputy DirectorTechnical Advisory
Group
“HEFCE”
4 IRCs5 Projects
GridUSERS
ICTSuppliers
Open Call Projects
Data BaseTaskforce
ArchitectureTaskforce
SecurityTaskforceUKERNA
Grid Network
Team
JISC
Reports
NetworkMonitoringGlobal Grid
Forum
NationalCentre
e-ScienceInstitute8 Regional
Centres£20M of
50 Projects
CCLRCProjects
NERCPilots
GridSupportTeam
EsrcPilots
MRCPilots
BBsrcPilots
PPARCPilots
EPsrcPilots
CERN
EUFramework
Projects
USPlayers
GridnetGrid
Fellowships
GEANTInternational
CCLRCRAL & DL
9 GridDemos
DTIOutreach
Publicity
Web sites
Information
OtherInternational
Projects
Information
International
DirectorCore Programme National
Centre
e-ScienceInstitute
Data BaseTaskforce
ArchitectureTaskforce
8 RegionalCentres
SecurityTaskforceUKERNA
EPsrc/DTIFinance
Grid Network
Team
Global Grid Forum
e-ScienceSteering
CommitteeCCLRCProjects
NERCPilots
GridSupportTeam
Dir GenOST
e-ScienceOperations Committee
EsrcPilots
MRCPilots
BBsrcPilots
PPARCPilots
EPsrcPilots
HPCCentres
CERN
OtherInternational
Projects
EUFramework
Projects
USPlayers
4 IRCs5 Projects
GridUSERS
ICTSuppliers
JISC
Open Call Projects
SR2002Bid
9 GridDemos
DTIOutreach
Reports
Hinxton
NetworkMonitoring
Gridnet
NHSNet
GridFellowships
Publicity
Keyworth
GEANT
£20M of50 Projects
CCLRCRAL & DL
Web sites
Deputy DirectorTechnical Advisory
Group
“HEFCE”
Industry& Commerce
IBMMicrosoftSunLogicaSGIBAE SystemsRolls RoyceWelcomeCompaqOraclePlatformAvakiEntropiaHPABBBayerIntelPfizerNAGAvantiumGSK
QinetiqData Systs RocheBMTCCDCFujitsuMet OfficeCFS ConsBPPallasAVSRTZEpistemicsFluentBNFLDelta DotRVCO ltdInfosenseMerckAstraZenecaUnilever
Technical Advisory Group
Information
International
DirectorCore Programme National
Centre
e-ScienceInstitute
Data BaseTaskforce
ArchitectureTaskforce
8 RegionalCentres
SecurityTaskforceUKERNA
EPsrc/DTIFinance
Grid Network
Team
Global Grid Forum
e-ScienceSteering
CommitteeCCLRCProjects
NERCPilots
GridSupportTeam
Dir GenOST
e-ScienceOperations Committee
EsrcPilots
MRCPilots
BBsrcPilots
PPARCPilots
EPsrcPilots
HPCCentres
CERN
OtherInternational
Projects
EUFramework
Projects
USPlayers
4 IRCs5 Projects
GridUSERS
ICTSuppliers
JISC
Open Call Projects
SR2002Bid
9 GridDemos
DTIOutreach
Reports
Hinxton
NetworkMonitoring
Gridnet
NHSNet
GridFellowships
Publicity
Keyworth
GEANT
£20M of50 Projects
CCLRCRAL & DL
Web sites
Deputy DirectorTechnical Advisory
Group
“HEFCE”
Industry& Commerce
IBMMicrosoftSunLogicaSGIBAE SystemsRolls RoyceWelcomeCompaqOraclePlatformAvakiEntropiaHPABBBayerIntelPfizerNAGAvantiumGSK
QinetiqData Systs RocheBMTCCDCFujitsuMet OfficeCFS ConsBPPallasAVSRTZEpistemicsFluentBNFLDelta DotRVCO ltdInfosenseMerckAstraZenecaUnilever
Technical Advisory Group
IBM
Information
International
DirectorCore Programme National
Centre
e-ScienceInstitute
Data BaseTaskforce
ArchitectureTaskforce
8 RegionalCentres
SecurityTaskforceUKERNA
EPsrc/DTIFinance
Grid Network
Team
Global Grid Forum
e-ScienceSteering
CommitteeCCLRCProjects
NERCPilots
GridSupportTeam
Dir GenOST
e-ScienceOperations Committee
EsrcPilots
MRCPilots
BBsrcPilots
PPARCPilots
EPsrcPilots
HPCCentres
CERN
OtherInternational
Projects
EUFramework
Projects
USPlayers
4 IRCs5 Projects
GridUSERS
ICTSuppliers
JISC
Open Call Projects
SR2002Bid
9 GridDemos
DTIOutreach
Reports
Hinxton
NetworkMonitoring
Gridnet
NHSNet
GridFellowships
Publicity
Keyworth
GEANT
£20M of50 Projects
CCLRCRAL & DL
Web sites
Deputy DirectorTechnical Advisory
Group
“HEFCE”
International
USAFranceGermanyBrazilHollandJapanChinaItalyScandinaviaAustraliaSwitzerlandAustriaSingaporeBelgiumCanadaIrelandPolandSpainSouth- America
Information
International
DirectorCore Programme National
Centre
e-ScienceInstitute
Data BaseTaskforce
ArchitectureTaskforce
8 RegionalCentres
SecurityTaskforceUKERNA
EPsrc/DTIFinance
Grid Network
Team
Global Grid Forum
e-ScienceSteering
CommitteeCCLRCProjects
NERCPilots
GridSupportTeam
Dir GenOST
e-ScienceOperations Committee
EsrcPilots
MRCPilots
BBsrcPilots
PPARCPilots
EPsrcPilots
HPCCentres
CERN
OtherInternational
Projects
EUFramework
Projects
USPlayers
4 IRCs5 Projects
GridUSERS
ICTSuppliers
JISC
Open Call Projects
SR2002Bid
9 GridDemos
DTIOutreach
Reports
Hinxton
NetworkMonitoring
Gridnet
NHSNet
GridFellowships
Publicity
Keyworth
GEANT
£20M of50 Projects
CCLRCRAL & DL
Web sites
Deputy DirectorTechnical Advisory
Group
“HEFCE”
A viable Core Programme must have this scope and
an infrastructure to support it!
e-Science and the Grid
‘e-Science will change the dynamic of the way science is undertaken.’
John Taylor, 2001
Need to convince university IT Directors!
e-Government and the Grid
‘[The Grid] intends to make access to computing power, scientific data repositories and experimental facilities as easy as the Web makes access to information.’
Tony Blair, 2002