gis enterprise architecture danny luong division of technology services enterprise gis manager...
TRANSCRIPT
GIS Enterprise ArchitectureGIS Enterprise Architecture
Danny Luong
Division of Technology Services
Enterprise GIS Manager November 19, 2009
California Department of Water Resources
22
Enterprise GIS Technology & Trends:Enterprise GIS Technology & Trends:
Server Virtualization w/ Blade Technology & Benefits (VMWare Server Virtualization w/ Blade Technology & Benefits (VMWare ESX)ESX)
VDI (Virtual Desktop Infrastructure) VDI (Virtual Desktop Infrastructure)
Clustering (Hardware, EMC SAN Storage, memory, etc) as Clustering (Hardware, EMC SAN Storage, memory, etc) as neededneeded
Service Oriented Architecture (SOA) & Identity ManagementService Oriented Architecture (SOA) & Identity Management
Active Directory/LDAP/Virtual Directory user authenticationActive Directory/LDAP/Virtual Directory user authentication
VMWare High-Availability/Fault-Tolerant VMWare High-Availability/Fault-Tolerant
Load Balancing Load Balancing
Client Web Interface (Flex, Silver Light, Java Script APIs) orClient Web Interface (Flex, Silver Light, Java Script APIs) or Web ADF (Java or .NET)Web ADF (Java or .NET)
3 Day Design Workshop / User Requirements:3 Day Design Workshop / User Requirements:
We anticipate approximately:We anticipate approximately:
• 100 internal users accessing our ArcGIS Server, Image 100 internal users accessing our ArcGIS Server, Image Server, SDE/Oracle 11g using ArcGIS Desktop 9.3, Third Server, SDE/Oracle 11g using ArcGIS Desktop 9.3, Third party (Microstation, Autocad, etc)party (Microstation, Autocad, etc)
• 50 external users using Mobile devices (Trimble Unit) & 50 external users using Mobile devices (Trimble Unit) & Customized Web InterfaceCustomized Web Interface
• 10 external users authenticating to internal network10 external users authenticating to internal network
• Estimated Growth in 2010 and 2011Estimated Growth in 2010 and 2011– Desktop (25%) and Web (40%)Desktop (25%) and Web (40%)
33
Geodatabase Design StrategyGeodatabase Design Strategy
• Versioning? Versioning? YesYes
• Vector? Vector? YesYes
• Raster? Raster? Yes, including Image ServiceYes, including Image Service
• Multiple or Single Geodatabase(s)? Multiple or Single Geodatabase(s)? 1 Instance 9 Multiple1 Instance 9 Multiple GeodatabasesGeodatabases
• Replication Strategy? Replication Strategy? YesYes
44
Storage RequirementsStorage Requirements
• Analysis Needed on How Much for GISAnalysis Needed on How Much for GIS Storage/Mirror/Backup/Offline Storage/Mirror/Backup/Offline
• Analysis Needed on How Much StorageAnalysis Needed on How Much Storage Needed for Vector and Raster Storage Needed for Vector and Raster Storage
• What Type of Storage System is Available?What Type of Storage System is Available?– SANSAN– Direct AttachDirect Attach– NASNAS
55
ArcSDEArcSDE Direct Connect Direct Connect VS Application ConnectVS Application Connect
• Direct Connect Provides Best PerformanceDirect Connect Provides Best Performance
• Works with Active DirectoryWorks with Active Directory
• ArcSDE Application Server Has Had No Development ArcSDE Application Server Has Had No Development Since Version 9.2Since Version 9.2
• Direct Connect is ESRI DirectionDirect Connect is ESRI Direction
• Allows Re-using of Current ArcSDE ServersAllows Re-using of Current ArcSDE Servers
66
User WorkflowsUser Workflows(Information Products)(Information Products)
• Users Types (Desktop and Web or Mobile)Users Types (Desktop and Web or Mobile)
• User WorkflowsUser Workflows
• Simple MappingSimple Mapping
• EditingEditing
• GeocodingGeocoding
• GeoprocessingGeoprocessing
• Batch Processes (Done off-hours, Nightly)Batch Processes (Done off-hours, Nightly)
• Interfaces to Other Applications/DatabasesInterfaces to Other Applications/Databases
• Geodatabase ReplicationGeodatabase Replication
• VersioningVersioning
• EDN, Production, Publishing, TestingEDN, Production, Publishing, Testing77
Consuming ServicesConsuming Services
• Map ServiceMap Service– MSDMSD
• GeocodeGeocode• Geodata ServiceGeodata Service
– Simple EditingSimple Editing
• Geoprocessing ServiceGeoprocessing Service– TasksTasks
• Globe ServiceGlobe Service• Imager ServiceImager Service• KML ServiceKML Service• OGC ServicesOGC Services• Caching ServicesCaching Services
88
Expanding Deployment OptionsExpanding Deployment OptionsOGC Standards via ArcGIS 9.3.1OGC Standards via ArcGIS 9.3.1
• Web Feature Service (WFS)Web Feature Service (WFS)– Provide feature dataProvide feature data
• Manipulation/analysis of data on clientManipulation/analysis of data on client
• Web Feature Service Transaction (WFS-T)Web Feature Service Transaction (WFS-T)– Simple transaction updates Simple transaction updates
• Session-less redliningSession-less redlining
• Web Mapping Service (WMS)Web Mapping Service (WMS)– Provide an ImageProvide an Image
• Different styles can be requested via SLDDifferent styles can be requested via SLD
• Web Coverage Service (WCS)Web Coverage Service (WCS)– Provide CoverageProvide Coverage
• Can be consumed for analysis by GeoprocessingCan be consumed for analysis by Geoprocessing
• Keyhole Markup Language (KML)Keyhole Markup Language (KML)– Google Earth/Maps compatibilityGoogle Earth/Maps compatibility
• Catalogue Service – Web (CS-W)Catalogue Service – Web (CS-W)– MetadataMetadata
UC2008 Technical WorkshopUC2008 Technical Workshop 99
ESRI Performance Tools:ESRI Performance Tools:
Capacity Planning Tool & MXDPerfStatCapacity Planning Tool & MXDPerfStat
1010
Template
Why is Enterprise System Architecture Why is Enterprise System Architecture design Important?design Important?Performance ChainPerformance Chain
1111
Reduce Cost
System Architecture Design
Improve Productivity
Balanced System Design
Servers Network DBMS Geodatabase
Storage Clients ArcSDE Application
Hardware Infrastructure
Framework for Productive Operations
Database Design User Workflow
Performance, Scalability, Flexibility, Reusable, interoperable
Expanding Deployment OptionsExpanding Deployment OptionsAPI’s - Enabling Mashup SupportAPI’s - Enabling Mashup Support
UC2008 Technical WorkshopUC2008 Technical Workshop 1212
VDI Deployment PatternsVDI Deployment PatternsEnterprise - CentralizedEnterprise - Centralized
J8338J8338
NorthernRegion
User
Data Center
Application Data
VDI
Oracle/ArcSDE
Thin/Thick Client Connections
Central Region
User
Thin /Thick Client Connections
South Central Region
User
Thin/Thick ClientConnections
Southern Region
User
Thin/Thick ClientConnections
WHY CONSOLIDATE?•Reduced hardware cost•Reduced administration cost•Lower implementation risk•Reduce infrastructure needed in DC (power, cooling, BK, etc)•Improved data access•Improved security•Reduced network traffic• “Greener datacenter”
WHY CONSOLIDATE?•Reduced hardware cost•Reduced administration cost•Lower implementation risk•Reduce infrastructure needed in DC (power, cooling, BK, etc)•Improved data access•Improved security•Reduced network traffic• “Greener datacenter”
Application Pattern
GIS Services
Data Sources
Desktop Web Mobile
Silverlight Flex
Rest
Map Service
MSD MXD
Map Cache
Dynamic BlendedCached
Java ADF .NET ADF
Soap
ImagesPGDB FGDB DB2 PostgresSQLOracle InformixMS Access
Data Types
User
JavaScript
Example One GIS Service (Map Only) x 16 Services
ESRI Servers 9.3.1 (VMWare, Blade System)ESRI Servers 9.3.1 (VMWare, Blade System)
1515
ArcGIS Server:- Make: Dell- Model: 2950- Type of CPU: Intel Xeon CPU [email protected] – 4 Core- Disk (RAID, SAN, etc): local storage- OS with exact version & service pack: Windows Server 2003 R2 Enterprise Edition with SP2- Network adapter(s) & speed: Broadcom BCM5708C netXtreme II – 1 Gbps SDE Server:- Make: Dell- Model: 2950- Type of CPU: Intel Xeon CPU [email protected] – 4 Core- Disk (RAID, SAN, etc): local storage- OS with exact version & service pack: Windows Server 2003 R2 Enterprise Edition with SP2- Network adapter(s) & speed: Broadcom BCM5708C netXtreme II – 1 Gbps
ESRI Servers 9.3.1 (VMWare, Blade System)ESRI Servers 9.3.1 (VMWare, Blade System)
1616
Image Server:- Make: Dell- Model: 2950- Type of CPU: Intel Xeon CPU [email protected] – 4 Core- Disk (RAID, SAN, etc): local storage and SAN- OS with exact version & service pack: Windows Server 2003 R2 Enterprise Edition with SP2- Network adapter(s) & speed: Broadcom BCM5708C netXtreme II – 1 Gbps Database Server:- Make: Dell- Model: 2950- Type of CPU: Intel Xeon CPU [email protected] – 4 Core- Disk (RAID, SAN, etc): local Storage and SAN- OS with exact version & service pack: Redhat Enterprise Edition 5.3- Network adapter(s) & speed: Broadcom BCM5708C netXtreme II – 1 Gbps- Database: Oracle 11g
Database RecommendationsDatabase Recommendations
• 1 Oracle 11g Instance1 Oracle 11g Instance• 7 User Geodatabases7 User Geodatabases• High-Availability/Fault-ToleranceHigh-Availability/Fault-Tolerance
– PublicationPublication– ProductionProduction
• Inherit Characteristics of Existing GeodatabasesInherit Characteristics of Existing Geodatabases• ESRI Provide Oracle Configuration RecommendationsESRI Provide Oracle Configuration Recommendations• Geodatabase Requirements (Tablespaces, etc)Geodatabase Requirements (Tablespaces, etc)
– Come from Existing ImplementationsCome from Existing Implementations
• ESRI Provide Tools for Oracle Performance TuningESRI Provide Tools for Oracle Performance Tuning
1717
Network RecommendationsNetwork Recommendations
• Remote Desktop UsersRemote Desktop Users– WTSWTS– VDIVDI– CitrixCitrix
• Test and MonitorTest and Monitor– Define Real Network ImpactDefine Real Network Impact
• DS3 ImplementationDS3 Implementation
1818
Storage RecommendationsStorage Recommendations
• Utilize 2 SANs Storage SpecificationsUtilize 2 SANs Storage Specifications– Production (2 TB)Production (2 TB)– Publication (11 TB)Publication (11 TB)– RAID 1/0 & 5 MirroringRAID 1/0 & 5 Mirroring
• Geodatabase ReplicationGeodatabase Replication– Changes to Oracle Geodatabases Moved from Production to PublicationChanges to Oracle Geodatabases Moved from Production to Publication
• Image Service ReplicationImage Service Replication– Move initial imager to SAN (UNC Path)Move initial imager to SAN (UNC Path)– Changes to Service Overviews and ImageryChanges to Service Overviews and Imagery– Done very infrequentlyDone very infrequently
1919
Security RecommendationsSecurity Recommendations
• Firewall Protected Boundary Around Publication Firewall Protected Boundary Around Publication EnvironmentEnvironment– All Publication Access Within Boundary (Read-only)All Publication Access Within Boundary (Read-only)– Reverse ProxyReverse Proxy
• Active Directory & LDAP integrationActive Directory & LDAP integration– Application EnablingApplication Enabling
• Single Sign OnSingle Sign On
2020
Show Visio Architecture Show Visio Architecture Diagram (Final)Diagram (Final)
2121
Summary Summary • Benefits for Enterprise GIS Architecture Benefits for Enterprise GIS Architecture
– Meets the state CIO enterprise architecture initiativeMeets the state CIO enterprise architecture initiative
– Improve overall performance (network, servers, desktops, load Improve overall performance (network, servers, desktops, load balance). balance).
– Multi-users & accommodate remote users via thin client connection Multi-users & accommodate remote users via thin client connection and tighter securityand tighter security
– Promote data sharing internal & external (as services)Promote data sharing internal & external (as services)
– Lower TCO of servers, software, licenses due to consolidationLower TCO of servers, software, licenses due to consolidation
– Scalability & Flexibility (Hardware, software, storage, clustering, Scalability & Flexibility (Hardware, software, storage, clustering, adding future projects, user access)adding future projects, user access)
2222
Questions?Questions?
Thank you!Thank you!
[email protected]@water.ca.gov
916-654-6433916-654-6433
2323