ibm software group ® performability and grid in an on demand world robert berry, ibm corporation

IBM Software Group

®

Performability and Gridin an On Demand World

Robert Berry,IBM Corporation

IBM Software Group

Good morning and thank you

IBM Software Group

Outline

Performance and Reliability are important

The Grid is an important component of business computing, today, and for the future

On Demand – the drive for ultimate flexibility and integration

• Leads us to Grid

The Grid in business

• Typical Examples of commercial Grid applications

• A different kind of example

Trends, Consequences, Questions for Performability

IBM Software Group

Performance, Reliability are important

Reliability, Quality A growing part of software development budget is spent on performance, test and service

Problem rates on new technologies (e.g., J2EE) are high and climbing

New solutions are required.

Typical development profile

41%

47%

5%7%

Development

Performance, test andservice

Build

Other

IBM Software Group

An on demand business is an enterprise whose

business processes—integrated

end-to-end across the company and with key

partners, suppliers and customers—can

respond with speed to any customer demand,

market opportunity or external threat.

On Demand Business – The “ Why”

IBM Software Group

Present Reality: Functional Automation

Limitations of Tight Vertical Integration:

• Monolithic applications can’t be reused economically, efficiently

• Ad hoc integration creates connections that are difficult to change/maintain

• Lack of standards limits ability to deliver meaningful interoperability

Marketing

Partners

Web

Partners

Sales

Partners

IBM Software Group

Marketing

Partners

Web

Partners

Sales

Partners

What Business needs: Horizontal Process Integration

Advances that make it possible:

• Standards for creating services and enabling them to communicate are agreed upon by major vendors

• Infrastructure that supports self-defined, loosely coupled services has emerged

• Tools to incorporate existing assets are available

• Automation and virtualization of systems resources readily available

Need to Integrate

IBM Software Group

Marketing

Partners

Web

Partners

Sales

Partners

What Business needs: Horizontal Process Integration

Need toIntegrate

Business Flexibility

IT Simplification

Increased focus on business flexibility

• Relentless use of open standards to enable communication and integration across the value net

• Partner to sharpen focus and respond to opportunities and threats

Requires an on demand IT environment

• Ability to repurpose application functionality in order to support horizontal processes

• Automation and virtualization of resources

IBM Software Group

Business process decision-making

Rigid organizational structure

Slow and steady economic growth

Long-term product lifecycles

Passive operational risk management

Fixed costs

Proprietary systems

Labor-intensive

Users adapt to technology

Collaborative, integrated value nets

Dynamic, adaptive, learning

Unpredictable fluctuations

Shortening product lifecycles

Proactive risk management; increased focus on privacy and security

Variable costs

Open, integrated systems

Self-healing, self-managing systems

Technology adapts to users

Bu

sin

ess

Tec

hn

olo

gy

Static On Demand

IBM’s On Demand model is a fundamental shift in the business model and technology

IBM Software Group

Focus on Virtualization and Grids

On Demand Operating Environment

Transactional Processes

Application Development, Deployment & Maintenance

Collaboration Information Management

Integration: People – Process – Information “Anywhere, any time, from any device”

Security Optimization Provisioning

Policy-based Orchestration

Availability

Business Objectives

and Policies

Virtualization Engine

StorageServersDistributed

Systems Network

Op

en S

tan

dar

ds-

bas

ed

Business Objectives

and Policies Grids

IBM Software Group

Grid – is it commercially real?

Several commercial examples Charles Schwab

Hewitt Associates

A somewhat different example Games

IBM Software Group

Charles Schwab

• Reduce the processing time on an existing wealth-management application to improve customer service.

• IBM • Linux • Globus Toolkit• IBM Infrastructure Technology Services • IBM Research

Challenge

SolutionTechnology Benefits:

Business Benefits:• Increased customer satisfaction by

responding to inquiries in real time• Enabling Schwab to move from a low-cost

transactional broker to an advice-based wealth manager

“We believe that Grid computing … has the potential to greatly improve our quality of service and be a truly disruptive technology.” Oren Leiman, Managing Director, Charles Schwab

“We believe that Grid computing … has the potential to greatly improve our quality of service and be a truly disruptive technology.” Oren Leiman, Managing Director, Charles Schwab

Technology Benefits:• Reduced processing time from four

minutes to 15 seconds• Leverages existing infrastructure• Grid-enabling many more applications

Business AnalyticsBusiness Analytics

IBM Software Group

Hewitt Associates LLCChallengeCreate Grid Computing environment to:

Contain expenses for CalcEngine valuations

Maintain or improve availability, response time & scalability

Insure personal-data security

Capitalize on existing application code

Cooperate with z/OS Sysplex CICS Calling Environment

Enable smooth and orderly migration to changeSolutionGrid Computing environment includes:

IBM zSeries® server

IBM eServer BladeCenterTM servers

Linux Red Hat v8.0

Business Partner: DataSynapse GridServer

Business Analytics

Benefits: Efficiently uses of the combined

processing power of their heterogeneous environment

Experienced an immediate 10% faster response time with the first application deployment

Open architecture enables Hewitt to easily deploy additional applications

Increased processing speed reduced cost per transaction

Reduced operational costs improves competitiveness in their industry segment

IBM Software Group

HR Outsourcer Business Background

Real time policy calculation Valuate participant scenario with respect to employer constructs

Policies defined by corporate plans and governmental rules

Custom interpretive language worksheet creation

Valuations are an expensive business COBOL CICS applications serialize person data through VSAM

Smalltalk Operations can take 1-50 seconds of zSeries computing

Arrival rate is erratic, causing divergent response time

Grid cost is justified by the flexibility for new deployment

zSeries Model 900

CICSAAA

COBOLBA0111COBOL

CaIcEngineSmalltalk

zSeries Sysplex16000 Mips71 CPs4 CPs for CalcEngineMore CPs for development

IBM Software Group

Integrating Smalltalk Into A Grid Grid Servers(xSeries)

Linux

VMWare or Blades

Binding App.

Linux

Smalltalk

CaIcEngineSmalltalk

zSeries Model 900

CICSAAA

COBOL Bin

din

g

Ap

p.

IBM VisualAge Smalltalk Connectors Support for APPC, CICS, CPI-C, MQI and

TCP/IP (sockets and RPC)

Version 6.0.1 became a ‘pre-req’

• Required DB2 access from Engines Prototype Selection

Tried OGSA v3 in February, but…

Keep it simple!

Use Java socket code

Provide enough ‘middle points’ to be able to ‘watch/debug’ request flow

IBM Software Group

OptimalGrid

A Research project at IBM Almaden Researcher Center

Makes developing and running grid application easy by hiding the complexity of using the grid

A different approach from the API or Toolkit application development environments – no need to educate developers on complicated grid technologies

Application code, Management Infrastructure, and Manager written in Java so it runs anywhere Java runs

Non-Java application integration possible via JNI and MathShell

IBM Software Group

What if….? You could create a NEW GENRE of massive player online game…

Where you can FLY through a huge game world

Where you can SEE objects in the other server

Where you can INTERACT with the entities on the other servers

Range of sight For player #1 Range of sight

For player #2

Server 1

Server 2

Server 3

Server 4

Server 6

Server 7

Server 8

“Interacting” withEntities in other servers

IBM Software Group

What if….? You could create a MASSIVE multi-player online game

Where the number of players are NOT LIMITED by the server hardware

Where everybody is in ONE WORLD, not several different “shards”

Where massive battles with over 10,000 PLAYERS are possible

#1 Game world server( 2000 players )

#2 Game world server( 1000 players )

#3 Game world server(MAX: 3000 players)Outage due to sudden increase in players

In the other game world.

ONE Gridified Game World

Game environment not limited by server hardware

HelloPlayer ABC

Hello player

XYZ

Three separate Parallel Game Worlds

Come join the big battle!

I got disconnected!

Where are you?

IBM Software Group

What if….? Your game servers could load balance the game DYNAMICALLY

Where the servers will allocate resources AUTOMATICALLY

Where the servers will partition the game for OPTIMAL PERFORMANCE

Game map zone : Blue Game map zone : Red Game map zone : Yellow

Huge User Movement From Map Zone BLUETo Map Zone RED

Grid Resource DynamicallyRe-allocated withOptimal configuration

IBM Software Group

• 870 unique total client code downloads • 67 IBM domains worldwide• 18% Linux clients 82% windows

Massively Multiplayer Online Game (mmog) Demonstration Based on Quake2

IBM Software Group

For Game Developers, Hosts, and Aggregators of MMOG

OptimalGrid can:

- Automatically partitions and distributes any game world

- Seamlessly moves players and objects between servers

- Game migration is easy

- Original game design is preserved

OptimalGrid’s Autonomic feature hides the complexity of Grid from the Application Developer, while resolving pain points

Player now in GameGrid

Server A’s Zone

Player now in GameGrid

Server B’s Zone

IBM Software Group

Performability in an on demand world

Performance

Reliability

IBM Software Group

Flexibility and Responsiveness drive On Demand

Flexibility

Componentisation

Reuse

Simplification

Virtualisation at all levels of Resources

Autonomic control

Reliability (predictability)

Finer modularity

Security

Responsiveness

Open Stds

Performance

And they, in turn, drive Virtualisation (Grid) And also have consequences for Performability

IBM Software Group

Trends, their Consequences, and Questions

SecurityA classic antithesis for performance

A critical and growing requirement for business

But a growing problem we all face, e.g.,

• Viruses−6.5M in 2003

• Antivirus scans - 3 hours of “downtime”

• Overhead for J2EE security managers ---------------------------------

This will continue to grow

• 6M Viruses so far in 2004

0

20

40

60

80

100

120

HTTP

req/s

ec.

No Sec.

Java2 Sec.

Java2 + J2EE Sec.

Trade3JVM: cn1411-20030915

IBM Software Group

Performance

Reliability

Security

- Typically drives performance down - pathlength goes up - scalability is constrained

-Typically enhances reliability-Availability also goes down with virus scans, etc.

• Security

Open, Grid environments scale up security issues, and mandate more attention.

Do we need to model these interactions explicitly?

Are present techniques adequate? Appropriate?e.g., to capture viral spreading patterns, containment


IBM Software Group


Scalability Whatever we think is large and complex now, won’t be in the future.

We see this in some of the grid examples we are familiar with

Games motivates another jump in scale

• 10,000 users at a time

• Communities of 500,000’s of users

• Wireless gaming will drive server demand, and strain adaptive capabilities even harder

• Security issues will multiply profoundly− Gaming is real commerce

− People buy virtual things – e.g., castles, etc., on ebay!

IBM Software Group


Complexity A growing concern for software in general

New technologies/disciplines – e.g., componentisation, Aspect Oriented Software Development - must help, but for now, we are faced with:

1 5 9 13 17 21 25 29 33 37 41

Call Depth

0

100

200

300

400

500

600

700

800

900

Fre

qu

en

cy

Call Depth Frequency for simple J2EE application

• One factor that contributes to growing security overhead

• Also to resulting models of reliability and overall fragility

IBM Software Group


Componentisation and Reuse Demands modularity and reuse in models

Demands incremental, scalable, composable models

Autonomic Systems What is a failure in a self-healing system?

What are the reliability characteristics of a system that is adaptive?

How is this to be characterised, measured, modelled?LotusWebSphere DB2Tivoli

Re-factor to SWG Product Offerings

Componentization

LotusTivoli WebSphere DB2New or

EnhancedCapabilities

New or EnhancedCapabilities




SharedComponents

Product OfferingsProduct Specific

Investment

SharedCapabilities

InitialBase

Product

IBM Software Group


Autonomic Systems What is a failure in a self-healing system?

What are the reliability characteristics of a system that is adaptive?

How is this to be characterised, measured, modelled?

IBM Software Group

Trends, their Consequences, and Questions Business focus is needed

Growing Recognition of the importance to IT of Business Events, Business Processes

For deeply technical people this is a hard concept

• But, technology exists to solve business problems

There are some interesting opportunities for performability as well. E.g.,

• Reliability as a factor in service level objectives, agreements

• Dynamic, operational performability

• Measuring and Characterising Business Performance; Business Reliability. The Reliability of Services.

Business Performance Management monitors and visualizes the behaviour of business processes by correlating IT events and business activities, thus enabling performance optimization according to business goals

IBM Software Group

Summary

Performance, Reliability are growing business concerns

The Grid solves real business problems and is part of the overall solution in delivering increasing flexibility and responsiveness.

Dependency on Software is growing in all levels of IT solutions

Complexity is growing

Security is a growing requirement, and the tradeoffs between security and performance need to be better understood

The IT focus is moving increasingly higher up the software stack; indeed, beyond the software into the business domain.

Reliability, Performance and Availability are more complex with dynamic provisioning and autonomic control

IBM Software Group

Thank You!

Questions?

IBM Software Group

Getting OptimalGridAvailable for download on Alphaworks

www.alphaworks.ibm.com/tech/optimalgrid

Project pageswww.almaden.ibm.com/software/ds/OptimalGrid

E-week: http://www.eweek.com/article2/0,3959,1227299,00.aspSlashdot: http://games.slashdot.org/article.pl?sid=03/08/22/0351229&mode=thread&tid=112&tid=127&tid=136&tid=186&tid=187&tid=206

)

MIT Technology Review

Researchers

James Kaufman [email protected] Lehman [email protected] Deen [email protected]

IBM Software Group

Trademarks

Hewitt is a trademark of Hewitt Associates, LLC

Charles Schwab is a trademark of The Charles Schwab Corporation.

Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

Microsoft, Windows, Windows NT, BizTalk, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.

Gartner is a registered trademark of Gartner, inc., or its Affiliates

Solaris is a trademark of Sun Microsystems, Inc. in the United States, other countries, or both.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Intel, Pentium, Pentium Pro, Pentium II, Pentium III are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the US and other countries.

HP-UX is a registered trademark of Hewlett Packard Company.

Linux is a registered trademark of William R. Della Croce, Jr. (last listed previous owner was Linus Torvalds)

"SAP is the trademark of SAP AG in Germany and in several other countries.

AIX, AS/400, Blue Gene, BlueDrekar, Lotus, Tivoli, Rational, XDE, Z/OS, DB2, Deep Blue, Deskstar, Discoverylink, IBM, Microdrive, OS/390, Scrollpoint, ServeRAID, Thinkpad, TransNote, Travelstar, Ultrastar, Websphere, Workpad, are all trademarks and registered trademarks of International Business Machines Corporation in the United States and/or other countries.

ibm software group ® performability and grid in an on demand world robert berry, ibm corporation

Documents