multiple instances consolidation practices

36
MS SQL Server: Multiple Instances Consolidation Practices Alexander Prusakov Senior MS SQL Server DBA May, 2010

Upload: alexdepo

Post on 05-Dec-2014

3.519 views

Category:

Technology


0 download

DESCRIPTION

There are many ways to reduce costs in IT. Consolidation is one of these ways. Many IT managers thinking only about virtualization when consider consolidation. Multi-instancing is very legitimate and effective way too. Managers and DBAs have to understand benefits and pitfalls, difference from virtualization. Presentation is unveiling real-world practice and experience of support of over 70 servers with at least 6 instances on each with over 2500 databases. This presentation can be helpful for infrastructure managers, system architects, and DBAs .

TRANSCRIPT

Page 1: Multiple instances consolidation practices

MS SQL Server: Multiple Instances

Consolidation PracticesAlexander Prusakov

Senior MS SQL Server DBAMay, 2010

Page 2: Multiple instances consolidation practices

Sr. MS SQL Server DBA (consultant) in one of the biggest financial institution in the world

20+ years of IT experience (business users, ERPs, databases and applications support, software development, data warehousing, etc.)

15+ years of experience with MS SQL Server

MBA, MCITP: Database Administrator 2005/2008

Industries: banking/finance, energy, education, health care, manufacturing, IT consulting.

Speaker’s Background:

Page 3: Multiple instances consolidation practices

Why; How; What to expect and how it

works; Summary; Q and A.

Agenda:

Page 4: Multiple instances consolidation practices

Consolidation refers to the merger from multiple computer sources into single.

Virtualization refers to the abstraction of computer resources.

Multi-instancing refers to the utilization of the same computer sources by multiple independent SQL Servers

Terms

Page 8: Multiple instances consolidation practices

Virtualization

Multi-instancing

Page 9: Multiple instances consolidation practices

Unexpected need in new SQL Server without budget for a hardware;

Buzz about virtualization; Enterprise environment; Curiosity;

How did I step in:

Page 10: Multiple instances consolidation practices

Reduce hardware cost Reduce pollution (carbon

footprint) Reduce labor/support cost Increase resources utilization Look nice in other’s eyes

Why to consolidate:

Page 11: Multiple instances consolidation practices

Actually it might not (MSRP pre-configured

estimated):› Enterprise level server: 16 sockets,

196GB (16P) about$175,000.00;› HP ProLiant DL785G5 8380 -128GB (8P)$34,999.00;› HP ProLiant DL380G6 E5504-4GB (1P)$ 2,289.00 x 8 = $ 18,312.00;$ 2,289.00 x 16 = $ 36,624.00;

Reduce hardware cost:

Page 12: Multiple instances consolidation practices

Space: 2U x 8 = 16U vs. 7U Power: 460x8 = 3,680 vs. 1,300 W Cooling cost: vary Reduced carbon footprint (including

manufacturing and usage) Ability to add physical CPUs and/or

memory

Real Benefits:

Page 13: Multiple instances consolidation practices

Cost of annual licensing;› OS – 1 to 8;› SQL Server: 8 x 5,999.00 =

47,992.00 8 x 24,999.00 =

199,992.00 Load performance improvement; Cost of SysAdmin support(1 vs. 8); Cost of DBA time (patch 1 vs. 8); Cost of real estate and other

Reduce support cost:

Page 14: Multiple instances consolidation practices

Data compression; Resource governor; Table partitioning; Hot-add CPU and memory; Policy-based management; Data collector; etc.

Extras bonus from Enterprise version:

Page 15: Multiple instances consolidation practices

Total workload throughput on the system versus total number

of databases.

http://www.dell.com/downloads/global/solutions/ServerConsolidation1.doc

Page 16: Multiple instances consolidation practices

Workload throughput on each database versus the number of

databases on the system

http://www.dell.com/downloads/global/solutions/ServerConsolidation1.doc

Page 17: Multiple instances consolidation practices

Effective memory for procedure cache in different configurations

http://www.dell.com/downloads/global/solutions/ServerConsolidation1.doc

Page 18: Multiple instances consolidation practices

Ability to re-distribute CPUs and memory between instances;

Parallel processing (especially beneficial in non-business hours);

Increase resource utilization:

Now you look GREAT!Or may be not

Page 19: Multiple instances consolidation practices

Multi-instancing vs Virtualization

Feature:Multi-

instancingVirtualization

All eggs in one basket Yes May beUse of many low-level servers as one

No Yes

Security and workload isolation

Not really Yes

System administration saving

Yes Sometimes

DBA time saving Yes NoDeployment time saving No Yes

Page 20: Multiple instances consolidation practices

Multi-instancing vs Virtualization

Feature:Multi-

instancingVirtualization

Patching time saving

OS level Yes Kind ofInstance level

Yes No

Overhead*

CPU No 10%IO No 6-8%

MemoryMay be some for

300 MB for the hypervisor;32 MB for the first GB

Page 21: Multiple instances consolidation practices

Multi-instancing vs Virtualization

Feature:Multi-

instancingVirtualization

Overhead*Memory

OS and related processes

of RAM on each VM;8 MB for every additional GB of RAM on each VM

Network latency

No less than 1 ms

Hardware limitations Server limit64GB limit per VM2 TB limit per Host

* http://msdn.microsoft.com/en-us/library/cc768536(BTS.10).aspx

Page 22: Multiple instances consolidation practices

Install multiple instances; Create multiple TempDBs; Limit CPUs and memory per

instance; Leave enough memory for OS; Monitor performance; Test performance before move to

production; Know your IO system; Set up thresholds;

How:

Page 23: Multiple instances consolidation practices

Model CPU Total Memory

IBM 3850 M2 / x3950 M28 Quad Core

66,583,112

Page 24: Multiple instances consolidation practices
Page 25: Multiple instances consolidation practices

Microsoft Performance Dashboard; Quest Foglight software; Good DBA;

What is not that much:

What is useful:

Single Instance Reports; Profiler; Sysadmins.

Page 26: Multiple instances consolidation practices

Usefulness:

Page 27: Multiple instances consolidation practices

And NOT:

Page 28: Multiple instances consolidation practices

But can be better:

Page 29: Multiple instances consolidation practices

Steady but needs a lot of patience from DBA;

Business has to follow rules; Adds extra work to manage and

keep records on DBs; Harder tune performance; Higher cost of error (including

planning).

How it works :

Page 30: Multiple instances consolidation practices

SQL Server Engines for users are separated on different instances;

SSAS and SSRS are separated from database engines;

Each instance is used by databases of one business unit;

Application has no elevated rights on any shared server;

Have a big boss on your side!

How:

Page 31: Multiple instances consolidation practices

Push back from development team on:› CPU utilization;› IO utilization (IOPS);› Database schema optimization;

› Query tuning;

What to expect:

Page 32: Multiple instances consolidation practices

Push back from business:› DBA has to be involved;› One instance down – all business units might be down;

› IT cost saving <> business cost;

› Is there a shortcut?;

What to expect:

Page 33: Multiple instances consolidation practices

Unexpected errors; A lot of work to build

monitoring and administration tools;

Fun, fun, a lot of fun

What to expect:

Page 34: Multiple instances consolidation practices

Bigger the farm – better savings;

Bigger the farm – bigger the headache;

Not that scary if design and implementation has been done carefully.

Summary:

Page 35: Multiple instances consolidation practices

Internet – find your way, do it yourself

Microsoft – excellent documentation, big community. For example:

http://msdn.microsoft.com/en-us/library/ee819082.aspx

Hardware Manufactures – hard to find the truth

Consultants – result may be vary

Where to look for more:

Page 36: Multiple instances consolidation practices

Slides can be found on:› http://

indiana.sqlpass.org/Default.aspx?tabid=2742

Email: [email protected]

Questions & Open Discussion

Thank You!