linux in the enterprise

Linux Overview © 2003 IBM Corporation

Linux in the Enterprise

Bill Hilf

IBM Sr. Consulting I/T ArchitectGlobal Linux Technical Lead, [email protected]

COSST Symposium

October 18, 2003


What is Open Source?• Community develops, debugs, maintains• Generally high quality, high performance

software• Superior security - on par with UNIX, superior to

Windows• Peer code reviews are Darwinian --

structured/disciplined• More information: www.opensource.org• Examples of Open Source Software:

•Apache web server

•Eclipse app development

•Gnome desktop environment

•Mozilla (Netscape) browser

•Open Office (Star Office) productivity suite

•Perl programming language

•Samba file/print

•SendMail mail server

•Tomcat application server

Maintainer

Core

Developer

Software Engineers at Large

Kernel

Core

Developer

Core

Developer


What is Linux?• UNIX-like operating system

• Kernel 2.4 available

• Kernel 2.6 in beta; production 2H03

• Developed / tested by the Open Source community

• Packaged and shipped by distributors• Red Hat, SuSE, Turbolinux

• Regional distributors:

• Red Flag, Conectiva, Mandrake, etc...

• UnitedLinux = open industry consortium providing a binary-compatible Linux distribution

D istributions

I n s t a l l S e r v ic e

P a c k a g e & T e s t

K D E G N O M E

K e r n e l

S A M B A

G l ib c

D D

D DD D

"Hello everybody... I'm doing a (free) operating system (just a hobby, won't be big and professional...)."

Linus Torvalds, creator of Linux, from the first Internet announcement on August 25, 1991. Even he initially underestimated its potential.


Linux Kernel Information

• The Linux kernel version numbers consist of three numbers separated by decimals, such as 2.2.14. The first number is the major version number. The second number is the minor revision number. The third number is the patch level version

• There are two stages of kernel releases: “stable” and “development”. Development kernels end in an odd number (2.3, 2.5, …), stable or production kernels end in an even number (2.4, 2.6, …).

• Once a kernel is deemed stable, it will move from an odd to even second number for release (e.g., from 2.3.51 to 2.4.0).

• You can get a good sense of what the future production state of Linux will be by looking at the development kernel.

• http://www.kernel.org


Trends in eBusiness

NetworkingNetworkingInternetInternet(TCP/IP)(TCP/IP)

CommunicationsCommunicationse-maile-mail

(pop3, SMTP, Mime)(pop3, SMTP, Mime)

InformationInformationWWWWWW

(html, http, j2ee, xml)(html, http, j2ee, xml)

Operating SystemOperating SystemLinuxLinux

(GPL, OSDL)(GPL, OSDL)

ApplicationsApplicationsWeb ServicesWeb Services(SOAP, WSDL, (SOAP, WSDL,

UDDI)UDDI)

Distributed ComputingDistributed ComputingGridGrid

(Globus, OGSA)(Globus, OGSA)

The Open SourceThe Open Source

(R)evolution(R)evolution


Open Source Software Fundamentals

• Open Source software is a critical component to understanding the overall Linux value proposition

• The rationale is that a larger group of programmers not concerned with proprietary ownership or financial gain will produce a more useful and bug -free product

• Quality• The Open Source development model relies on peer review to

find and eliminate bugs, as well as to enhance or add feature/functionality

• Speed• Programmers communicate and develop via the Internet (through

newsgroups, online source code repositories, and email) which drives an expedient evolution of the product


Open Source Software Fundamentals

• Leadership by merit• Technical merit (coding, design, support, leadership) drives the

power positions• The kernel development, in particular, is very disciplined and

structured• Driven by need

• Open Source software is generally created by those who need to solve a particular problem

• There are multiple types of Open Source licenses (http://www.opensource.org/licenses/)

• Standards driven by the Linux Standard Base (http://www.linuxbase.org) which develops and promotes standards to increase compatibility across distributions and applications developed on or ported to Linux

• Cross-vendor groups, such as the Open Source Development Lab, (http://www.osdl.org) provide benchmarks, tools, and test suites --among many other things


Linux in The Enterprise


Linux Market Broadening

Customers Industry adoption expanding

Workload usage maturing

Governments endorsing Linux

Technology 2-way 8-way

Blade acceleration

"Carrier-grade"

2.6 Kernel due 4Q'03 (16-way)

Client functionality

Market Increasing vendor competition

Standardization increasing

Growing ISV support

Analysts endorsement strengthening


Question: Question: Based on what you have seen or heard so far with Based on what you have seen or heard so far with Linux, how would you rate Linux on the following aspects?Linux, how would you rate Linux on the following aspects?

Note: Includes responses from 500 Linux users

Reliability

Acquisition Costs

Performance

Value of Open Source

Security

TCO

Scalability

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%

Attributes Rated "Outstanding"

Source:IBM Market

Research 2002

Linux, more than just costs…


Linux Today

• 28% CAGR by 2007 (3x any other OS)

• Since 2000…

• Servers up 50%• Middleware and applications revenue

growth 100%+• Installed license base grew 4M copies to

15 million


Security – CC achievement

• IBM and SuSE Linux have achieved Common Criteria Security Certification. The Common Criteria (CC) is an internationally recognized ISO standard (ISO 15408) used by the Federal government and other organizations to assess security and assurance of technology products.

• Equivalent to ‘Good Housekeeing Seal of Approval’. Opens the door for internal use in banks, the Pentagon, etc.

“The Common Criteria certification of Linux will be a critical factor as Linux is applied to mission critical environments.”-Fritz Schulz, Defense Information Systems Agency


Evans Data Developer Survey – July 2003

• Recent Evans Data Survey Found:• Of more than 400 developers focused on Linux development more than

70% said that the SCO lawsuit will “probably not” or “absolutely not” impact their companies decision to use Linux

• Linux users are finding it as easy to migrate their applications from Windows to Linux as from Unix to Linux. Within the first six months 45% of Unix application migrations to Linux have been completed and 47% of Windows application migrations have been completed.

• The playing field for Linux is far from decided with 36% of developers preferring commercial versions of Linux and 15% choosing a non-commercial version. The majority of developers are undecided with 49% saying it doesn’t matter.


1999 2000 2001 2002 2003P0

20

40

60

80

Per

cen

t

SolarisLinux

HP-UXWin NT

IBM AIX

Primary EDA Platform

1999 2000 2001 2002 2003P0

20

40

60

SolarisLinux

HP-UXWin NT

IBM AIX

Secondary EDA Platform

Source: Synopsys 2002 Platform Survey (with permission)

EDA Platform Trends

"Linux doubled its marketshare in 2002.""Linux doubled its marketshare in 2002."Gartner/Datquest, April 2003Gartner/Datquest, April 2003


NEC AX10 A/V Server

Ericsson HS210 Cordless Screen Phone

Motorola DCT5000 STB

Sony CoCoon PVR

TiVO Personal TV

Nokia Media Terminal

Hitachi FLORA-ie 55mi Wireless Web Pad LG Electronics Digital iPAD

Ericsson Bluetooth "blip"

HP Digital Entertainment Center

Linksys Wireless Gateway

Toshiba Wireless Mobility Server

Citizen and IBM Linux WatchPad

Wincor Nixdorf POS

Sony Video Network Station

Square D Power Mgmt Device

Embedded Linux


Linux Strides World Wide

Source USAToday/Gartner DataQuest March 2003


IBM’s Perspective on Linux Deployment

Database server-highCommercial ClustersERP, CRM, SCMVertical Industry Applications

Database server-loweCommerceSuper Computing ClustersSW DevelopmentWeb HostingBranch Automation

Database server-loweCommerceSuper Computing ClustersSW DevelopmentWeb HostingBranch AutomationInfrastructure

Maturing

Leading Edge

FirewallPrint/FileWeb Servere-mail




IBM Internal Use of Linux

1100+ Production Servers WW

Internal Linux Projects:

www.ibm.com/linux & w3.ibm.com/linuxredundant xSeries Linux servers

Intranet search enginexSeries servers; Inktomi search engine

IGS Internet Vulnerability Security Scanning61 xSeries scanning 30k IP addresses/ week

Performance monitoring24 xSeries servers75% fewer Linux servers than NT servers for same workload

IBM Global e-Mail Anti-virus ManagementxSeries scans incoming/outgoing mail for viruses

300mm Wafer Manufacturing Equip. ControlMuch more reliable than Win2000159 xSeries; 300-400 by year end


The Future of Linux and Open Source

“...the Linux philosophy is ‘laugh in the face of danger’. Oops. Wrong one. ‘Do it yourself’. That's it.” -Linus Torvalds

“Linux, which is right next door, and which is not a business at all. It's a bunch of RVs, yurts, tepees, and geodesic domes set up in a field and organized by consensus.” -Neal Stephenson, In the Beginning was the Command Line


Linux Kernel Version Timeline96 97 98 99 00 01 02 03 04 05

v2.2.22

FF

v2.4.20

v2.2.23

v2.0.39

v2.5.54

v2.1

v2.2

v2.3

v2.4

v2.5

v2.6

v2.7

v2.8

v2.0

Stable source tree Development source tree Estimate/projection


Key v 2.5/2.6 Features• Block I/O subsystem rework/enhancements:

for better performance, scalability and device support

• Scalability improvements 16-way SMP scalability on x86 (higher on other

architectures) O(1) scheduler, improved locking, synch

primitives, IO scheduler improvements, interrupt processing, per-cup page lists, etc

• CIFS VFS: Common Internet File System• LSM: Loadable Security Modules

infrastructure for configurable security policies and authentication

• SCTP important for CGL and for eSDC networking

requirements• IPv6

testing and new test development, bug fixes, reliability stabilization, new functionality, interoperability improvements

• IPSec• IPv4

TCP serviceability, stabilization and performance improvements

• PCI Hot Plug DD’s• NUMA

topology infrastructure, performance enhancements

Process affinity

• Large Block I/O• Read-Copy-Update synchronization primitives• readv/writev raw I/O and O_Direct • Scalable SMP Aware Timers• Async I/O• Futexes• CPU Hot Plug boot code• Driverfs SCSI Device Support• PowerPC64 architecture support• NPTL• NGPT kernel prereqs

POSIX threading support for signals Exploit of futex for shared mutex

• NAPI (improves nw dd performance)• Removal of 2TB block device limit

Up to 16TB on 32-bit archs and up to 8EB on 64-bit archs

• In kernel module loader• Large page support• FS enhancements

Ext3, JFS, XFS, Reiser, CIFS, smbfs, NTFS, AFS POSIX ACLs and EAs

• Kernel pre-emption• NFS v4 (client and server), and NFS over TCP• New Kernel build system• X86-64 (AMD) architecture support


Native Posix Thread Library (NPTL)

http://developer.java.sun.com/developer/technicalArticles/JavaTechandLinux/RedHat/

http://people.redhat.com/drepper/nptl-design.pdf


v 2.7/2.8 Candidate Features

• Dynamic memory add/remove• SCSI Multi-Path I/O• Event Logging• Online diagnostics• User space get time of day• Infiniband• NUMA API• MobileIP• 32-SMP Scalability on x86 (and higher on other

architectures)• Bug fixing, performance improvements, testing, …


Netcraft server statistics


• Thank you• Q&A

linux in the enterprise

Documents