Foundation for an agile IT Infrastructure:
Building the ultimate database container
with
Red Hat Enterprise Linux, MySQL, and
Virtualization
Security Agility Reduced Cost
Jan Mark Holzer
[email protected]Consulting Engineer
Emerging Technology Group
CTO Office
Outline
• What is virtualization and how can it help
• Red Hat Enterprise Linux 5 & Virtualization
Red Hat Enterprise
• Database Appliances Linux
• Use Models and Deployments
• Q&A
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 2
Why virtualization ?
It’s fun.
It gets a lot of papers published.
It’s going to change everything. Eventually.
But the customer benefits boil down to just two things…
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 3
Customer Benefits
Virtualization can help to manage cost
Virtualization enables distributed, automated system management
Virtualization allows resources to be managed as abstract entities
Independent of physical instantiation, location – even existence
Physical servers host multiple virtual servers
Virtual servers are objects that hide underlying complexity
Presents a common interface and architecture
Simplifies OS and system maintenance
Hardware abstraction
Virtual resources can be allocated and managed dynamically
Enables more efficient use of existing resources
Manage such things as cost, QoS, power,floor space, cooling and security
Enhances scalability while controlling costs
Virtualization is the fundamental enabling technology for utility computing
and utility services, both of which will reduce costs
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 4
Customer Benefits
Virtualization can help to manage risk
Virtual servers run in secure compartments
Isolation is comparable to separate physical servers
Failures, even user and kernel errors, cannot propagate to other virtual servers
Individual applications can be mapped to separate virtual servers
Enhances security and separation
Avoids application incompatibility problems
Separation of virtual and physical resources facilitates availability
Transparent hot-swap component replacement and upgrades
Live virtual server migration for load management and maintenance
Low-cost redundancy
Virtualization provides a risk buffer for capacity planning
Under-provisioning to reduce expenses
Over-provisioning to ensure adequate capacity
Dynamic resource management can mitigate these risks
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 5
Example: Data Center Dilemma
Data center has physical constraints
Fixed sized, fixed power, fixed cooling, etc
Often physical constraints are cost prohibitive to change
Data centers have excess capacity
Volume servers (Intel ISS) 10-15% utilized, mid / high 30-40% (>4 socket)
Customers comfortable with single application server
One application per OS instance – optimal unit of management, control, etc.
Application stacking to consolidate on a single OS viewed as higher risk and
often more expensive
Need a new service, deploy a new server / storage (ie VM warehouse model)
Dilemma
Can no longer afford current paradigm
Can’t afford the $10 million server or storage controller that translates into
a new data center or expansion
Can’t afford continual increase in number of administrators or cost / time to
deploy new services
Can’t afford power and thermal management
e.g. Annual electric bill for Google’s 200K servers greater than cost of
all server hardware
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 6
Example: Server & Storage Virtualization
Multiple Views
One or more applications per view
One OS per view
Multiple OS versions per server
Enable transparent migration of services between hardware instances –
blades, enclosures, etc.
Benefits
Increased hardware utilization
Avoid the $10 million dilemma
Reduced time to deploy new services
Don’t need to purchase new server / storage to deliver
Use views to validate service on existing hardware while maintaining
complete isolation and protection
Reduced cost
Fewer servers to buy / manage
Lower software licensing
Per core rather than unit of work / value delivered
Few administrators
Decouple hardware evolution from software
No longer legacy software constrained
Virtualization provides legacy view
Change customer control point
Virtual and physical management infrastructure drive customer purchase
decisions
Motivated to upgrade to virtualization-capable hardware and software
De-motivated to migrate to competitive offerings
Those that establish beachhead will be more difficult to displace
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 7
What is Virtualization?
Multiplex one machine into different “Virtual Machines” VMs; allows running different
isolated guest Operating Systems with different applications on same physical
hardware.
Allows a “Guest” OS to run
under control of a supervising Hypervisor/VMM
master program that is called: Hardware
“Hypervisor” or “Virtual Machine Monitor (VMM)”.
Hypervisor / VMM Functionality:
Virtualizes System Resources
Provides Scheduling of host/guests
Intra-guest communication
Common grounding
'Host' also often referred as 'dom0' and/or HyperVisor
'Guest' also known as 'domU'
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 8
Red Hat Enterprise Linux Overview
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 9
Red Hat development model
• Collaboration with partners and open source contributors to develop
technology
• Deliver complete distributions in two stages for two users
− First stage
• Fedora: The development vehicle
• New versions approximately twice each year
• Unsupported
• Fast moving, latest technology
− Second stage
• Red Hat Enterprise Linux
• New versions approximately every 18 – 22 months
• Supported and certified
• Stable, mature, commercially
focused technologies
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 10
What's new in Version 5?
• Enterprise Linux Advanced Platform
• Integrated virtualization
• Industry leading performance and price/performance
• Enhanced and easy to use security
• Improved networking and interoperability
• Enhanced development tools
• New SLAs
• Enhanced client
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 11
Red Hat Enterprise Linux Overview
2005 2006 2007 2008 2009 2010
RHEL 2.1
RHEL 3
... U7 U8 U9
RHEL 4
U3 U4 4.5 4.6 4.7 4.8
RHEL 5
RHEL 4.5 released May 2nd
5.1 5.2
Lengthened release cycle to avoid schedule overlap.
Support of RHEL4 para-virt guests on RHEL5. RHEL 5 released March 2007
Extended full support phase of approx. 3 years Virtualization and Advanced Platform
RHEL 4.6 in November. intergation
Final bug-fix-only release, similar to 3.9 in August Selinux enhancements
'08. New cluster management infrastructure
GFS2 , Statless Linux technology preview
RHEL 3 in transition from Full Support to Maintenance
mode.
RHEL 6 no schedule yet for next major release
Final bug-fix-only update 9
Planning driven by customers, partners and
Improved para-virtualized drivers planned.
technology
Fedora 7 released and Fedora 8 in planning
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 12
RHEL Virtualization Roadmap
2007 2008 2009 2010
RHEL 5
5.1 5.2
RHEL 5.2
Large System Support
NUMA
Memory
RHEL 5.1 Nested Page Table
RHEL 5.0 GA
Core Virtualization. HVM Improvements support planned.
Para-Virt RHEL on Performance Path for CIM support
RHEL, (Hot-) Migration on top of libvirt.
32/32, 64/64 bit, 32 on 64 bit para- Virtual Desktop
x86 virtualized.
& x86_64 Dom0 KDump
Libvirt IA64 Support
Libvirt enhancement Post-RHEL 5.1
management Para-VIrtualized
RHEL 5 guests Security
RHEL 4 guests with drivers for HVM RHEL 3,
later 4.
4.5+ Para-Virtualized
drivers for Windows.
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 13
Red Hat Enterprise Linux 5: Product summary
• Servers:
− Red Hat Enterprise Linux Advanced Platform for mainstream
customers
• Unlimited server size and virtualization capabilities
• Maximum flexibility and value
− Red Hat Enterprise Linux available for
small environments
• Clients:
− Red Hat Enterprise Linux Desktop
− Workstation and Multi-OS
options for special environments
− High volume security and manageability
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 14
Red Hat Enterprise Linux 5 Advanced Platform
• Extends the base product to provide a complete solution for
virtualized environments
− The ideal solution for the mainstream customers
• Advanced Platform provides
− Integrated server and storage capabilities
− Unlimited guest operating systems
− Guest migration with consistent storage
− Application migration*
− Cluster Logical Volume Management &
Global File System*
− Seamless expansion across multiple systems
− Enhanced management capabilities
− Easy transition for Red Hat Enterprise Linux AS customers
• Provides significantly greater capabilities
* Previously offered as separate layered products:
Red Hat Global File System and Red Hat Cluster Suite
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 15
Red Hat virtualization architecture
• Physical computing and storage components provide a central pool
of resources
• Virtual systems with appropriate compute, memory, and data can
be dynamically allocated, provisioned, and managed
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 16
Development Approach
• Requirements: Stability, reliability, effectiveness
• Release focus is on foundational elements
− Innovation rate is high in virtualization technologies
− Stable platform with stable APIs for easy enhancement
• Support for x86, x86_64, UP and SMP at GA
− Support for IA64, PPC tech preview in RHEL5 GA
• Focus is on foundational elements
− Priority is to deliver hooks, APIs to enable continued development of rich management &
monitoring tools
• At a minimum, will include:
− libvirt – local Virtual Machine (VM) management API
• create, destroy, start, stop, suspend, resume
• basic support for hot and cold migration
− iSCSI, GFS2 (tech preview in RHEL5 GA), NFS containers
− Virtual block, network
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 17
libvirt: Stable and Open API
Management of hypervisor(s)
Hypervisor agnostic
Stable API for application developers
Isolation from Xen HV instability
Isolation from XenD protocol changes
Formalized error reporting/handling
XML definitions for Vms
Distributed in FC4/FC5/FC6/F7/RHEL5/Debian/OpenSolaris
Core API in C, Python/Perl bindings
CLI access via virsh
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 18
Database
Appliances
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 19
High Level Xen Architecture
Domain 1 Domain 2
Domain 0
Front end Front end
Back End
Device Driver Virtual CPU &
Memory
Hypervisor
Hardware
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 20
MySQL Database Appliances
• Virtual Appliances
− One or more virtual machines packaged and tailored for distribution
and deployment
− Pre-defined function and packaging
− Pre-configured and optimized for specific use case
• MySQL and OS configuration/tuning
• Benefits of appliances
− Ease of Installation, configuration and deployment
− Tested as a whole by vendor/supplier
− Can be easily replicated
− Long term storage and archival
− Hardware agnostic and independence
− Application isolation (performance, security)
− Dynamic workload management
− Ability to move workloads online throughout the environment
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 21
MySQL Database Appliances
• Dynamic Management of Virtual Appliances
− Integrated Virtualization will allow use of live migration and/or failover to
relocate/move appliances throughout the infrastructure
− Live migration automatically used by underlying clustering framework
− Can trigger relocation/movement via scripts/API
− Dynamic (re)allocation of resources based on workload needs
• Hot-add of virtual CPUs
• Resizing of memory footprint
• Add I/O and network capacity on demand
• “Dixie Cup” model for deployments
• Automated provisioning based on profiles
− Fast recreation of VMs for DR/DT
− Quick (re)provisioning of new/additional appliances
• Agnostic to underlying hardware infrastructure (storage, server, network)
− Can move between different hardware vendors and processors
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 22
Virtual SMP combined with
sub-CPU granularity
All available in one offering on RHEL5
Virtual machine scalability and Higher resource utilization
VMn == domUn
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 23
Memory ballooning
Guest can be configured to balloon/grow their current memory
footprint
Allows for online expansion and growth
Can use virt-manager or CLI interface for management
VMn == domUn
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 24
Memory ballooning
Growing guest VM2 to 1GB using memory ballooning
Now both guests have increased their available memory online
Resize database SGA
Increase available VM for applications etc...
VMn == domUn
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 25
I/O virtualization
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 26
Dynamic I/O Sharing
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 27
Dynamic Network I/O Sharing
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 28
High
Availability
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 29
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage
Gues
t Guest running as a RHCS service
Guest 1 Guest X
Guest 2
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 30
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage
Gues
t Guest running as a RHCS service
Guest 1 Guest X
Guest 2 Automatic failover upon Hypervisor failure
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 31
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage
Gues
App
t Guests running as independent cluster
Guest 1 Guest X
Guest 2
Hypervisor clustered via RHCS
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 32
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage
App
Guests running as independent cluster
Guest 1 Guest X
Guest 2
Hypervisor clustered via RHCS
Application failover upon hosts/guest failure
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 33
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage
Gues App
t Guests running as independent cluster
Guest 1 Guest X
Guest 2
Hypervisor clustered via RHCS
Application failover upon hosts/guest failure
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 34
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage
App
Guests running as independent cluster
Guest 1 Guest 2 Guest X
RHEL5
Guest X
Host C
Hypervisor and bare metal host clustered via RHCS
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 35
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage
Guests running as independent cluster
Guest 1 Guest 2 MySQL can migrate to another Guest/VM Guest X
RHEL5
Guest X
Host C
Hypervisor and bare metal host clustered via RHCS
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 36
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage
Guests running as independent cluster
Guest 1 Guest 2 Guest X
RHEL5
Guest X
Host C
MySQL can migrate to a bare metal system
Hypervisor and bare metal host clustered via RHCS
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 37
RHEL5 Disaster Recovery
RHEL5 RHEL5
Site A Site B
Shared
Storage
Guest 1 Guest X
Guest Guest
Image Image
Guest 2
Guest Guest
Image Image
Guest Guest
Image XP/CA, EVA/CA Image
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 38
RHEL5 Disaster Recovery
RHEL5 RHEL5
Site A Site B
Shared
Storage
Guest 1 Guest X
Guest Guest
Image Image
Guest 2
Guest Guest
Image Image
Guest Guest
Image Image
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 39
RHEL5 Disaster Recovery
RHEL5 RHEL5
Site A Site B
Shared
Storage
Guest X
Guest Guest 1
Image
Guest 2
Guest
Image
Guest
XP/CA, EVA/CA Image
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 40
Solving real business problems
Live Migration
Virtual Machine relocation enables
High Availability:
machine maintenance
Load Balancing:
statistical multiplexing gain
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 41
Consider the possibilities...
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 42
Resources
• MySQL
− http://www.mysql.com/
• Red Hat
− http://www.redhat.com/
• Virtualization Infocenter
− http://www.openvirtualization.com/
• libvirt
− http://www.libvirt.org/
• virt-Manager
− http://virt-manager.et.redhat.com/
• Red Hat Cluster Suite
− http://www.redhat.com/solutions/gfs/
• Red Hat Emerging Technology Group
− http://et.redhat.com/
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 43
Questions?
Thanks
Jan Mark Holzer
[email protected]
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 44
Advanced Platform benefits
• Designed for mainstream customers who seek the advantages of
virtualization without complexity or risk
• Provides a full virtualization infrastructure in one complete package
• Eliminates the need to create a solution using multiple products
from different vendors
• Reduced solution cost
• Reduced deployment time
• Integrated installation and
management
• Extensive documentation
• Training services
• Installation and maintenance services
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 45
