Forrester Open Source Databases
Forrester Open Source Databases
EXECUT I V E S U M MA RY
Open source databases continue to make inroads into enterprises, offering more robust, high-
performance, and advanced DBMS features and functionality as enterprises look for low-cost solutions.
More enterprises are deploying open source databases than ever before, with many looking at mission-
critical deployments in the coming years. And with more than five viable open source database products
available, enterprises now have more flexibility in choosing one that meets their requirements. More
vendors are gearing up to offer comprehensive support and services to meet the growing demand. The
future of open source databases remains bright, with products expanding to include advanced features
and continuing innovation, in addition to enabling evolving technologies like XML, Web services, and
content management. All enterprises should consider open source databases as part of their overall
DBMS strategy to benefit from potential cost savings, starting with small application deployments.
TABLE O F CO N T E N TS N OT E S & R E S O U R C E S
2 Open Source Databases Have Become More Forrester interviewed 10 user companies and
Viable five vendors, including: Computer Associates
8 The Current State Of Open Source Databases (CA), IBM, MySQL, PostgreSQL, and Sleepycat
Is Healthy Software.
© 2004, Forrester Research, Inc. All rights reserved. Forrester, Forrester Oval Program, Forrester Wave, WholeView 2, Technographics, and
TechRankings are trademarks of Forrester Research, Inc. All other trademarks are the property of their respective companies. Forrester
clients may make one attributed copy or slide of each figure contained herein. Additional reproduction is strictly prohibited. For additional
reproduction rights and usage information, go to www.forrester.com. Information is based on best available resources. Opinions reflect
judgment at the time and are subject to change. To purchase reprints of this document, please email [email protected].
2 Tech Choices | Open Source Databases Come Of Age
The Open Source Database Market Is Small, But It’s Growing Rapidly
While open source databases represent only a fraction of the $10 billion overall market for
new DBMS licenses, the market potential is huge in the areas of support and services. As
more enterprises start to use open source databases over the coming years, the demand for
24x7 technical support will increase and so will the need for services to help with planning,
migration, and tuning initiatives. We estimate that the current open source database market
— comprising new licenses, support, and services — is about $120 million; this figure is
likely to grow to more than $1 billion by 2008. More ISVs will jump on the open source
bandwagon to offer support and services over the next one to two years.
1970
Ingres created
1975
· Low acquisition cost. Commercial enterprise DBMS licenses currently cost an average
of $25,000 per processor, so this can add up to a significant budget item, especially
when deployed for hundreds and thousands of databases across the organization. With
open source databases, enterprises experience dramatic savings over new DBMS licenses.
· Strong support from the community. Open source is all about the community,
tapping into hundreds and thousands of developers, contributing to increased
reliability, robustness, and low-cost deployment. Most enterprises using open source
databases claim to have very good support from the community, with responses
provided by actual developers rather than by support personnel, as is often the case
with commercial DBMSes.
· Lower support and maintenance costs. The annual maintenance costs for DBMSes
often run high for many enterprises. Although open source databases can lower
acquisition costs, they may not lower lifetime data management costs. Administrative
support, migration, and upgrade efforts are often the same regardless of whether or not
open source or commercial DBMSes are deployed.
· More hardware and software choices. With open source databases, enterprises often
have more flexibility in choosing the hardware and operating system platform that
meets their business and technological requirements. Unlike Microsoft SQL Server,
open source databases can run on a variety of operating systems, including Linux,
Windows, and several flavors of Unix. However, the value of this flexibility is somewhat
offset by the advantages SQL Server can provide in tighter integration with the
Windows operating system.
· Access to source code. Enterprises that need to support complex applications often
find that open source databases offer greater flexibility in application integration by
allowing developers to change source code when necessary. This can be particularly
desirable when the database is deployed along with the application, with a common
install.
· Less database vendor lock-in. With open source databases, there is no need to fear
that a DBMS vendor might cease to exist or change its strategy. The major open source
databases are supported by more than one vendor, and enterprises always have access
to source code. This ensures long-term protection, although the cost of dealing with
the worst-case scenarios must also be considered as part of the risk profile.
· Support quality. Although open source support is improving, it’s still not comparable
to commercial DBMS support. Commercial DBMSes have always offered high-quality
24x7 support for enterprises, surpassing the best level of support offered by open
source databases, although this is beginning to change. Many open source database
vendors are gearing up to offer higher-quality support and improved, searchable
knowledge bases. Large vendors will offer even more support options and services over
the next two years.
· Support for packaged applications. Although there are not as many packaged
applications supported for open source databases, the number continues to grow and
should largely eliminate this concern over the next two to three years. Many large ERP,
CRM, and other business application vendors are considering supporting open source
databases because of the growing market. Some are also building their own open
source stacks to ship along with their applications.
· Security. All database products, whether commercial or open source, are vulnerable,
largely because a DBMS is a complex piece of software. Many commercial DBMSes
have experienced several security vulnerabilities over the past few years. Enterprises
remain concerned about the security and reliability of open source databases, given
that source code is easily available to any hacker. While this is true, it is at least partly
offset by the larger community of the open source initiative driving the product to
undergo a rigorous review to ensure robustness and reliability. Having access to the
open source database source code also reduces anxiety about whether the vendor will
exist in the future, helping to ensure long-term protection, although in some cases,
source escrow programs for commercial DBMS provide the same benefit.
· Web-based applications.
· Small to midsize transaction-processing applications.
· Small to midsize data warehouses and data marts.
· Scientific applications like DNA sequencing or seismic analysis.
· Reporting databases.
· Directories and email repositories.
· Data repositories.
· Commercial DBMS prices will fall. DBMS vendors continue to feel competitive
pressure from open source DBMSes and are likely to lower prices over the next 12
to 24 months in an effort to directly compete with them. The current impact of open
source databases is in the low-end market, but it will expand into the mid- and high-
end markets over the next three to five years. Earlier this year, Oracle reduced its
pricing for entry-level DBMS products, and other vendors are likely to follow suit
in one to two years. Other likely competitive responses include incorporating open
source technology into the vendor’s own offering, especially for vendors like IBM that
already embrace open source in other areas.
· Some vendors will adopt a free database strategy. Sybase recently announced a free
version of its Adaptive Server Enterprise (ASE) product on Linux; its free ASE has
attracted some customers but, because of usage limits, will likely fall short of customers’
expectations. Its limitations include a maximum 2 GB database size, one CPU server,
and 2 GB of memory. More vendors will adopt this strategy in an effort to attract new
customers, but these vendors will set higher limits.
· Commercial DBMSes will have to innovate to retain customers. The features gap
between open source databases and commercial DBMS products is narrowing. While
commercial DBMSes offer hundreds and thousands of database features, we estimate
that only 40% of such features are typically needed by enterprises. This is one of the
reasons why open source databases have become attractive; open source databases
provide the basic database features and functions that most applications need. But
commercial DBMS vendors will add highly innovative new features to retain large
enterprise customers.
We conducted a Forrester Wave™ evaluation of the five key open source database products,
namely Berkeley DB, Cloudscape, Ingres, MySQL, and PostgreSQL. We compared these
tools in a number of areas, including transactional capability, security, market presence,
and data warehousing capability, standards, and support (see Figure 2). Our findings:
· MySQL remains the most widely used but lacks some key features. MySQL
continues to have a very high adoption rate across several industries and is known
for its reliability, ease of use, and performance. It is a full, relational DBMS, and it
supports row-level locking and deadlock detection functionality. However, it lacks
some key DBMS features, such as triggers, stored procedures, and views, which are
likely to be available in Version 5. These features are likely to boost MySQL to even
higher adoption rates and may open doors for support for more packaged applications
and tools. At present, there are many large enterprises that run MySQL to support both
mission-critical and non-mission-critical applications.
“We have more than 20 MySQL production databases supporting our mission-critical
applications. Basically, we depend on it. MySQL is the back end for our Web site, which
gets more than 30 million hits a day. We are satisfied with the performance, availability,
and support with MySQL. Besides, it saves us lots of money over commercial DBMSes
like Oracle.” (Online community Web site)
Ingres
PostgreSQL
MySQL
Cloudscape
Berkeley DB
Current
offering
Weak
Weak Strategy Strong
Source: Forrester Research, Inc.
“We use MySQL extensively in our environment. For our Web site, which has more
than 6 million unique visitors per month, we track all events created by user activity
and store the state and session in MySQL. We also use MySQL to track the emails
that we send out each week in a large data warehouse that has more than 300 million
rows. MySQL doesn’t have some of the advanced features that Oracle has, but it meets
our business requirements. Our application is mainly written in Java and some PHP/
Perl. The MySQL community is very active, so getting support and guidance has been
very effective. MySQL is easy and flexible to work with; we can get MySQL and our
application running very quickly.” (Entertainment company)
“We looked at MySQL and Oracle at the very beginning and found that MySQL was a lot
easier to configure, set up, and run, even though we had experience with Oracle. With
Oracle we often had to hire an outside consultant to come to help with administration;
with MySQL we never had to. MySQL has not only saved us money on licensing fees,
but it also made our databases easier to manage. Adopting MySQL has been one of the
better decisions that we have made. We do not see any limitations with MySQL DBMS
for our application.” (Online retailer)
“We have not changed the source code of MySQL for our application, but being able to
review it is incredibly valuable to us. It is a lot easier to troubleshoot with open source
than to go to commercial support all the time. We are always looking to deploy more
applications with MySQL because it’s easy to use, it’s flexible, and it saves us money.”
(Entertainment company)
· Ingres raises the bar for open source databases with expanded features. Ingres is the
most complete open source relational database. It has been around for more than two
decades and is well known to have advanced enterprise-class features and reliability
on par with many commercial DBMSes. CA recently made Ingres open source in an
effort to make Ingres more visible and grow CA’s services and tools business. With
Ingres going open source, the bar for features, functionality, and support is certainly
higher for open source databases. CA’s move to open source Ingres might trigger other,
smaller, commercial DBMS vendors to follow suit, especially for their slow-moving
database products.
“Ingres has been our primary database platform for the past 10 years. We have a large
subscription system that processes information about members who need to access
airport lounges across the world. This application is running on a Linux/Red Hat
environment. We wanted an enterprise database that was affordable to us; we invited
Oracle to give us a quote, and it was laughable. Ingres R3 is a lot easier to install and
use, and because it’s an open source product, more vendors are likely to offer plug-ins
into their tools and applications, which will broaden the market. With Ingres you get
an enterprise database at a very low cost.” (Travel services company)
“We’ve deployed Ingres for several in-house applications, including for a report server.
We have been using Ingres for more than nine years, and we are pleased with its
performance, reliability, and enterprise-class functionality. Our report server, which
tracks information from various stores, is around 750 GB in size and growing. While
the number of users is not high with the report server, we load more than a million
transactions a day on it. We also use Ingres for the general ledger mission-critical
application that has close to 250 concurrent connections. Our business depends on
Ingres to support our critical applications.” (Retail company)
While there aren’t many customers using Cloudscape, IBM has used the technology
quite extensively to support more than 70 projects, including WebSphere, Tivoli, and
Lotus Workplace. For customers that outgrow Cloudscape/Derby and wish to upgrade,
IBM offers a full upgrade path to DB2. Potential uses of Cloudscape include support of
Java applications for data repositories, directory services, and Web-based applications.
Besides Java, Cloudscape also supports .NET programming environments using the
ODBC interface. IBM offers an optional 24x7 support for Cloudscape/Derby through
the IBM Cloudscape package.
· PostgreSQL has good features with moderate adoption. PostgreSQL and Ingres
share a family history; both were created by Michael Stonebraker and his grad students
at Berkeley. Because of this, PostgreSQL has strong enterprise DBMS features and
functionality. PostgreSQL is a full, relational DBMS with core transactional capability
like ACID properties and deadlock detection. It has many database features that are
essential for business applications, such as triggers, functions, BLOBs, and views. The
current version supports stored procedures using functions, but 100% SQL-syntax-
compatible stored procedures will be available in version 8.1.
“We are using PostgreSQL in production for our critical applications, including
running our Web site. PostgreSQL had all of the features and functionality that we
needed for our application, including embedded SQL and transactional capability. It
certainly has saved us money, besides giving us a high-quality database. The speed of
the PostgreSQL database has been phenomenal, besides being reliable and running
without any issues. The PostgreSQL Web site contains a lot of documentation and
FAQs that have been helpful.” (Entertainment company).
“We run real-time, mission-critical databases using PostgreSQL for our registry of Web
sites. PostgreSQL is the core of the application, and if it goes down, all registrations and
modification will cease. We found PostgreSQL very easy to administer; it conforms
to the best practices in the industry. PostgreSQL has a very rich set of tools that cover
broad areas from an end-user graphical tool to a command-line utility for experts.
PostgreSQL is a mature database; we run it every day supporting our mission-critical
applications. It has very good database features and supports high availability and
mission-critical usage.” (Internet company)
“We have been using Sleepycat Berkeley DB for the past two years for our enterprise
software. Our applications are becoming more complex, with SAN storage and
complex hardware infrastructure. We use the Berkeley DB to share information among
various applications related to resources. Berkeley DB is a small, easy, and fast database
that is critical for our product. We did not need complex queries or complex databases;
we just needed a simple and easy-to-use database with no administration requirements,
and Berkeley DB delivered that. We hardly ever use Sleepycat’s support because of the
product’s reliability. Although we have looked at the source code, we haven’t felt the
need to modify it.” (Technology company)
· Higher adoption and increased support for packaged applications. Open source
databases will continue to make inroads to enterprises that are looking for low-cost
DBMS alternatives in the future. We estimate that 30% of enterprises will be using
open source databases in production by 2008. More enterprise packaged applications,
such as ERP and CRM applications, will support open source databases over the next
two to three years.
· More features, automation, and innovation. In the near future, more open source
databases will support semistructured and unstructured data, along with advanced
data searching capability. Advanced automation of administrative tasks will roll out
in the areas of performance tuning, backup recovery, archiving, replication, patch
deployments, and upgrades. Some open source databases will lead in innovation to
offer highly advanced features for availability, performance, and reliability.
· Growing demand for robust, reliable, and cross-DBMS tools. As more enterprises
use open source databases for mission-critical deployments, the need for database
tools will grow. Enterprises will demand more cross-DBMS tools that support not only
their current portfolio of databases but also open source databases. More database
tools will be offered that will support high-end open source database deployments.
R E C O M M E N D AT I O N S
· Look for vendor support besides the community for critical applications. Many
vendors are offering highly improved 24x7 technical support coverage for open
source databases to meet the growing demand. Besides tapping the community
for support, enterprises should choose vendor support, especially when supporting
mission-critical database applications. Most vendors offer quick response for critical
issues, in addition to services around installation, tuning, and migrations.
· Plan for considerable effort for rip and replace, on top of high costs. Migrating a
DBMS to any product, whether commercial or open source, remains a complex effort,
especially for large applications. Ensure that planning is given utmost importance
when migrating. Also consider using tools that can help in the migration process, as
automation minimizes human errors.
· Standardize on one or two open source databases. Just as with commercial
DBMSes, firms should standardize on one or two key products to ensure lower cost,
manageability, and operational efficiency.
· Benchmark before deploying any large database. Most deployments of open
source databases are centered around small databases. To ensure performance and
scalability, consider benchmarking your application.
SUPPLEMENTAL MATERIAL
Online Resource
The underlying spreadsheet detailing the Forrester Wave in Figure 2 is available online.
Companies Interviewed For This Document
BMC Software PostgreSQL
Computer Associates Quest Software
IBM Sleepy Cat Software
MySQL Sybase
ENDNOTES
1
Forrester surveyed 140 large companies in North America to find out their open source plans.
See the March 16, 2004, Trends “Open Source Moves Into The Mainstream.”
2
Open source is cheap to acquire, but the integration, maintenance, and support costs can add up,
therefore enterprises should proceed after careful analysis of the benefits. See the March 16, 2004,
Trends “Open Source Moves Into The Mainstream.”
35650