Introduction to IBM
InfoSphere Optim Solutions
IBM InfoSphere Optim v11.3
© Copyright IBM Corporation 2016
Course materials may not be reproduced in whole or in part without the written permission of IBM.
Unit objectives
• Describe the available InfoSphere Optim Solutions and how they fit
into Enterprise Data Management
• Describe the InfoSphere Optim architecture components
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Overview of IBM
InfoSphere Optim
Solutions
After completing this topic, you should be able to:
• Describe the InfoSphere Optim Solutions.
• Explain how InfoSphere Optim Solutions support enterprise
environments.
• Describe what is included and what are add-ons for
InfoSphere Optim Solutions.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Optim is designed for the enterprise (1 of 2)
• InfoSphere Optim Data Growth Solution (Archive):
Improve performance.
Manage data growth, save storage.
Support retention compliance.
Streamline application upgrades.
Segregate historical data to a secure archive.
• InfoSphere Optim Application Retirement Solution:
Enable application retirement.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Optim is designed for the enterprise (2 of 2)
• InfoSphere Optim Test Data Management Solution:
Create targeted, right-sized test environments.
Subset, edit, compare test data.
Improve application quality.
Speed iterative testing processes.
• InfoSphere Optim Test Data Management Solution - Data Masking
Option:
De-identify confidential data.
Comply with privacy policies.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Optim enterprise architecture
Non Production Environments Production Environments
Subset & Mask Archive
JD Edwards
JD Edwards
PeopleSoft
PeopleSoft
OEM/ISV
OEM/ISV
Amdocs
Amdocs
Custom
Custom
Oracle
Oracle
Siebel
Siebel
SAP
SAP
Data Growth, Data Masking, Test Data Management, Application Retirement
IBM Optim
SQL Hadoop
Oracle DB2 Informix Sybase XML IMS VSAM Adabas DB2 z/OS Teradata Netezza
Server Hive
Windows XP/2000/7 Solaris HP/UX Linux AIX OS/390 z/OS iSeries
NAS SAN ATA CAS Optical Tape
Single scalable architecture provides central point to archive/extract, store,
restore, and protect (mask) application data records.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Optim captures related business objects across the
enterprise
• Referentially intact subset of data across related tables, databases,
applications, and systems, including metadata.
• Provides "historical reference snapshot" of business activity.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Archive/extract, store, and restore
• Archive/Extract:
Identify and archive/extract business objects across multiple related
applications, databases, and platforms.
• Store:
Store immutable business objects independent of infrastructure - any
hardware device or platform.
• Restore:
Restore complete business objects from any database, application, or
version to any other database, application, or version.
Choose exactly what items to restore - a single transaction record, a year's
worth of data, or any other range.
Migrate business objects seamlessly from any database, application, or
version to any other database, application, or version. De-sensitize test data
for privacy and regulatory purposes.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Universal access to archived data
• Access any record, any time, anywhere!
• Native application access. ERP
Applications
• Application independent access: More Options
Industry standard methods (e.g. SQL, ODBC / JDBC
XML
ODBC/JDBC, XML).
SQL
Portals. Excel
Access
Report writers (e.g. Cognos, Business
Objects, Crystal Reports, etc.).
Desktop formats (e.g. Excel, CSV, MS
Access).
Database formats.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
InfoSphere Optim Data Growth - Store in any environment
Current Active Online Offline
Data Historical Archive Archive
1-2 years 3-4 years 5-6 years 7+ years
Non-DBMS
Offline
Retention Platform
Retention Platform
Production Archive Reporting
Database ATA File Server
Database EMC Centera CD
HP RISS Tape
HCAP Optical
IBM Tivoli Storage
Manager
Compressed Compressed Compressed
Archives Archives Archives
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
What is included with
InfoSphere Optim Data Growth Solution?
• What is included?:
All Archive functions (archive, delete, restore,…).
• What is an extra-cost add-on?:
ODM (Open Data Manager to view archived files).
Optim Legacy (IMS, VSAM, Sequential).
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Optim Application Retirement Solution
• Preserve application data in its business context.
• Retire out-of-date packaged applications and custom legacy
applications.
• Shut down legacy system without a replacement.
Infrastructure before Retirement Archived Data after
Consolidation
User Application Database Data User
User Application Database Data User Archive Archive
Engine Data
User Application Database Data User
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
InfoSphere Optim Test Data Management Solution
Extract
Extract Files
Production DB or
Production Clone Load
Optim Insert / Update
Edit
Compare
• Create targeted, "right-sized" subsets
of data faster and more efficiently
than cloning. QA DB
• Edit data to insert special test cases. Dev DB
• Compare data to pinpoint and
resolve application defects faster. Test DB
• Easily refresh, reset, and maintain
test environments.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
InfoSphere Optim Test Data Management Solution - Data
Masking Option
A comprehensive set of data masking techniques to transform or de-identify data:
• String literal values. • Arithmetic expressions. • Lookup values (DM).
• Character substrings. • Concatenated expressions. • National IDs (DM).
• Random or sequential #s. • Date aging and currency • Credit Card #s (DM).
(DM).
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
What is included with
InfoSphere Optim Test Data Management Solution?
• What is included?:
Data Migration (extract, insert/load, create).
Edit.
Compare.
• What is an extra-cost add-on?:
Optim Legacy (IMS, VSAM, Sequential).
Data Masking Option:
− TRANS functions for social security numbers (SSN), credit card numbers (CCN)
and Email.
− Date aging (AGE).
− LOOKUP functions.
− FILL and SHUFFLE functions.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Review: Optim Solutions available
• IBM InfoSphere Optim Data Growth Solution.
• IBM InfoSphere Optim Application Retirement Solution.
• IBM InfoSphere Optim Test Data Management Solution.
• IBM InfoSphere Optim Test Data Management Solution - Data
Masking Option.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Suggested readings
• IBM Redbook:
Implementing an InfoSphere Optim Data Growth Solution
http://www.redbooks.ibm.com/redbooks/pdfs/sg247936.pdf.
• White Papers:
Anatomy of an Archiving Project: Seven Principles for Managing your
Enterprise Data
https://www14.software.ibm.com/webapp/iwm/web/signup.do?lang=en_US&
source=sw-infomgt&S_PKG=500007061.
• Data lifecycle management strategies - The importance of the
complete business object:
https://www14.software.ibm.com/webapp/iwm/web/signup.do?lang=en_US&s
ource=sw-
infomgt&S_PKG=500028427&S_CMP=Optim_data_lifecycle_management_st
rategies_wp_lib.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Optim Architecture
After completing this topic, you should be able to:
• List the components of an Optim Solution.
• Explain the purpose of each of the components.
• List the environments and databases that are
supported by Optim.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Physical components
Optim Server
Optim Directory
Optim
Workstation
Optim
Data Growth.
TestInfoSphere
Data Management
and
Optim
Data Privacy
Solutions
Source Data Growth Optim Archive
Database
Destination Optim ODM
Database
Application
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Optim solution components
• Optim Directory and Extended Optim Directory - Central location that
contains all service information for services that are in development,
test, or production.
• Optim Workstation - Installed on Windows platform with database
client software to access the Optim Directory and all application
databases for archiving.
• Optim Server - Runs the resource-intensive data processing functions.
• Optim Distributed - Software that is used by Optim Designer and
Manager on LUW.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Minimum hardware requirements (1 of 2)
• Optim Workstation:
Intel (e.g. Intel Pentium i5, i7).
1-2 Cores.
1.7 GHz minimum.
2 GB RAM.
1 GB disk for Optim Software installation.
Minimum of 10base-T network connection.
Minimum one Dual Port Fiber Channel Card
−4 GB or 8 GB for SAN
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Minimum hardware requirements (2 of 2)
• Optim Server:
Minimum 2-4 cores, recommend more based on workload.
2.0 GHz minimum, recommend fastest processor speed.
2-4 GB RAM per CPU Core.
1 GB disk space for Optim Software installation.
Minimum one 100 Mbit Network Interface Card (NIC)
− recommend 1 GBPS with TCP/IP connectivity networked on an enterprise class
network, like LAN operating at 1000 MBPS.
Minimum one Dual Port Fiber Channel Card, 4 GB or 8 GB for SAN.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Supported platforms
• AIX: 5.3, 6.1, 7.1.
• Red Hat Enterprise Linux: 4, 5, 6.
• SUSE Linux Enterprise Server: 9, 10, 11:
Open Data Manager (ODM) not supported.
• Solaris: 9, 10.
• Windows: XP, Vista, 7, 2012 R1, Server 2003, Server 2003 R2, Server
2008, Server 2008 R2.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Optim Directory support
• DB2 for Linux, UNIX, and Windows: 9.5, 9.7, 10.1, 10.5.
• Oracle: 11gR1, 11gR2, 12c.
• MS SQL Server: 2008 R1, 2008 R2, 2012 R1.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Native databases supported
• DB2 for Linux, UNIX, and Windows: 9.5, 9.7, 10*, 10.1*,10.5*.
• DB2 for iSeries: 5.3, 5.4, 6.0, 7.0 (* InfoSphere Federation Server
used for connectivity).
• DB2 z/OS: 8.1, 9.1, 10.1, 11.1*.
• Informix Dynamic Server: 11.0*, 11.5*, 11.7*.
• Oracle: 8.1.7, 9.2, 10.1, 10.2, 11gR1, 11gR2, 12c*.
• Postgre SQL: 9.2, 9.3.
• SQL Server: 2000, 2005, 2008, 2012*.
• Netezza: 6.0.3, 7.x*.
• Sybase: 15, 15.5*, 15.7*.
• Teradata: 2.6.2, 12,* 13*, 13.10*, 14*, 14.10*, 15*.
* Toleration support
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Federated and non-relational data sources
• Federated data sources:
InfoSphere Federation Server
− DB2 for iSeries.
− ODBC data sources.
Oracle DG4ODBC
− ODBC data source.
• Non-relational data source:
Middleware with Optim Connect
− Flatfile (Linux, UNIX, and Windows), RMS on VAX, RDB on VAX, Flat file on VAX,
Tandem, Enscribe on Tandem, Cache.
InfoSphere Federation Server and Classic Federation
− IMS, VSAM, Sequential, Datacom, IDMS, Adabas.
InfoSphere Federation Server and Optim Connect (on z/OS)
− IMS, VSAM, Sequential, Adabas.
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
High-Level Architecture
• Server name: Server
address or name.
• DB alias: Connectivity
via DB Client software.
Optim
• Work directories: Workstation Enterprise storage
( EMC Symmetrix )
Server file system. Server
• Storage profile: name
Storage and retention
policy.
Storage
Archive
profile
Document storage
(DR550 Centera)
Optim Server
DB Source and
Destination DB alias
Temporary
Data
… Auxiliary storage
(For example: tape)
Optim Directories
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Simplest configuration
• Optim operates as a client application with processing on the
Windows workstation.
Windows workstation -
DBMS client that is required
to access remote DB
Optim
workstation/server DBMS Server
SHARED NETWORK
All Optim data flows
over shared network
along with other traffic
Other workstations
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Optim Server that is installed on LUW DBMS Server
• Optim Workstation defines tasks and directs resource-intensive data
processing tasks to the Optim Server.
LUW Server
Windows workstation
DBMS client that is required to access remote DB
Optim workstation Optim Server / DBMS Server
SHARED NETWORK
Most data stays within the Optim Server /
DBMS Server.
Minimum flows over the shared network.
Other workstations
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Separate Optim Server and LUW DBMS Server
• Tasks must be defined on Optim Workstation; processes can be
initiated from Optim Workstation or on Optim Server by using the
Command Line interface.
LUW Server -
Windows DBMS client that is
workstation - required
DBMS client
required to
access remote
DB
Optim workstation Optim Server DBMS Server
SHARED NETWORK
Minimal Optim
data flow
over the shared
network Most data flows between
the DBMS Server and the
Optim Server
Other workstations
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Optim data-driven engine
• Technology to define, extract, and access referentially intact subsets of
related data from cross-platform relational database management
systems.
• Two types of models from the tables and relationships in Access
Definition:
A model of the data flow (the schema), which is used to archive/extract
data.
A referentially intact model, which is used to restore and purge data.
Optim
Optim Test Data Optim
Test Data Management Data
Management with Data Growth
Masking
Data-drive Engine
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016
Unit summary
• Describe the available InfoSphere Optim Solutions and how they fit
into Enterprise Data Management
• Describe the InfoSphere Optim architecture components
Introduction to IBM InfoSphere Optim Solutions © Copyright IBM Corporation 2016