4 Data Integration Technology

4.1 Oracle Data Integrator Enterprise Edition

Oracle Data Integrator Enterprise Edition is a comprehensive software package for enabling scalable data integration in heterogeneous data environments. Oracle Data Integrator Enterprise Edition is separately licensed independent of any Oracle Internet Application Server edition, Oracle Business Intelligence Server Enterprise Edition, or Oracle Business Intelligence Suite Enterprise Edition.

Oracle Data Integrator Enterprise Edition includes the following components:

• Oracle Data Integrator (ODI) — a heterogeneous platform for data integration that includes design time components for modeling and mapping, and run-time components for executing bulk data movement and transformation. ODI includes Job Scheduler Services, Changed Data Capture components, and a complete set of Knowledge Modules for access to an unrestricted number of Source technologies.

• Oracle Warehouse Builder Enterprise ETL — an enterprise-class data integration platform for the Oracle Database that includes design time components for modeling and mapping, run-time components for executing bulk data movement and transformation, and administration components for managing the metadata repository.

Oracle Warehouse Builder Enterprise ETL extends the Oracle Database ETL features and includes the following functionality:

• Accessing sources and targets

  • Native support for heterogeneous databases, including the definition of new platform types, JDBC connectivity, knowledge modules, and code templates

  • Change Data Capture mappings in ETL

  • Publishing and consuming web services, including integrating with process orchestration technologies such as Oracle BPEL Process Manager

  • Importing Cobol copybooks using the built-in wizard

  • Targeting XML files

• Working with dimensional objects

  • Creating slowly changing dimensions, types 2 and 3

  • Storing data in OLAP cube-organized materialized views

  • Defining orphan management policies

• Designing and executing ETL jobs

  • Right-time data warehousing utilizing queues and real-time mappings

  • Reusing and embedding mapping code with pluggable mappings

  • Specifying the load order of multiple targets in a single mapping

  • Partitioning and parallelizing updates to tables by utilizing the data chunking feature

  • Scheduling ETL jobs using the built-in Schedule interface

  • Using advanced process flows features (activity templates, use of the following activities: Assign, Set Status, For Loop, While Loop, Route, Notification, EJB, Java Class, and Webservice)

  • Designing mappings to handle complex types using the following operators: varray iterator, construct object, and expand object

  • Rapidly moving large amounts of data with transportable modules

  • Using spatial transformations and streams transformations

• Integrating with other products

  • Deploying metadata directly to Oracle Discoverer End User Layer

  • Deriving and deploying metadata to Oracle Business Intelligence Enterprise Edition

• Administering Warehouse Builder and its metadata repository

  • Managing environments, including promoting from development to test to production, using the multiple configurations functionality

  • Interactively analyzing metadata lineage and impact and automatically propagating metadata change using the Metadata Dependency Manager

  • Extending the metadata repository using the following: user-defined objects, user-defined associations, user-defined modules, creating icon sets and custom icons

  • Hosting the OWB design repository in an Oracle Real Application Clusters (Oracle RAC) environment (executing in an Oracle RAC environment does not require this license)

For more information about Warehouse Builder functionality, see the Oracle Database 11.2 Documentation Library for Data Warehousing and Business Intelligence.

4.2 Oracle Data Integration Suite

Oracle Data Integration Suite is a comprehensive software bundle for enabling scalable, highly-accessible data integration in any heterogeneous data environment. It can be separately licensed, independent of any Oracle Internet Application Server edition.

Oracle Data Integration Suite includes:

• Oracle Data Integrator Enterprise Edition

• Hyperion Data Relationship Management (up to maximum of 2,000 records per processor)

4.3 Oracle Data Profiling

Oracle Data Profiling enables business users to assess the quality of their data through metrics, to discover or infer rules based on this data, and to monitor the evolution of data quality over time.

Oracle Data Profiling has a prerequisite requirement that the license holder also owns a valid license for Oracle Data Integrator.

4.4 Oracle Data Quality for Data Integrator

Oracle Data Quality for Data Integrator is a comprehensive data quality platform that enables data standardization, match, merge, de-duplication, householding and name and address cleansing.

Oracle Data Quality for Data Integrator has a prerequisite requirement that the license holder also owns a valid license for Oracle Data Integrator.

4.5 Oracle Data Quality Rules for Data Integrator

Oracle Data Quality Rules for Data Integrator provide a set of pre-defined cleansing rules that extend Oracle Data Quality for Data Integrator capabilities explicitly for name and address cleansing for one or more countries.

Each Oracle Data Quality Rules for Data Integrator license gives the holder the capability to use these rules for one given country.

Rule Sets are available for the following countries and each Rule Set is licensed separately: Argentina, Australia, Austria, Belgium, Brazil, Brunei Darussalam, Canada, Chile, China, Colombia, Czech Republic, Denmark, Finland, France, Germany, Greece, Hong Kong, Hungary, India, Ireland, Israel, Italy, Jamaica, Japan, Korea, Luxembourg, Malaysia, Mexico, Netherlands, New Zealand, Norway, Peru, Philippines, Poland, Portugal, Russia, Saudi Arabia, Singapore, South Africa, Spain, Sweden, Switzerland, Taiwan, Turkey, United Arab Emirates, United Kingdom, United States, and Venezuela.

4.6 Oracle Application Adapters for Data Integration

Oracle Application Adapters for Data Integration provide specific software components for reverse-engineering metadata and extracting bulk data from various ERP software applications. Each unique Application Adapter for Data Integration is licensed separately, but must be used with Oracle Data Integrator Enterprise Edition and the Data Integrator component.

Application Adapters for Data Integration are available for PeopleSoft, JD Edwards, E-Business Suite, Siebel, and SAP Applications. Each Application Adapter for Data Integration is licensed separately.

4.7 Oracle Application Adapters for Warehouse Builder

Oracle Application Adapters for Warehouse Builder provide specific software connectors for reverse-engineering metadata and extracting bulk data from various ERP software applications. Each unique Application Adapter for Warehouse Builder is licensed separately. Any use of Application Adapters for Warehouse Builder, including customers constructing their own application adapters for Warehouse Builder using documented APIs, requires a license for Oracle Data Integrator Enterprise Edition.

Application Adapters for Warehouse Builder are available for PeopleSoft, SAP, Siebel, and E-Business Suite.

4.8 Oracle GoldenGate

Oracle GoldenGate is a log-based, real-time change data capture (CDC) software platform that moves high volumes of transactional data between databases with very low latency, and allows logical data replication. A typical environment includes a capture, pump, and delivery process. Each of these processes can run on most of the popular operating systems. You can replicate all or a portion of your data, and you can even manipulate the data within any of these processes not only for heterogeneous environments but also different database schemas.

The Oracle GoldenGate product can be used in conjunction with Oracle GoldenGate for Non Oracle Database and/or with Oracle GoldenGate for Mainframe and/or with Oracle GoldenGate for Teradata Replication Services in order to achieve heterogeneous replication to an Oracle database from another third party database or from an Oracle database to another third party database.

The license for Oracle GoldenGate includes the ability to capture database transactions from Oracle Database and deliver database transactions to Oracle Database. It also includes a full use license for Oracle Active Data Guard and a full use license for XStream. Note that the capture and deliver features of Oracle GoldenGate work with any edition of the Oracle Database, while Active Data Guard and XStream require Oracle Database Enterprise Edition.

When Oracle GoldenGate is used in an Oracle to Oracle environment, it includes the following components:

• XStream, which is built on the infrastructure of Oracle Streams, provides application programming interfaces (APIs) that enable client applications to receive real-time data changes from an Oracle database (using XStream Out APIs) and to send real-time data changes to an Oracle database (using XStream In APIs). These data changes can be shared between Oracle databases and other systems, such as file systems and non-Oracle databases.

• Oracle Active Data Guard enables a physical standby database to be opened as read-only while changes are applied to it from the primary database, enabling read-only reporting on the physical standby with minimal latency between reporting and production data. Oracle Active Data Guard also allows backup operations to be off-loaded to the standby database using fast incremental backups. Oracle Active Data Guard provides the additional benefit of high availability and disaster protection by quickly failing over to the standby database in the event of a planned or an unplanned outage at the production site.

For more information about Oracle Active Data Guard and XStream functionality, see the Oracle Database 11.2 Documentation Library for High Availability.

4.9 Oracle GoldenGate for Non Oracle Database

Oracle GoldenGate is a log-based, real-time change data capture (CDC) software platform that moves high volumes of transactional data between databases with very low latency, and allows logical data replication. A typical environment includes a capture, pump and delivery process. Each of these processes can run on most of the popular operating systems. You can replicate all or a portion of your data, and you can even manipulate the data within any of these processes not only for heterogeneous environments but also different database schemas.

The Oracle GoldenGate for Non Oracle Database product can be used in conjunction with Oracle GoldenGate, which supports Oracle Databases, and/or with Oracle GoldenGate for Mainframe, and/or with Oracle GoldenGate for Teradata Replication Services in order to achieve heterogeneous replication. For example, it is possible to use Oracle GoldenGate for Non Oracle Database to capture from a third party database and use Oracle GoldenGate to deliver to an Oracle database, or any other heterogeneous combination.

The license for Oracle GoldenGate for Non Oracle Database includes the ability to capture database transactions from supported non-Oracle open systems databases and deliver database transactions to supported non-Oracle open systems databases.

4.10 Oracle GoldenGate for Mainframe

Oracle GoldenGate is a log-based, real-time change data capture (CDC) software platform running on HP NonStop databases (Enscribe, SQL/MX, and SQL/MP) and DB2 running on z/OS that replicates high volumes of transactional data between homogeneous and heterogeneous database environments. All of the data or a portion of the data can be replicated, and you can even manipulate the data for not only heterogeneous environments but also unequal database schemas too.

The Oracle GoldenGate for Mainframe product can be used in conjunction with Oracle GoldenGate, which supports Oracle Databases, and/or with Oracle GoldenGate for Non Oracle Database, and/or with Oracle GoldenGate for Teradata Replication Services in order to achieve heterogeneous replication. For example, it is possible to use Oracle GoldenGate for Non Oracle Database to capture from a third party database and use Oracle GoldenGate to deliver to an Oracle database, or any other heterogeneous combination.

The license for Oracle GoldenGate for Mainframe includes the ability to capture database transactions from supported mainframe platforms and deliver database transactions to supported mainframe platforms.

4.11 Oracle GoldenGate for Teradata Replication Services

Oracle GoldenGate is a log-based, real-time change data capture (CDC) software platform that moves high volumes of transactional data between databases with very low latency, and allows logical data replication. A typical environment includes a capture, pump, and delivery process. Each of these processes can run on most of the popular operating systems. You can replicate all or a portion of your data, and you can even manipulate the data within any of these processes not only for heterogeneous environments but also different database schemas.

The Oracle GoldenGate for Teradata Replication Services product can be used in conjunction with Oracle GoldenGate, which supports Oracle Databases, and/or with Oracle GoldenGate for Mainframe, and/or with Oracle GoldenGate for Teradata Replication Services in order to achieve heterogeneous replication. For example, it is possible to use Oracle GoldenGate for Teradata Replication Services to capture from a Teradata database and use Oracle GoldenGate to deliver to an Oracle database or any other heterogeneous combination. Oracle GoldenGate for Teradata Replication Services also allows homogeneous replication between a Teradata source and Teradata target.

The license for Oracle GoldenGate for Teradata Replication Services includes the ability to capture database transactions from Teradata databases and deliver database transactions to Teradata databases.

4.12 Oracle GoldenGate Application Adapters

The following components are licensed together as part of the Oracle GoldenGate Application Adapter for Base24:

• Oracle GoldenGate D24 — Allows transactional data to be synchronized bi-directionally in real time throughout the day. In the event of an outage on one system, the full transaction load is processed on the remaining systems, ensuring continuous availability.

• Oracle GoldenGate N24 — Coordinates the notification message to all BASE24 satellite processes once the file refresh process has completed. Coordination is available for bidirectional configurations as well as unidirectional without the need to modify BASE24.

• Oracle GoldenGate T24 — Does the following:

  • Resolves problems with moving tokenized or segmented data to other platforms and databases

  • Reorganizes and reformats the transaction log (TLF and PTLF) tokens for all transaction types into a configurable order

  • Also reorganizes and re-formats PBF and CAF segments into a defined flat structure that can be propagated into any supported database.

The following components are licensed together as part of the Oracle GoldenGate Application Adapter for JMS and Flat File:

• Oracle GoldenGate for Flat File — Used for file integration, predominantly for ETL, proprietary, or legacy applications. Oracle GoldenGate can write micro batches to disk to be consumed by tools that expect batch/file input. The data is formatted by Oracle GoldenGate to the specifications of the target application, for example, delimiter separated values, length delimited values, binary, etc. Near real-time feeds to these systems are accomplished by decreasing the time window for batch file rollover to minutes or even seconds.

• Oracle GoldenGate for Java — Allows customers to execute custom event handlers written in Java to process the transaction operations and metadata changes captured by Oracle GoldenGate on the source system. These custom Java handlers can apply these changes to a third-party Java API exposed by the target system.

4.13 Management Pack for Oracle GoldenGate

Oracle GoldenGate Director allows organizations to easily monitor and manage their Oracle GoldenGate deployments. It is a server-based product that features an intuitive graphical interface for centrally designing, configuring, managing, monitoring, and reporting on the Oracle GoldenGate processes implemented across the user's infrastructure.

4.14 Oracle GoldenGate Veridata

Oracle GoldenGate Veridata is a high-speed data comparison solution that identifies and reports data discrepancies between databases without interrupting ongoing business processes. Using Oracle GoldenGate Veridata, companies can audit and verify large volumes of data across a variety of business applications with certainty, and maintain reliable data synchronization.

4.15 Oracle Data Service Integrator

Oracle Data Service Integrator provides the ability to do the following:

• Create canonical data service components for SOA

• Perform federated query capabilities from databases, Web services, and other sources

• Execute multi-target database updates

Oracle Data Service Integrator supplies fine-grained security with data redaction, and is natively accessible from the Oracle Service Bus product.

Oracle Data Service Integrator is separately licensed as a standalone product.