Introduction This article illustrates how to import data from relational databases into Hadoop Distributed File Systems (HDFS) with Sqoop and Oracle Data...
Introduction This article illustrates how to import data from relational databases into Hadoop Distributed File Systems (HDFS) with Sqoop and Oracle Data Integrator (ODI). This article features two ODI knowledge modules designed to work with Sqoop: IKM SQL to HDFS File (Sqoop) and IKM SQL to HDFS Hive (Sqoop). If your source data store is a relational database such as Oracle, Teradata, and MySQL, the Sqoop tool provides a fast and efficient way to extract and load data...
Introduction This article illustrates how to import data from relational databases into Hadoop Distributed File Systems (HDFS) with Sqoop and Oracle Data Integrator (ODI). This article features...
Introduction The "OGG-01161 Bad Column Index" error is possibly one of the most reviled and misunderstood Oracle GoldenGate (OGG) error messages ever created....
Introduction The "OGG-01161 Bad Column Index" error is possibly one of the most reviled and misunderstood Oracle GoldenGate (OGG) error messages ever created. In this article, we shall attempt to demystify this error message. Main Article Bad column index errors tend to occur in OGG heterogeneous; i.e., unlike database, environments and most frequently where change control procedures do not require an OGG sign-off for database maintenance tasks. To demonstrate, I have an...
Introduction The "OGG-01161 Bad Column Index" error is possibly one of the most reviled and misunderstood Oracle GoldenGate (OGG) error messages ever created. In this article, we shall attempt...
Introduction Logdump is a standard utility that comes with the Oracle GoldenGate (OGG) application. Logdump enables the user to view and scan for transactions...
Introduction Logdump is a standard utility that comes with the Oracle GoldenGate (OGG) application. Logdump enables the user to view and scan for transactions and records, obtain transaction statistics, and save data contained within OGG Trails. In this article we shall present examples of the Oracle GoldenGate Log File Dump Utility version 12.1.2 functionality that aid in troubleshooting data issues, determining database recovery points, and OGG group load balancing. Main...
Introduction Logdump is a standard utility that comes with the Oracle GoldenGate (OGG) application. Logdump enables the user to view and scan for transactions and records, obtain...
Introduction Oracle GoldenGate (OGG) provides a mechanism for assigning values to parameters at run time. In this article we shall discuss this feature and show...
Introduction Oracle GoldenGate (OGG) provides a mechanism for assigning values to parameters at run time. In this article we shall discuss this feature and show you how to reference operating system variables from within an OGG parameter file. Main Article Typically when we create OGG Groups we edit a parameter file and define configuration options. This requires that we edit the parameter file whenever a change occurs that affects the operating environment. Instead of...
Introduction Oracle GoldenGate (OGG) provides a mechanism for assigning values to parameters at run time. In this article we shall discuss this feature and show you how to reference operating system...
Introduction This article explains how to encrypt sensitive data (such as ssn, credit card number, etc ) in the incoming payload and decrypt the data back to...
Introduction This article explains how to encrypt sensitive data (such as ssn, credit card number, etc ) in the incoming payload and decrypt the data back to clear text (or original form) in the outgoing message. The purpose is to hide the sensitive data in the payload, in the audit trail, console and logs. Main Article Oracle provides Oracle Web Services Manager (OWSM) message protection, but it encrypts the entire payload. However, Oracle OWSM gives us the capability to...
Introduction This article explains how to encrypt sensitive data (such as ssn, credit card number, etc ) in the incoming payload and decrypt the data back to clear text (or original form) in...
Introduction With its version 12, Oracle Data Integrator offers three flavors of agents: JEE, Colocated and Standalone. The purpose of this post is to compare...
Introduction With its version 12, Oracle Data Integrator offers three flavors of agents: JEE, Colocated and Standalone. The purpose of this post is to compare and contrast the benefits of each one of these types of agents and to help developers and architects select the best option(s) for their implementation. ODI Agents: Standalone, JEE and Colocated In this comparison between the three agent flavors, we only refer to the 12c version of ODI unless otherwise noted. Agents...
Introduction With its version 12, Oracle Data Integrator offers three flavors of agents: JEE, Colocated and Standalone. The purpose of this post is to compare and contrast the benefits of each one...
Introduction With no middle tier required in the ODI architecture, the most common question from people who are new to ODI is where to install the standalone...
Introduction With no middle tier required in the ODI architecture, the most common question from people who are new to ODI is where to install the standalone agent: source, target or middle tier systems? We look here at different possible architectures and provide the best choices accordingly. Understanding Where to Install the ODI Standalone Agent Source, Target or Middle tier? Source systems be dispersed throughout the information system: connection from one source system...
Introduction With no middle tier required in the ODI architecture, the most common question from people who are new to ODI is where to install the standalone agent: source, target or middle...
Introduction Oracle GoldenGate (OGG) version 12c introduced the Coordinated Apply. Coordinated Apply provides the ability to spawn multiple OGG Replicat...
Introduction Oracle GoldenGate (OGG) version 12c introduced the Coordinated Apply. Coordinated Apply provides the ability to spawn multiple OGG Replicat processes from one parameter file. This article discusses configuration options, GGSCI commands, and troubleshooting for Coordinated Apply as of OGG version 12.1.2.0.0 Main Article OGG 12c introduced the Coordinated Apply; which is a multi-threaded Replicat that performs parallel processing of data into a target database. In...
Introduction Oracle GoldenGate (OGG) version 12c introduced the Coordinated Apply. Coordinated Apply provides the ability to spawn multiple OGG Replicat processes from one parameter file. This article...
Introduction This document describes how to convert a primary key update operation into a delete and insert operation based on the customer’s needs. This will...
Introduction This document describes how to convert a primary key update operation into a delete and insert operation based on the customer’s needs. This will be required where data is filtered and sent to different target locations based on the value of the primary key. This document is intended for Oracle Database Administrators (DBAs), Oracle Developers with some basic knowledge of Oracle GoldenGate software and Oracle GoldenGate Administrators. The document is intended to...
Introduction This document describes how to convert a primary key update operation into a delete and insert operation based on the customer’s needs. This will be required where data is filtered...
