Session -I
Oracle Data Integrator
Introduction
Created By : Gourav Atalkar
Reviewed By: Amit Sharma
Contact Point :bispsolutions.wordpress.com
Agenda
What is Oracle Data Integrator?
Why Oracle Data Integrator?
Overview of ODI 11g Architecture
Overview of ODI 11g Components
About Graphical Modules
Types of ODI Agents
Overview of Oracle Data Integrator
Repositories
Why Oracle Data Integrator ?
ELT Architecture provides high performance.
Active integration enables real time data warehousing and
operational data hubs.
Declarative design improves developer productivity.
Knowledge modules provides flexibility and extensibility.
ODI combines three style of data integration: data based, event
based and service based
ODI shortens implementation times with its declarative design
approach.
Conventional Integration process: ETL
Machine Machine
Integration Process
Order
Errors
Source Transform Target
Sales
Correction
files
Machine
Extract Transform Load
ELT
1) Extract: Extracting the data from various sources.
2) Load: Loading the data into the destinations target.
3) Transform: Transforming data according to a set of business
rules.
Conventional ETL Process Next Generation ELT Architecture
Extract
Load
Extract
Load
Transform
Oracle Data Integrator Architecture
Desktop Web Logic 11g/Application Server
JVM ODI Studio FMW Console ODI Plug-in
Java EE Designer
Servlet Container Web Service
Applicatio
n Operator Java EE Run-time Container
ODI WS
Applicatio Data
ODI SDK Public
Topology n Console Servi
ODI SDK Stand Alone WS
ce
Agent
Security
Data Sources Connection Pool
Repositories Sources and Targets
JVM
Run-time WS
Master
Repository Work Stand Alone
Agent
Repository
Legacy Files DBMS
Oracle Data Integrator Components
ODI Studio Components:
Designer Navigator
Operator Navigator
Topology Navigator
Security Navigator
ODI Agent
ODI Console
ODI Repositories
Oracle Data Integrator Studio
Designer Navigator: Operator Navigator: Operator Navigator: Security Navigator:
Reverse Engineering Operate Production Define the Manage user
Develop Projects Monitor sessions infrastructure of the IS. privileges.
Release Scenario
Repository
Designer Navigator
Designer Navigator
Designer Navigator is the GUI for defining metadata and rules for
transformation and data quality. It uses this information to
generate scenarios for production, and designer is where all the
project development take place. Designer navigator is the core
module for developers and metadata administrators.
Designer handles the following:
Models: Description of the data and application structure.
Projects: The developments of various ODI objects.
Operator Navigator
Toolbar
In Operator
navigator you can
monitor execution
of ODI objects
This monitoring
sessions steps
enables you to
perform debugging
Operator Navigator
Operator navigator is used to manage and monitor ODI in
production. It is designed for production operators and
displays the execution logs with error counts, the number of
rows processed, execution statistics, and so on. At design time,
developers use operator navigator for debugging purpose.
Through the Operator navigator, you can manage your
interface execution in the sessions, as well as the scenario in
the production.
The operator navigator stores this information in a work
repository while using the topology define in the master
repository.
Topology Navigator
Toolbar
Technology Workspace to
tree define Topology
objects
In ODI Topology manager
you set the architecture of
your information system,
technologies server
information, schemas and
repositories.
Topology Navigator
Topology Navigator manages the physical and logical
architecture of the infrastructure. Server, schemas, and agents
are registered in the ODI Master Repository-a major ODI
component that contains information about the topology of the
company’s IT resources, security, and ODI resource.
Using the topology navigator, you can define the topology of
your information system to ODI so that it can be accessed by
other ODI modules. Topology navigator enables you to manage
repositories. The topology navigator store this information in a
master repository.
Security Navigator
Workspace to define
objects, profiles,
users and hosts.
In security navigator , you manage
objects, profiles, users and their
privileges and hosts.
Object Tree
Security Navigator
Security Navigator manages users and their privileges in ODI. It
is used to create profiles and provide rights to users to access
ODI objects and features. This navigator is usually used by
security administrators.
It is used to assign user rights for method on generic objects
and to fine tune these rights on the objects instances.
What is an Agent ?
An agent is a run time component of ODI that orchestrates the
integration process.
It is a lightweight java program that retrieves code from the
repository at the run time.
At design time developer generate scenario from the business
rule that they have designed. The code of these scenario is then
retrieved from the from the repository by the agent at run time.
This agent then connects to the data servers and orchestrates
the code execution on these servers.
Oracle data Integrator Agent
Agents are lightweight java
processes that orchestrates the
execution of objects at run time.
Agent can do one of the
following:
-Execute objects on demand
-Execute according to predefined
schedules.
Oracle data Integrator Agent
Two Types of agents: Java EE and standalone
The agents comes in two different types:
The java Enterprise Edition(Java EE; formerly J2EE) agent
can be deployed as a web application and benefit from the
feature of an application server.
The standalone agent runs in a simple java machine and can
be deployed where needed to perform the integration flow.
Both agents are multithreaded java programs that support
load balancing and can be distributed across the information
system.
Using the Two Types of agents
Deploying a Java EE agent in a Java application server
(Oracle WebLogic Server):
1)In ODI, define the Java EE agent in the Topology Navigator.
2)In ODI, create the WLS template for the Java EE Agent.
3)Deploy template directly using WLS configuration Wizard.
Using a stand alone Agent:
1)Launch an agent.
2)Display scheduling information.
3)Stop the agent.
Advantages of Java EE agents over Standalone agents:
1)High Availability
2)Multiple agents, using Coherence.
Example of standalone agent
Designer Navigator: Operator Navigator:
Reverse Engineering Operate Production
Develop Projects Monitor sessions
Release Scenario
Java Any Platform
Repository
RDBMS
Standalone Agent
Java Any Platform
Information System
ODI Console
ODI Console provides web access to Repositories. It enables user
to navigate projects, models, logs and so on. Business user,
developer, Operators, and administrators use their Web browsers
to access ODI Console. The ODI console replaces Metadata
navigator of previous version.
Oracle Data Integrator Repositories
Two Types of repositories are included into the ODI.
-Master Repository
-Work Repository
* Development Repository
* Execution Repository
Work Repositories are always attached to a single Master
repository
Master and Work Repositories
Security
Topology
Versioning
Master Repository
Model
Project Execution
Execution
Work Repository Execution Repository
(Development) (Production)
Master and Work Repositories
Master Repository: It is the data structure containing the
information about the Topology of the company’s IT resources,
security, and version management of projects and data models.
This repository stored on a relational database accessible in
client/server mode from the different ODI modules.
Work Repository: It is the data structure containing the
information about the data model, projects and their use. This
repository stored on a relational database accessible in
client/server mode from the different ODI modules.
Question
Thank You
Contact Us: http://learnhyperion.wordpress.com
http://bisp.consulting@gmail.com
