In general every OBIEE Application user/developer needs to know the origin of the data displayed on reports. The general questions that everyone looks for answers to understand their application are:
Also, if you want to modify/update your metadata definition, the developer/BI Analyst should be aware of the impact of that change in already developed content.
To answer these questions, we need to build a column lineage, from dashboard to subject area, to physical column, and then to column in source system. We have so many tools to build this Data Lineage, but within OBIEE itself, we have some great information that can be used to build this Data Lineage to answer many of questions but not all.
To build OBIEE Data Lineage, We need to extract the objects information from:
The All Web Catalog objects information can be found using Catalog Manager Report. Generate a catalog report using Catalog manager and then export it to a tab delimited CSV file.
To export the OBIEE Web Catalog report to a CSV file:
All repository objects information can be generated with Repository documentation utility available within OBIEE Administrator tool. Generate the repository documentation and export to a text file.
To export the OBIEE Repository documentation to a text file:
Now we are ready with the data required for data lineage. Now we can build an OBIEE RPD with these OBIEE Web Catalog and Repository CSV files by creating ODBC connections or we can import the CSV files data into a database table using any import tools. For example, I am using SQL developer to import data from CSV files into a database table. I used SQL developer excellent feature to import data from CSV files. This is very simple, just expand the database and right click on the tables. Then select Import Data.
Select the CSV file to import.
Define the CSV file properties, like Format type = Delimited and Delimiter = tab.
I have used the following business logic to join the Catalog and RPD data. (The table and column names are dependent on what you have customized).
Catalog.Subject Area = RPD. Subject Area
RPD.Presentation Table = Catalog. Table
Catalog.Presentation Column = RPD.Column
Deploy this RPD and configure an empty webcatalog (or you can use existing one) through Oracle Fusion Middleware EM and restart all the OBIEE services.
Now we are ready with the data lineage information. Login to OBI Presentation Services and create the necessary reports to know about reports statistics and their columns definition all the way from physical sources.
For Example:
Question 1: What are the physical columns used by a report?
I’ll create a report with the required columns to answer this question (See the report below).
From above report I can answer, what are the columns the report is made up with, what is the definition of a metric and what is the source of that particular column. And the above report also tells me what happens if I delete a particular column from RPD like what are the reports that are being impacted?
Question 2: How many reports have been developed and who?
Create a report. Answer, there are 39 total reports and ownership details are below.
This is how we can create the reports to answer some complicated questions about column lineage.
Shiva Molabanti is a Manager and Senior Architect at KPI Partners. He is a business intelligence enthusiast who likes blogging about acquisitions in the BI space, technical workings of BI tools, and Oracle Business Intelligence. Visit Shiva at his personal blog or check out Shiva's blog at KPIPartners.com. |