GeekInterview.com
  I am new, Sign me up!
 
GeekInterview.com  >  Interview Questions  >  Data Warehousing  >  ETL
Go To First  |  Previous Question  |  Next Question 
 ETL  |  Question 46 of 65    Print  
How you capture changes in data if the source system does not have option of storing date/time field in source table from where you need to extract the data?
The DW database can be Oracle or Teradata. The requirement here is to pull data from source system and ETL need to device a mechanism to identify the changes or new records. The source system can be a legacy system like AS400 application or Mainframe application. List out all such methods of data capture. The ETL can be Informatica, data stage or custom etl code.


  
Total Answers and Comments: 1 Last Update: July 13, 2007     Asked by: GeekNo1 
  
 Sponsored Links

 
 Best Rated Answer
—

No best answer available. Please pick the good answer available or submit your answer.
July 13, 2007 00:05:57   #1  
Sriram        
RE: How you capture changes in data if the source syst...

Assuming this is a Type1 Dimension or a FACT table on the DWH - Create Date and Update Date will be 2 system dates captured and stored on the Datawarehouse. First time Creation_Dt Update_Dt. Subsequent edits While loading from Staging to the DWH comparing the unique keys of the source data from Staging and DWH if keys match then update last update_dt and update other data items.


 
Is this answer useful? Yes | NoAnswer is useful 0   Answer is not useful 2Overall Rating: -2    

 Related Questions

Answered by Laxmi on 2005-05-13 16:42:53: Staging area is place where you hold temporary tables on data warehouse server. Staging tables are connected to work area or fact tables. We basically need staging 
Latest Answer : The staging area is:- One or more database schema(s) or file stores used to “stage” data extracted from the source OLTP systems prior to being published to the “warehouse” where it is visible to end users.Data ...
Latest Answer : Client:-* GUI/Presentation logic* Query specification* Data Analysis* Report formatting* Data accessApplication/Data Mart Server:-* Summarizing* Filtering* Meta Data* Multidimensional view* Data accessDW Server:-* Data logic* Data services* Meta data* ...
What are the various methods of getting incremental records or delta records from the source systems?
Answered by kiran on 2005-05-08 09:20:30: Informatica Metadata contains all the information about the source tables, target tables, the transformations, so that it will be useful and easy to perform transformations 
Latest Answer : Metadata is simply documentation for a digital geospatial dataset. It is a text document that describes the who, what, when, where, why and how questions about the data, so that a potential data user can decide whether or not the data is appropriate for ...
Tags : Metadata
Latest Answer : You cannot use Informatica to extract data from SAP via ABAP.  Only the SAP/Business Objects Data Integrator product can do this.Informatica uses a data dictionary interface, with clear SQL instructions, example...select BUKRS, BELNR, GJAHR, BUZEI ...
Latest Answer : draw the inference if slowly changing dimension and based on the Type 1/2 or3  tables defined. ...
Latest Answer : You cannot lookup from a source qualifier directly. However, you can override the SQL in the source qualifier to join with the lookup table to perform the lookup. ...
Read Answers (3) | Asked by : asha
Latest Answer : ODS is nothing but operational data source. It contains  most recent data .it contains around 30-60 days data  It is placed in between source system and staging area..   reports can also be taken in ODS . ...
Read Answers (7) | Asked by : kumar
What are the various test procedures used to check whether the data is loaded in the backend, performance of the mapping, and quality of the data loaded in INFORMATICA.
Read Answers (3) | Asked by : Andy
I'am new to SAS, can anybody explain the process of extracting data from source systems,storing in ODS and how data modelling is done.RegRam
Read Answers (3) | Asked by : ram_sas

 Sponsored Links

 
Related Articles

Breaking up XML into Relational Data

Breaking up XML into Relational Data While the preceding example shows how to construct an XML representation over relational data the example in this section illustrates how you can shred XML data back into relational data This reverse operation can be useful if your application works with relation
 

Querying Data with Oracle XQuery

Querying Data with Oracle XQuery Starting with Oracle Database 10g Release 2 you can take advantage of a full featured native XQuery engine integrated with the database With Oracle XQuery you can accomplish various tasks involved in developing PHP Oracle XML applications operating on any kind of dat
 

Retrieving XML Data

Retrieving XML DataTo retrieve XML data from an XMLType table you can use a SELECT SQL statement just as you would if you had to query a relational table For example to select the employee with the id set to 100 from the employees XMLType table discussed in the preceding section you might issue the
 

Using XMLType for Handling XML Data in the Database

Using XMLType for Handling XML Data in the Database Being an object type XMLType can not only be used to store XML data in the database but also to operate on that data via its built in methods Regardless of the storage model you choose XMLType provides a set of XML specific methods to operate on XM
 

Using Oracle Database for Storing, Modifying, and Retrieving XML Data

Using Oracle Database for Storing Modifying and Retrieving XML Data With Oracle XML DB you have various XML storage and XML processing options allowing you to achieve the required level of performance and scalability One of the most interesting things about Oracle XML DB is that it allows you to per
 

ODP.NET - Techniques to Improve Performance while Retrieving Data

ODP NET Techniques to Improve Performance while Retrieving Data Performance tuning is a great subject in Oracle Volumes of books would not be enough to cover every aspect of performance tuning in Oracle However in this section we will only discuss the fundamental performance techniques while working
 

ODP.NET - Populating a Dataset with a Single Data Table

ODP NET Populating a Dataset with a Single Data Table A dataset is simply a group of data tables These data tables can be identified with their own unique names within a dataset You can also add relations between data tables available in a dataset mosgoogle The following code gives you the details o
 

ODP.NET - Retrieving Typed Data

ODP NET Retrieving Typed Data While retrieving values from OracleDataReader we can extract information available in individual columns of a particular row either by using column ordinal position values or column names mosgoogle Retrieving Typed Data Using Ordinals ODP NET provides data specific enum
 

ODP.NET - Retrieving Data Using OracleDataReader

ODP NET Retrieving Data Using OracleDataReader OracleDataReader is simply a read only and forward only result set It works only if the database connection is open and it makes sure that the connection is open while you are retrieving data As the data that it retrieves is read only it is a bit faster
 

ODP.NET - Fundamental ODP.NET Classes to Retrieve Data

ODP NET Fundamental ODP NET Classes to Retrieve Data To retrieve data from an Oracle database using ODP NET we need to work with a few of the ODP NET classes At this point we will discuss the most fundamental classes available in ODP NET for retrieving data mosgoogle The following is the list of fun
 

About Us -  Privacy Policy -  Terms and Conditions -  Contact -  Ask Question -  Propose Category -  Site Updates 

Copyright © 2005 - 2009 GeekInterview.com. All Rights Reserved

Page copy protected against web site content infringement by Copyscape