srinuv_11

 Profile Answers by srinuv_11 Questions by srinuv_11

• Dec 4th, 2006

 

We have to run the workflow one again if u r doing like we load the data once again

sravan kumar

• Dec 4th, 2006

 

Mr.srinuv Please dont give wrong answers.

this site must help others.

Ans is we have to go for "change data Capture".

Binaya

• Dec 13th, 2006

 

(select all the source records) minus (select all the target records) on basis of primary key.Now you get all the new recods then you can insert only those records which are new.

Manisha

• Dec 14th, 2006

 

I think it will be definitely wiser to check this from the backend rather than running the work flow again !

Usually DWH tables have a Create Date and Update Date feilds which dont really contain any 'Real' data only store the dates on which the row was created /last updated.

sowjanya

• Dec 19th, 2006

 

hi mr. sravan,

can u plz explain how to use change data capture to check all the new recorda are loaded or not

Sravan Kumar

• Dec 20th, 2006

 

Dear Sowjanya,

There are 3 ways to capture CDC,

1.By using Time Stamp

2.Date range Key

3.Triggers.

Bye.

jvivek80

• Dec 25th, 2006

 

Five methods for capturing data changes are available:Use source timestamps. -- Advances in operating systems and RDBMS functionality has enabled us to a large extent to identify record creation and updates to the nanosecond ranges. Source time stamped records can serve as a powerful platform to facilitate CDC. Read the DBMS log. - Technology advances in DBMS have enabled to capture the history of all the changes occurring within a DBMS. The changes are brought into the staging area and are matched up with the partially constructed records for a completed one, ready for the next process integration. Compare before and after images of the database. - To make this process easier, it is recommend that you use the backup files (image copies) and a compare utility. Comparison may be your only choice for older batch systems. It can be a slow process to identify those records that have changed since the last compare. Once identified, the records or the fields are extracted and put into a file for further integration. Create snapshots of the operational systems and use these in the capture process. - This usually requires a complete reload of the tables and works best in the ODS. If used for the data warehouse, then all history must be rebuilt. Use database triggers from the operational system. - This mechanism requires that the operational source has a relational DBMS that saves inserted, updated or deleted records of interest. Unfortunately, this also creates twice the workload on the operational system. For example, upon the insertion of a new record, the database fires a trigger not only to insert the record into its own database, but also to update another table for our use in data capture.

Lingesh Kumar

• Jan 31st, 2007

 

Hi When ever you load to source load with date timesatmp. Suppose u want ot today records into target table. So source table will have today Date timestamp for all the records which came today.So when u run the query give conditon that records with today date so today records alone will be selected. If my answer is not relevant pls mail to lingeshkumar.n gmail.com