Incremental Loading Flat File Data Capture

How can we do incremental loading if the source is flat file?

Showing Answers 1 - 5 of 5 Answers

Ratnesh

  • Dec 31st, 2020
 

If your source flat file is always full file , based on the natural keys, you can identify the records by lookup on the target table , whether records are existing or new. If records are new, go ahead and insert them. If records are existing , check whether any real changes on any fields and update the existing records.

  Was this answer useful?  Yes

Jacqueline

  • Aug 23rd, 2023
 

Ratnesh, your answer is fine if we know what the natural keys are but what happens if the file is extremely large and you have no idea what the keys are in the flat file? If that is the case then I would think we use the target table PK to perform the look up with corresponding columns from the flat file. Just a thought.

  Was this answer useful?  Yes

Give your answer:

If you think the above answer is not correct, Please select a reason and add your answer below.

 

Related Answered Questions

 

Related Open Questions