| |
GeekInterview.com > Tech FAQs > DataStage
| Print | |
Question: How do you remove duplicate records from a file and capture the rejected records in a separate file.
|
| November 11, 2007 07:00:41 |
#3 |
| Fanguna |
Member Since: Visitor Total Comments: N/A |
RE: How do you remove duplicate records from a file an... |
Other than remove duplicate stage ,we can also use aggregator stage to count the number of records exist for the key columns.If more than one record exist for the key column,then they are considered as duplicate records and using transformer we can set a stage variable as 'COUNT' and check if 'COUNT>1'.If so,using a constraint, reject that duplicate records into reject file. |
| |
Back To Question | |