How do you remove duplicates without using remove duplicate stage?

Showing Answers 1 - 4 of 4 Answers

sasi

  • Aug 3rd, 2006
 

In the target make the column as the key column and run the job.

  Was this answer useful?  Yes

Reddy

  • Aug 3rd, 2006
 

Hi

Could please explain about this?

Thanks

Sudheer.

  Was this answer useful?  Yes

Tasneem

  • Aug 11th, 2006
 

Using a sort stage,set property: ALLOW DUPLICATES :false

  Was this answer useful?  Yes

c2

  • Sep 5th, 2006
 

You can do it at any stage.

Just do a hash partion of the input data and check the options Sort and Unique.

This will do.

  Was this answer useful?  Yes

Give your answer:

If you think the above answer is not correct, Please select a reason and add your answer below.

 

Related Answered Questions

 

Related Open Questions