in paralle job or server job?
can any one expalin clearly

in server job to remove duplicate we can make use of hash file(by selecting the column as primary key where you want the duplicates to be eliminated) and in parallel jobs theres a separate stage called REMOVE DUPLICATES STAGE(here also u can select the column where u want the duplicates to be removed, moreover u even have the chance to select the instance u want to retain)

U can remove the duplicate records through selecting the check box "SelectDistinct" options in source qualifier-edit-properties. So that before the
source is transformed to target this SelectDistinct option will remove from it from source qualifier itself.

hi,
You can remove duplicate through aggregator stage in server job and through remove duplicate stgae can remove in parallel job on the base of primary key columns.
thanks