Samir Desai

• Jul 23rd, 2007

 

You can use following query in SQ -->

Select Col_1,Col_2,Col..n from source group by Col_1,Col_2,Col..n having count(*)>1

to get only duplicate records in the traget.

Best Regrads,

Samir Desai.

sanjeev

• Aug 6th, 2007

 

If you take a ex:EMP TABLE  having the duplicate records
The query is


SELECT *FROM EMP WHERE EMPNO IN SELECT EMPNO FROM EMP GROUP BY EMPNO HAVING COUNT(*)>1;


Sanjeeva Reddy

sheeladere

 Profile Answers by sheeladere 

• Dec 30th, 2009

 

If you want to directly get the records from some relational table then you can use the query in Source qualifier to group by on all the columns and get the count of records and pass the records which has the count>1 only.

If you want to get the records from some file or you want to do it in the middle of the mapping after several transformations then use the aggregator, group by on all the ports and get the count, use the filter transformation after aggr. to filter the records only with count>1.