How to delete duplicate rows in flat files source is any option in informatica

Showing Answers 1 - 9 of 9 Answers

Prasad

  • May 10th, 2007
 

You cannot write SQL override for flat file

santanu

  • May 11th, 2012
 

Use the file as source, then a sorter, and then a expression to store the previous value,filter those which matches the previous record and the load them into the same flat file as target

  Was this answer useful?  Yes

jayapraveen

  • Jun 21st, 2012
 

SRC-->SQ-->LKP-->EXP-->UPD-->T1

LOGIC IS
LKP: EMPNO=IN_EMPNO
EXP:IIF (LKP_EMPNO=EMPNO, D,I)
ROUTER (GROUPS: DELETE----D>
INSERT---->I)
UPD_DELETE (DD_DELETE)(Connect to delete group and pass only the primary key column)
UPD_INSERT (DD_INSERT)
NOTE: take two instances of same target..
So you have to run the mapping two times.. For this
(OR)
Otherwise you can use dynamic lookup in this way
SRC-->SQ-->DY_LKP-->EXP-->UPD_T1
LOGIC:
DYNAMIC LOOKUP: Check the lookup property as dynamic
EXP:IIF (NEW_LOOKUP_ROW =0,R, I)
FILTER: NEW_LOOKUP_ROW! =0
TARGET: T1

  Was this answer useful?  Yes

Madhuri

  • Jun 22nd, 2012
 

Use sorter transformation after SQ and check the distinct check box of sorter.finally connect to the tgt.

Chinna

  • May 20th, 2013
 

Using Sorter Transformation it will delete duplicate records and using Expression Transformation...

Code
  1. S->SQ->EXP->Router->TR....

  2. Exp Logic=V_Prod_id=Prod_id

  3.                V_Dup_Count(V)=iff(prod_id=V_Prod_id,1,0)

  4.                Dup_count(O)=V_Dup_Count

  5. Router Logic

  6.    Unique=Dup_count=1........> Unique Records

  7.    Duplicate=Dup_Count>1.....>Duplicte Records

  8.    Connect to Target Table

  9.  


  Was this answer useful?  Yes

Give your answer:

If you think the above answer is not correct, Please select a reason and add your answer below.

 

Related Answered Questions

 

Related Open Questions