Informatica - Eliminate Duplicate Records

GeekInterview.com > Interview Questions > Data Warehousing > Informatica

Go To First | Previous Question | Next Question

Informatica | Question 571 of 644

Eliminate Duplicate Records

Hi

I am having 10000 records in flat file, in that there are 100 records are duplicate records..
soo we want to eliminate those records..which is the best method we have to follow.

Regards
Mahesh Reddy

Total Answers and Comments: 4

Last Update: November 03, 2009 Asked by: Maheswar Reddy

Sponsored Links

Best Rated Answer

—

Submitted by: vivek1708

In order to beable to delete those entries
I think, you'll have to write sql queries in teh data base table
using rownum/rowid concept.

Or

by using the sorter and distinct option, load the unique rows in a temp table
followed by a truncate on the original table
and moving data back to it from the temp table.

hope it helps.

Above answer was rated as good by the following members:
ayappan.a, joyfun23

October 23, 2007 11:54:47

ravi

RE: Eliminate Duplicate Records

You can put sorter transformation after source qualifier transformation and in sorter tranformation' properties enable distinct property.

Thanks

kumar

Is this answer useful? Yes | No

1 0

Overall Rating: +1

May 11, 2008 12:44:49

vivek1708

Member Since: May 2008 Contribution: 18

RE:

In order to beable to delete those entries
I think you'll have to write sql queries in teh data base table
using rownum/rowid concept.

Or

by using the sorter and distinct option load the unique rows in a temp table
followed by a truncate on the original table
and moving data back to it from the temp table.

hope it helps.

Is this answer useful? Yes | No

1 1

Overall Rating: -N/A-

February 24, 2009 13:15:05

balaji_r

Member Since: February 2009 Contribution: 1

RE: Eliminate Duplicate Records

use aggregate on primary keys

Is this answer useful? Yes | No

November 03, 2009 12:13:34

avneeshrathor

Member Since: November 2009 Contribution: 7

RE: Eliminate Duplicate Records

Using sorter (with distinct option checked) will not tell what all records were duplicate. There is even a better way of doing it without using aggregator and all. it just uses expression transformation.

Is this answer useful? Yes | No

Go To Top

User Name		Remember Me?
Password

Question Bank