Geeks Talk

Prepare for your Next Interview




remove duplicate values in a source using Informatica

This is a discussion on remove duplicate values in a source using Informatica within the Data Warehousing forums, part of the Databases category; How to remove duplicate values in a source using Informatica? Which transformations to use? what is the query? NOTE : [This question was asked by dharma]...


Go Back   Geeks Talk > Databases > Data Warehousing

Register FAQ Members List Calendar Mark Forums Read
  #1 (permalink)  
Old 12-28-2006
Expert Member
 
Join Date: Oct 2006
Posts: 690
Thanks: 0
Thanked 49 Times in 41 Posts
JobHelper is on a distinguished road
remove duplicate values in a source using Informatica

How to remove duplicate values in a source using Informatica?
Which transformations to use?
what is the query?

NOTE : [This question was asked by dharma]
Reply With Quote
Sponsored Links
  #2 (permalink)  
Old 01-04-2007
Junior Member
 
Join Date: Dec 2006
Location: London
Posts: 20
Thanks: 0
Thanked 2 Times in 2 Posts
manisha.sinha is on a distinguished road
Re: remove duplicate values in a source using Informatica

Hi
There are 2 ways to do this and both of them are efficient.
Method 1: Sorter -Filter.
Send all the data to a sorter and , sort by all feilds that u want to remove duplicacy from . note that in the preoperties tab, select Unique .
This will select and send forward only Unique Data .

Method 2; Use an Aggregator
Use AGG Transformation and group by the keys /feilds that u want to remove duplicacy from.

Cheers
Manisha
Reply With Quote
  #3 (permalink)  
Old 01-17-2007
Junior Member
 
Join Date: Jan 2007
Location: pune
Posts: 5
Thanks: 0
Thanked 3 Times in 2 Posts
jvenkateshkumar is on a distinguished road
Re: remove duplicate values in a source using Informatica

Quote:
Originally Posted by JobHelper View Post
How to remove duplicate values in a source using Informatica?
Which transformations to use?
what is the query?

NOTE : [This question was asked by dharma]
Hi, I have some idea about that. Pls, reply whether these are correct or not
1. We can remove them at staging area, by using SQL before entering into informatica.
2. By using aggregator transformation we can remove by using group by port.
Reply With Quote
  #4 (permalink)  
Old 01-19-2007
Junior Member
 
Join Date: Jan 2007
Location: bangalore
Posts: 5
Thanks: 0
Thanked 0 Times in 0 Posts
narasimha.e is on a distinguished road
Re: remove duplicate values in a source using Informatica

Quote:
Originally Posted by JobHelper View Post
How to remove duplicate values in a source using Informatica?
Which transformations to use?
what is the query?

NOTE : [This question was asked by dharma]
if soure is relational then we can used source qualifier transformation,
if source is flat file then we can used joiner (by using option sort) or by using Aggregator (by using Group by port) or look up Transformation.


Narasimha Reddy
Reply With Quote
  #5 (permalink)  
Old 02-03-2007
Junior Member
 
Join Date: Feb 2007
Location: india
Posts: 7
Thanks: 0
Thanked 1 Time in 1 Post
sat.inn is on a distinguished road
Re: remove duplicate values in a source using Informatica

How to remove duplicate rows using router and filter?
Reply With Quote
Reply

  Geeks Talk > Databases > Data Warehousing


Thread Tools
Display Modes


Similar Threads

Thread Thread Starter Forum Replies Last Post
Remove an application without "uninstall/Remove" option anushya Windows 7 10-18-2008 02:42 PM
For Informatica Users Lokesh M Geeks Lounge 3 10-06-2008 07:38 AM
description of informatica power center 6 architecture satyajitchowdhury Data Warehousing 1 12-10-2007 04:45 AM
Typical Informatica Scenarios Lokesh M Data Warehousing 5 08-16-2007 09:18 AM
Compare values of column in a table JobHelper SQL Server 1 12-13-2006 01:57 AM


All times are GMT -4. The time now is 05:37 AM.


Powered by vBulletin® Version 3.6.8
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.1.0
Copyright © 2008 GeekInterview.com. All Rights Reserved