Results 1 to 8 of 8

Thread: remove duplicate values in a source using Informatica

  1. #1
    Expert Member
    Join Date
    Oct 2006
    Answers
    209

    remove duplicate values in a source using Informatica

    How to remove duplicate values in a source using Informatica?
    Which transformations to use?
    what is the query?

    NOTE : [This question was asked by dharma]


  2. #2
    Junior Member
    Join Date
    Dec 2006
    Answers
    19

    Re: remove duplicate values in a source using Informatica

    Hi
    There are 2 ways to do this and both of them are efficient.
    Method 1: Sorter -Filter.
    Send all the data to a sorter and , sort by all feilds that u want to remove duplicacy from . note that in the preoperties tab, select Unique .
    This will select and send forward only Unique Data .

    Method 2; Use an Aggregator
    Use AGG Transformation and group by the keys /feilds that u want to remove duplicacy from.

    Cheers
    Manisha


  3. #3

    Re: remove duplicate values in a source using Informatica

    Quote Originally Posted by JobHelper View Post
    How to remove duplicate values in a source using Informatica?
    Which transformations to use?
    what is the query?

    NOTE : [This question was asked by dharma]
    Hi, I have some idea about that. Pls, reply whether these are correct or not
    1. We can remove them at staging area, by using SQL before entering into informatica.
    2. By using aggregator transformation we can remove by using group by port.


  4. #4
    Junior Member
    Join Date
    Jan 2007
    Answers
    5

    Re: remove duplicate values in a source using Informatica

    Quote Originally Posted by JobHelper View Post
    How to remove duplicate values in a source using Informatica?
    Which transformations to use?
    what is the query?

    NOTE : [This question was asked by dharma]
    if soure is relational then we can used source qualifier transformation,
    if source is flat file then we can used joiner (by using option sort) or by using Aggregator (by using Group by port) or look up Transformation.


    Narasimha Reddy


  5. #5
    Junior Member
    Join Date
    Feb 2007
    Answers
    6

    Re: remove duplicate values in a source using Informatica

    How to remove duplicate rows using router and filter?


  6. #6
    Junior Member
    Join Date
    Dec 2008
    Answers
    2

    Re: remove duplicate values in a source using Informatica

    You can remove duplicates by using either select Distinct or Order by clause at the end of the SQL over ride in source qualifier


  7. #7
    Junior Member
    Join Date
    Dec 2009
    Answers
    2

    Re: remove duplicate values in a source using Informatica

    Hi
    If it is a relational file u can select SELECT DISTINCT option in the source qualifier itself and can use filter transformation and specify the condition.


  8. #8
    Junior Member
    Join Date
    Aug 2010
    Answers
    4

    Re: remove duplicate values in a source using Informatica

    To Just remove duplicate values u can use distinct in Source qualifier transformation.
    Or by using sorter transformation .


Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
About us
Applying for a job can be a stressful and frustrating experience, especially for someone who has never done it before. Considering that you are competing for the position with a at least a dozen other applicants, it is imperative that you thoroughly prepare for the job interview, in order to stand a good chance of getting hired. That's where GeekInterview can help.
Interact