Submitted Questions

  • How to identify updated records in datastage.

    How can we identify updated records in datastage? Only updated records without having any row-id and date column available.

    Vikram Singh

    • Nov 11th, 2014

    I believe you can use the change capture stage which will show you the data before any update change made and after the update change was made. Should work, if there are no other constraints.

  • what is slowly changing dimension(SCD)

    what is slowly changing dimension(SCD)? How do we rectify it in datastage.

    sabz

    • Nov 5th, 2014

    SCD is a common problem particular to database.This applies to cases where the attributes for a record varies over time.This can be solved by 3 types.type1,type2,type3

  • what is range look up and how it is used in datastage.

    Say I have 5 rows in a source table ‎and for each rows 10 rows matching in a lookup table and my range is for lookup is 9 to 99. what will be the row count in output table?

    barak

    • Nov 21st, 2014

    That depends on , if you set up "more than one row match" you will get you "Cartesian Product"

    ramireddy

    • Oct 17th, 2014

    You will get same no of records in the source even there are duplicates in look up data

  • How to read a comma delimiter file in sequential file stage?

    How we read comma delimiter file in sequential file stage and how we can remove the header and footer from a comma delimiter file?

    deepakatsit

    • Oct 23rd, 2014

    For Sequential file there is an option "First Row Column Name" set to true so Header is removed and File End Type You need to select through which Footer is Removed.
    Now For Comma Delimiter Use : :"Field Defaults -> Delimiter = Comma"

  • Dataset stage and sequential file stage

    what is the difference between dataset stage and sequential file stage? even one more to be added here, What is the difference between dataset stage and fileset stage?

    Sourabh Kulkarni

    • Jan 22nd, 2023

    Deepak!, how to load a sequential file stage having data more than 2 Gb?

    ravikumar

    • Jul 24th, 2017

    1) Sequential file stage we can use UNIX commands and in dataset stage we cant use UNIX commands.
    2) Sequential file stage filename save as .txt and dataset - .ds

  • Source file and 3 output tables records problem

    Suppose i am having a source file and 3 output tables and I want first row to be written to first table second row to second table, third row to third table likewise how can we achieve this using datastage without using partitioning?

    Dheerendra

    • Nov 14th, 2014

    Use SEQ---> Transformer stage ----> 3 SEQ Files In transformer stage add constraints as Mod(@INROWNUM,3) =1, Mod(@INROWNUM,3) =2, Mod(@INROWNUM,3) =0

    Pratheeksha

    • Nov 12th, 2014

    For this, one option could be :
    Get the row number column from the source seq file, in the transformer use stage variable which is defined as below:

    if mod(i/p col,3)=0 then
    if mod(i/p col,2)=0 then
    "2"
    else
    "3"
    else "1"

  • Having single input source want three different outputs.

    I have a source file having data like: 10 10 10 20 20 20 30 30 40 40 50 60 70 i want three output from the above input file, these output would be: 1) having only unique records no duplicates should be there. Like: 10 20 30 40 50 60 70 2) having only duplicate records, no unique records should be there. Like: 10 10 10 20 20 20 30 30 40 40 3) only unique record should be present. Like: 50 60 70 how...

    Ruchi Gautami

    • Dec 30th, 2019

    File -->> Sort -->> Transformer -->> O/P File
    Sort:
    Define the key field and in Property set Key Change column as TRUE.
    Transformer:
    In Constraints put the below condition:
    KeyChange=1 for Unique record O/P
    KeyChange=0 for Duplicate O/P.

    shaheed

    • Nov 20th, 2019

    Src->Sggr->Trans->Target(3)
    1) Unique- send as it is with link sort
    2) Duplicate only- Loop through Count of each row count (constraint Count . 1)
    3)Unique Only- Constraints Count = 1