DataStage Interview Questions

upstream means data channel from source system to ETL.
there are verity of source system (RDBMS, Flat Files, XML, ODBC).this data is integrated by ETL.this is input to ETL.
same as upstream.

Downstream means data generated from ETL.

Could you plz site examples for upstream and downstream applications

There are 2 ways to fetch the last row of any file if the number of records in the file is not known before run time:

1) Use the tail stage and run the tail stage in sequential mode
2) Use the lastrow() function in the transformer stage

Develop a job source seq file--> Transformer--> output stageIn the transformer write a stage variable as rowcount with the following derivationGoto DSfunctions click on DSGetLinkI...

Besides used for making copies of the input, copy stage is also helpful for achieving 1) dropping columns between stages 2) to change column names 3) if the scenario is to end the job flow directly f...

copy stage purpose is to avoid the unwanted columns in output table means in a table u have 10 columns but u want 5 columns then you use copy stage to get which columns you want

Add an extra column colA and colB to the files A and B respectively. Let the value for colsA be a for all the rows in file A and the value for colB be b in file B(using the column generator stage).Now...

You take two seq files and club the files in to funnel stage as continuous funnel and take sort stage and filter the duplicates and the n transformer stage write the constraints over there and give 3 outputs

That's all its very simple method !!!

DateToString(date,"%yyyy:%mm:%dd")

Using datetostring function in transformer stage
example
DateToString(inputcolumnname(ex Dob),"%yyyy/%mm/%dd")

Oconv(Iconv(Filedname,"D/MDY[2,2,4]"),"D-YDM[4,2,2]") 

JJ, you are wrong.

Apt_ Dump_Score
By using this only we can find.

1 conductor process
3 Section leader process
3 player process ( modify and filter are combined)
1 source sequential file
1 target sequential file
Total : 9

your database size is the sum of all datafiles,tempfiles,redologs. so check the sum from dba_data_files,dba_temp_files and v$logfile

It Depends about the size,Example My Development Database size is 6TB and UAT Server is 12 TB and Production is ~25TB.

In 8.0/8.1 it uses parser which requires the entire XML document to be loaded into memory, so that youre limited by the amount of available memory. In 8.5 it uses a really clever streaming app

set the cron entry

This can be done in Director -->Add to Scheduler.

1)Sequential file->Take Sequential File and Import The flat file which consist of (AABBBCCD)data. 2)Transform Stage-->Take Transformer Stage and create two Stage variables In StageVariable1 Write t...

first count the rows using transformer stage (stage variables)stgvar ===dslink source,,,stgvar 1===count the rows
stgvar 3====concatenate stgvar stgvar1 you will get the result

Its very simple: 1. Introduce a sort stage very next to sequential file, 2. Select a property (key change column) in sort stage and you can assign 0-Unique or 1- duplicate or viceversa as you wish. ...

After source sequential we can use sort stage with dump_key in which 0 is assigned to duplicate record and 1 is assigned to non duplicate record after sort stage we can use transformer stage in whic...

Use transformer or generate extra rows and using column generator and make same number of columns in 2 inputs and join.

We can connect the two job activity stages without any column.

In sequential file we can take a single file by using the file as Specified file.

But we can take the more than one file use File Pattern with different file names.

Metadata must be same.

HI,
In sequential file we can take a single file byusing the file as Specifyed file.

But we can take the more than one file use File Pattern with different file names.

Metadata must be same.

example : raje123ndh456ar

Code
convert(0123456789,,raje123ndh456ar) = rajendhar 

use alpha function.
Exp-->alpha(123vinay567)
Ans-->vinay

i thing this is your requeriment..

Transformer is a heavier stage as apart from the orchestrate we do have the C++ operators for various derivations. Right from compilation to execution a Transformer will always take more time than a copy stage which is a simple straight forward passive(if we can call) stage

Copy stage is a passive stage and Transformer is Active and it involves the process usage and copy does not . So its good to go with copy since it takes less time then transformer to propagate the columns over the link

You can choose O.W option in constraints, so remaining records you will get.

In the transformer Stage Constraints we can define the constraints where this records can get to which link so that the missing records can get catched.

Partition by Round Robin

Hash

Key partition is required and data should be sorted before all these stage while using