-
Design Phase
How technical design will be prepared in datastage?
k2_swarupa
- Apr 16th, 2009
If you want to prepare a design doc, then you should know the complete flow of your project along with business rule. Technical design doc is nothing but the flow of the process,?to describe in jobs.
-
Use of Terminator Activity
What is the Use of Terminator Activity in Datastage server Jobs?
nikhilanshuman
- Mar 19th, 2010
The terminator activity is used to terminate/abort a job in particulat conditions.user can define his own flow to the terminator activity.
Abhijain
- Sep 19th, 2008
A terminator stage can be used in a job sequence to ensure that the sequence is stopped cleanly if certain situations arise. You can have multiple terminator activities and can place them anywhere in ...
-
Dataset and Transformers Performance
How can you say that performance will be improve if we make use of a dataset?Why does the performance degrade when we use 4-5 transformers in a single job?
ashokmadduri
- Jan 17th, 2009
Dataset are referring to control file due to this dataset will give fast performance while processing the data, if you use transformers in job, it should compile the C++ backend due to this datastage ...
anurangevk
- Dec 6th, 2008
1. Using Dataset?- The storage method is internal to datastage, hence performance increases as less time is required to read from or write to a dataset2. Transformers are very bulky with lot of functions inbuilt them, so usage of more transformers slows down the speed at which?job executes
-
Job Sequence
How to create Job Sequence?
Abhijain
- Feb 8th, 2010
Have you ever tried opening Datastage and browse all the available options.To create a job sequence. Below are the steps;1. Open Datastage2. Open New Job Sequence3. Save it with some name.4. A your job sequence is created.5. Now drag the job sequence stages-->as per your business requirement.
veer.dwh
- Jul 20th, 2009
You can create job sequencer using designer client, if you click create new job like server or px job in Datastage, it will get open window there you can find to create the job sequencer.Job sequencer uses to run multiple jobs either server or px based on the dependencies.
-
Job Schedule
How to schedule jobs in UNIX Server?
Abhijain
- Feb 8th, 2010
Couple of ways to schedule the Datastage jobs/sequences-1. Can be done using Datastage Director Tool 2. Normally done using crontab script. You can easily get it through google.3. Can use Third party scheduling tools like Autosys
veer.dwh
- Jul 20th, 2009
DataStage job scheduling we can do using datastage director client tool, but in real time they use UNIX for DataStage job scheduling which supports 3rd party scheduling tools like Autosys, Triviam, UNIX corn tab etc.
-
Feature of DataStage 8.01 Version
What are the main features of DataStage 8.01 Version?
veer.dwh
- Sep 23rd, 2009
There are several new futures includes in DS 8.0.1 compare to 7.5 version.In 8.0.1 IBM included Quality stage, IBM information server (profile stage and audit stage) . these are not available in 7.5...
veer.dwh
- Jul 20th, 2009
Compare to DataStage 7.5 Accential DataStage, with DataStage 8.0 IBM websphere datastage Architecture got changedIn 8.0 IBM included client components of IBM information server which supports profiling stage along with Quality stage features are included in designer client component.
-
Rename Jobs
How will you rename all of the jobs to support your new File-naming conventions?
DatastageDev
- Jan 26th, 2010
More easily you can export to an XML file then simply do a find and replace. You can do this for any changes, job names, parameters, etc. Then import the jobs back to the project.
vkamatag
- Dec 8th, 2009
Create a excel spreadsheet with new and old names. Export the whole project as a .dsx. write a perl program, which can do simple rename of the strings looking looking up the excel file. Then import th...
-
Datastage Incremental Loading
How to do incremental loading in datastage?
veer.dwh
- Oct 15th, 2009
Abhijain is right. If you compare source with target using either lookup or change capture you can perform Incremental loading. But my requirement is I have a job like,Source-------->Transformer...
Abhijain
- Oct 14th, 2009
There are ways to perform the incremental load. While performing incremental load, Pls take care of below points:1. Retrieve changed records from last load run from source by using appropriate ex...
-
OCI Stage
Why array list is used in Oracle OCI stage? Brief about Important Options in OCI Stage.
Mili Jon
- Jan 16th, 2011
Array size is a property of OCI stage which help to reduce the context switch between DataStage and Oracle database. We should keep this in mind that however it help us reducing the context switch but...
DSQuest
- May 7th, 2010
I Suppose it is called "Array Size"....Array Size is mainly used to increase the buffer during Write operations into a Oracle DB in a Server job using the Oracle OCI stage.This comes of grea...
-
Commit and Rollback
How do you perform commit and rollback in loading jobs? What happens if the job fails in between and What will you do?
Sivaramakrishna
- Feb 23rd, 2012
There is an option in RDBMS stage as Transaction Isolation tab whether data commit or un commit.
Gokul21
- Jul 12th, 2010
There is an option called "Transsaction Grouping" is available. You can specify the condition there to commit or rollback if the job fails. This option is available in teradata.
-
Job Unlock
How to unlock a locked job in Datastage 8.0?
vharids
- Sep 3rd, 2010
We can unlock the jobs by using 'cleanup resources' optionin DS director-->tools->cleanup resources
-
Job Unlock
How to unlock a job in Datastage 8.0?
sivakumar.datastagepx
- Jan 19th, 2011
$ps -EF$kill PIDBy using above 2 commands in unix ...then we can kill the jobotherwise tools-> cleanup resourses
svasu.r
- Aug 14th, 2010
If you want unlock the jobDS DIRECTOR----------->JOB TAB-------->Clean up on resourcesIn admin enable priviliges to director
-
Data Validations
What various validations do you perform on the data after extraction?
varunndschange
- Aug 13th, 2010
In data validation we check for the data size, data type, removing extra spaces and applying proper null handling.
veer.dwh
- Aug 13th, 2010
It depends upon the requirment you needed.Some bascic checks:1. NULL validation2. Data type validationif you consider Data quality below points may come across1. Address fileld validations2. Word validations3. Character validations
-
Flat File Header and Footer
Does flatfile contain header & footer?How to remove Header & Footer from a flatfile before extracting the data?What information header & footer contains?
nikhilanshuman
- Nov 30th, 2010
Does flatfile contain header & footer? =>Yes, it may or may not contain header or footer depending on the requirements. How to remove Header & Footer from a flatfile before extracting t...
Brajesh Singh Bhadoriya
- Sep 20th, 2010
A Flat file can have header and trailor. These will contain the information about the file. For example, header will have date for which the file is, and trailor will have records count. this count ma...
-
InvocationId
What is invocation Id? How to find InvoicationID? What is the need of Invocation Id?
tapan8984
- Aug 12th, 2011
Invocation ID is the unique identifier for distinguishing the instances in multiple instance job. It is needed for uniquely define the instances. While running the job there is a field for Invocation ID in the run window (pop-up).
narra satish
- Mar 7th, 2011
Invocation id is nothing about instance. Normaly job run in only one instance.By enabling it will run in multiple instance. As long as running invocation Id is unique.
-
Improve performance using copy stage
How can we improve performance using copy stage
Datastage Etl
- May 13th, 2011
Copy stage is used to send the data to the multiple sources.?Here we can ?change the column names . Rather than using Transformer Stage where ever necessary , we can use the copy stage. Like this, c...
narra satish
- Mar 21st, 2011
By using copy stage we can increase the performance. In this stage we can do sorting, Removing unwanted columns
-
Job based scenario
TABLE T1 with c1 and Table T2 with c1
1 3
2 4
2 5
3
4
5
...Dinesh
- Aug 19th, 2011
Use lookup stage...and choose reject option !
you will get the matched records in master output file(3,4,5,5) and unmatched in reject file(1,2,2,6,7). -
Cannot find stage variables definition in the trasformer stage properties
I can only see the name of the stage variables but cannot see the definition, where can I find them?
manish_toy
- Jan 10th, 2012
If you are not able to view the definition then its has not been given. You have to provide the definition by double clicking to the left of the variable and give the definition as per your requirement.
manish_toy
- Jan 10th, 2012
If it is not visible in the transformer stage then the definition has not been given. You have to provide the definition for the stage variable by double clicking to the left of the variable, then you can give the definition as per your requirement.
-
What are the Environmental variables in Datastage?
Sushil
- Aug 19th, 2013
Basically Environment variable is predefined variable those we can use while creating DS job.We can set either as Project level or Job level.Once we set specific variable that variable will be available into the project/job
glaciya
- Dec 12th, 2011
The Environmental variables in datastage are some pathes which can support system can use as shortcuts to fulfill the program running instead of doing nonsense activity. In most time, environmental variables are defined when the software have been installed or being installed.
-
No of processors in DataStage
How do we know the no of processors in a job? Is there any specific calculation for this.
Mallikarjuna_G
- Aug 10th, 2013
There will not be any processors in the job. Your question could be - find the number of nodes/processors on which the job is running. So the answer to this - go to Director and open the log for the ...
Kumaresh
- Jul 19th, 2013
Run the job. Go to director log. Check for the apt config data displayed over there. That will show the number of processors/nodes.
DataStage Interview Questions
Ans