-
Rename Jobs
How will you rename all of the jobs to support your new File-naming conventions?
DatastageDev
- Jan 26th, 2010
More easily you can export to an XML file then simply do a find and replace. You can do this for any changes, job names, parameters, etc. Then import the jobs back to the project.
vkamatag
- Dec 8th, 2009
Create a excel spreadsheet with new and old names. Export the whole project as a .dsx. write a perl program, which can do simple rename of the strings looking looking up the excel file. Then import th...
-
Datastage Incremental Loading
How to do incremental loading in datastage?
veer.dwh
- Oct 15th, 2009
Abhijain is right. If you compare source with target using either lookup or change capture you can perform Incremental loading. But my requirement is I have a job like,Source-------->Transformer...
Abhijain
- Oct 14th, 2009
There are ways to perform the incremental load. While performing incremental load, Pls take care of below points:1. Retrieve changed records from last load run from source by using appropriate ex...
-
OCI Stage
Why array list is used in Oracle OCI stage? Brief about Important Options in OCI Stage.
Mili Jon
- Jan 16th, 2011
Array size is a property of OCI stage which help to reduce the context switch between DataStage and Oracle database. We should keep this in mind that however it help us reducing the context switch but...
DSQuest
- May 7th, 2010
I Suppose it is called "Array Size"....Array Size is mainly used to increase the buffer during Write operations into a Oracle DB in a Server job using the Oracle OCI stage.This comes of grea...
-
Commit and Rollback
How do you perform commit and rollback in loading jobs? What happens if the job fails in between and What will you do?
Sivaramakrishna
- Feb 23rd, 2012
There is an option in RDBMS stage as Transaction Isolation tab whether data commit or un commit.
Gokul21
- Jul 12th, 2010
There is an option called "Transsaction Grouping" is available. You can specify the condition there to commit or rollback if the job fails. This option is available in teradata.
-
Job Unlock
How to unlock a locked job in Datastage 8.0?
vharids
- Sep 3rd, 2010
We can unlock the jobs by using 'cleanup resources' optionin DS director-->tools->cleanup resources
-
Job Unlock
How to unlock a job in Datastage 8.0?
sivakumar.datastagepx
- Jan 19th, 2011
$ps -EF$kill PIDBy using above 2 commands in unix ...then we can kill the jobotherwise tools-> cleanup resourses
svasu.r
- Aug 14th, 2010
If you want unlock the jobDS DIRECTOR----------->JOB TAB-------->Clean up on resourcesIn admin enable priviliges to director
-
Data Validations
What various validations do you perform on the data after extraction?
varunndschange
- Aug 13th, 2010
In data validation we check for the data size, data type, removing extra spaces and applying proper null handling.
veer.dwh
- Aug 13th, 2010
It depends upon the requirment you needed.Some bascic checks:1. NULL validation2. Data type validationif you consider Data quality below points may come across1. Address fileld validations2. Word validations3. Character validations
-
Flat File Header and Footer
Does flatfile contain header & footer?How to remove Header & Footer from a flatfile before extracting the data?What information header & footer contains?
nikhilanshuman
- Nov 30th, 2010
Does flatfile contain header & footer? =>Yes, it may or may not contain header or footer depending on the requirements. How to remove Header & Footer from a flatfile before extracting t...
Brajesh Singh Bhadoriya
- Sep 20th, 2010
A Flat file can have header and trailor. These will contain the information about the file. For example, header will have date for which the file is, and trailor will have records count. this count ma...
-
InvocationId
What is invocation Id? How to find InvoicationID? What is the need of Invocation Id?
tapan8984
- Aug 12th, 2011
Invocation ID is the unique identifier for distinguishing the instances in multiple instance job. It is needed for uniquely define the instances. While running the job there is a field for Invocation ID in the run window (pop-up).
narra satish
- Mar 7th, 2011
Invocation id is nothing about instance. Normaly job run in only one instance.By enabling it will run in multiple instance. As long as running invocation Id is unique.
-
Improve performance using copy stage
How can we improve performance using copy stage
Datastage Etl
- May 13th, 2011
Copy stage is used to send the data to the multiple sources.?Here we can ?change the column names . Rather than using Transformer Stage where ever necessary , we can use the copy stage. Like this, c...
narra satish
- Mar 21st, 2011
By using copy stage we can increase the performance. In this stage we can do sorting, Removing unwanted columns
-
Job based scenario
TABLE T1 with c1 and Table T2 with c1
1 3
2 4
2 5
3
4
5
...Dinesh
- Aug 19th, 2011
Use lookup stage...and choose reject option !
you will get the matched records in master output file(3,4,5,5) and unmatched in reject file(1,2,2,6,7). -
Cannot find stage variables definition in the trasformer stage properties
I can only see the name of the stage variables but cannot see the definition, where can I find them?
manish_toy
- Jan 10th, 2012
If you are not able to view the definition then its has not been given. You have to provide the definition by double clicking to the left of the variable and give the definition as per your requirement.
manish_toy
- Jan 10th, 2012
If it is not visible in the transformer stage then the definition has not been given. You have to provide the definition for the stage variable by double clicking to the left of the variable, then you can give the definition as per your requirement.
-
What are the Environmental variables in Datastage?
Sushil
- Aug 19th, 2013
Basically Environment variable is predefined variable those we can use while creating DS job.We can set either as Project level or Job level.Once we set specific variable that variable will be available into the project/job
glaciya
- Dec 12th, 2011
The Environmental variables in datastage are some pathes which can support system can use as shortcuts to fulfill the program running instead of doing nonsense activity. In most time, environmental variables are defined when the software have been installed or being installed.
-
No of processors in DataStage
How do we know the no of processors in a job? Is there any specific calculation for this.
Mallikarjuna_G
- Aug 10th, 2013
There will not be any processors in the job. Your question could be - find the number of nodes/processors on which the job is running. So the answer to this - go to Director and open the log for the ...
Kumaresh
- Jul 19th, 2013
Run the job. Go to director log. Check for the apt config data displayed over there. That will show the number of processors/nodes.
-
What is the size of your database ?
Please answer this question
-
Job running slow
Hi,
Job1 is running for 10 minutes for the first time and the same job1 is running for 15 minutes for the second time ,the load being the same for both.Could someone explain..Mallikarjuna_G
- Aug 10th, 2013
One reason could be that - for the first time the job is just loading/inserting data into target. When you run the same job again, it would take more time as it tries to update from second time. Upda...
Raju Nath
- Jun 27th, 2013
Hi you can use the delete and then load command during loading then it will be the same time. First time when you are loading that time the dataset/table is empty that is why its taking less time bu...
-
-
Flatfiles(.txt,.csv,xml) to laod sequential files?
How can we load three different flat files(1 file .txt,2 file .csv,3 file xml) to sequential file at a time?
-
How to read a comma delimiter file in sequential file stage?
How we read comma delimiter file in sequential file stage and how we can remove the header and footer from a comma delimiter file?
deepakatsit
- Oct 29th, 2014
For Removing Header file you can use SED Command of UNIX to remove Header.
deepakatsit
- Oct 23rd, 2014
For Sequential file there is an option "First Row Column Name" set to true so Header is removed and File End Type You need to select through which Footer is Removed.
Now For Comma Delimiter Use : :"Field Defaults -> Delimiter = Comma" -
What is range look up and how it is used in datastage.
Say I have 5 rows in a source table and for each rows 10 rows matching in a lookup table and my range is for lookup is 9 to 99. what will be the row count in output table?
DataStage Interview Questions
Ans