-
Server transformer and Parallel transformer
Explain the difference between server transformer and parallel transformer
kairunnisha.k
- Aug 4th, 2008
Server transfomer is same as basic transfomer used in SMP systems. Uses a server interface to call a server transformer stage. But parallel transfomer are same as normal transfomer used in parallel jobs. They use a c-based environment that is called osh (orchestrate shell).
santhosh.gsk
- Dec 27th, 2007
The main difference is server Transformer supports basic transforms only,but in pararllel both basic and pararllel transforms. server transformer is basic language compatability,pararllel transformer is c++ language compatabillity.
-
Why you need Modify Stage?
When you are able to handle Null handling and Data type changes in ODBC stages why you need Modify Stage?
leelasankar.pr
- Jul 22nd, 2008
By using this modify stage we can change data types,keep and drop columns and also we can handle null values
-
Sparse Lookup and Normal Lookup
What are the differences between Sparse Lookup and Normal Lookup?
karthikgeekkarthik
- Jul 9th, 2008
normal look-up:all the reference table data is stored in the buffer for cross- check with the primary table data.sparse lookup:each record of the primary table is cross checked with the reference tabl...
nagakalyan
- Jun 23rd, 2008
Sparse means we will generate query source bases and one by one record ,and normal is we can take look up on target table at a time multiple records
-
Can we pass the parameters in job sequence
nikhilanshuman
- Mar 10th, 2010
Parameters can be passed to the job sequence using a shell script.Following is the command to run the sequence with passing the parameters :dsjob -run mode Normal -param param=value projectname S...
nikhilanshuman
- Dec 25th, 2009
Please provide more details.=> Are you asking to pass the parameters to the job sequence from any external script?=> Are you asking passing parameters to a parallel job from sequence?
-
Remove duplicates using transformer
How do you remove duplicates using transformer stage in datastage
Jaimy Chacko
- Oct 26th, 2009
To capture rejected duplicates use a Transformer. Partition and sort on your primary key. In a transformer keep the primary key stored in a Stage Variable. Compare incoming primary key to the stored p...
umamahesh.ds
- Jul 25th, 2008
In that Time double click on transformer stage---> Go to Stage properties(its having in hedder line first icon) ---->double click on stage properties --->Go to inputs ---->go to part...
-
Setting up of node
How do we set up nodes in Datastage?
amitarudra
- Jan 29th, 2010
We can set the nodes in the follwing path C:AscentialDataStageConfigurations, which is a text file containing { node "node1" { &nb...
john_345
- Nov 19th, 2008
Here not the question of admin or developer.For the above question we have provide proper answer, like Go to DS manager and create nodes into Configuaration file according to the requirement. Please if any of DS admin registered expecting step by step process. Mine is also not clear answer.
-
How do you use Surrogatekey key in reporting?
Mallikarjuna_G
- Aug 10th, 2013
In a typical data warehouse environment, we normally have a requirement to keep history. So, we would end up having multiple rows for a given Primary key. So, we define a new column that doesn't have ...
djkool4u
- Jul 11th, 2013
Is Slowly Changing Dimension (SCD) Implementation we use Surrogate key as the primary key is being duplicated for the sake of keeping history data for the records with the same pk.
-
User Created Stages
Explain Wrapped, Build and Custom stages?
Phuzzball
- Feb 15th, 2012
Datastage allows you to create your own stages with custom properties. There are three types of custom stages: Custom: This is Orchestrate based custom stage. Orchestrate operators are used for def...
MArcus_Datastage
- Mar 17th, 2009
Custom: This allows knowledgeable Orchestrate users to specifyan Orchestrate operator as a DataStage stage. This is then availableto use in DataStage Parallel jobs.Build: This allows you to design and...
-
Sequential File Stage
If are given a list of .txt files and asked to read only the first 3 files using seq file stage. How will you do it?
matan
- Nov 16th, 2012
In sequential file we can take a single file by using the file as Specified file.
But we can take the more than one file use File Pattern with different file names.
Metadata must be same.narra satish
- Mar 25th, 2011
HI, In sequential file we can take a single file byusing the file as Specifyed file.But we can take the more than one file use File Pattern with different file names.Metadata must be same.
-
Link sort/Stage sort
What is the use of sort stage when you have explicit sort stage?
nikhilanshuman
- Dec 9th, 2010
Link Sort and stage sort,both do the same thing.Only the Sort Stage provides you with more options like the amount of memory to be used,remove duplicates,sort in Ascending or descending order,Create change key columns and etc.These options will not be available to you while using Link Sort.
praveen.sarva
- Dec 1st, 2010
Simple... For huge amount of data we prefer link sorting... Under partitions for small and compatable data we use stage sort(nothing but sort with in data set).
-
Stage Variables Initialization
What are the initial values of stage variables? How can we set this values?
glaciya
- Dec 12th, 2011
In my thought, the inital variables are the variables which can be defined when you just have installed the software, in another word they are usually called default variable or you have the first chance to create and config some variables that are used in a stage.
G. Venu
- Oct 14th, 2011
In Transformer stage properties we can set the stage variable initial value.
-
How to Create new user in Datastage 7.5
I want to create new user in datastage 7.5 I dont know how to do it?
manoj kumar ganji
- Jan 23rd, 2011
User creation in 7.5 is os dependant i.e.., you can make creation of users in OS. For example when you load DS on Windows XP, then create new user in user accounts in control panel.
tisha24
- Dec 13th, 2010
The user created in and for windows will be a user for datastage by default..You can't crete a user from datastage environment. If you want to create a user create through Control panel user.. The...
-
Join Stage Reject Records
How to get the reject records from join stage?
AvelinCorreia
- Feb 23rd, 2012
If you want rejected records also, you need to use an outer join so that all the records are carried forward and then youll need to use next stage as a transformer. In the transformer, you can use appropriate condition in the constraints and redirect the unwanted records to a sequential file.
Bharath
- Feb 14th, 2012
Outside the join stage, you can put a filter to filter out the records having null values for the columns coming from right part of the join
-
Reading multiple files through sequential file
What are the ways to read multiiple files from sequentila file if the both files are differnt
-
Conditional load of records in Datastage
Source has sequential file stage in 10 records and move to transformer stage it has one output link 2 records and reject link has 5 records ? But i want remaining 3 records how to capture
Shirisha
- Oct 10th, 2012
You can choose O.W option in constraints, so remaining records you will get.
anil_k_nayaka
- Jan 25th, 2012
In the transformer Stage Constraints we can define the constraints where this records can get to which link so that the missing records can get catched.
-
-
Datastage partition
Which partition followed by joiner,merge. lookup,remove duplicate
lalit
- Oct 9th, 2017
For join, merge and remove duplicated you can use Hash partitioning and for lookup you can use entire partitioning
Thank you
Mallikarjuna_G
- Aug 10th, 2013
For Join, Merge and Remove duplicates, have data on links hash key partitioned an sorted on Key columns specified. For lookup - primary link needs to be hash key partitioned and sorted and reference link has to use entire partition method.
-
How to get the last day of the current month?
I have explored all the available functions in the transformer stage, but could not find the exact function to get the last day of the current month. Can you please show me which function is available for this logic.
venueksh
- Apr 8th, 2014
Oracle has LAST_DAY function:
SELECT LAST_DAY(to_date(07/04/2014,MM/DD/YYYY)) from dual;
SELECT LAST_DAY(SYSDATE) from dual; -
Source file and 3 output tables records problem
Suppose i am having a source file and 3 output tables and I want first row to be written to first table second row to second table, third row to third table likewise how can we achieve this using datastage without using partitioning?
-
Datastage scenario - two columns in the source
I have two columns in the source , COl A and Col B .
Input is like
Cola Colb
100 ABCDEF
I should achieve the output as
Cola Colb
100 A
100 B
100 C
100 D
100 E
100 F
Note : Colb is not of fixed length .
DataStage Interview Questions
Ans