-
Incremental Loading
How to do incremental loading in datastage?
Abhijain
- Feb 8th, 2010
This question is been answered many times before. Do go through the link below--http://www.geekinterview.com/question_details/77425
-
Datastage Incremental Loading
How to do incremental loading in datastage?
veer.dwh
- Oct 15th, 2009
Abhijain is right. If you compare source with target using either lookup or change capture you can perform Incremental loading. But my requirement is I have a job like,Source-------->Transformer...
Abhijain
- Oct 14th, 2009
There are ways to perform the incremental load. While performing incremental load, Pls take care of below points:1. Retrieve changed records from last load run from source by using appropriate ex...
-
Job Schedule
How to schedule jobs in UNIX Server?
Abhijain
- Feb 8th, 2010
Couple of ways to schedule the Datastage jobs/sequences-1. Can be done using Datastage Director Tool 2. Normally done using crontab script. You can easily get it through google.3. Can use Third party scheduling tools like Autosys
veer.dwh
- Jul 20th, 2009
DataStage job scheduling we can do using datastage director client tool, but in real time they use UNIX for DataStage job scheduling which supports 3rd party scheduling tools like Autosys, Triviam, UNIX corn tab etc.
-
Delete Dataset
-
Job Sequence
How to create Job Sequence?
Abhijain
- Feb 8th, 2010
Have you ever tried opening Datastage and browse all the available options.To create a job sequence. Below are the steps;1. Open Datastage2. Open New Job Sequence3. Save it with some name.4. A your job sequence is created.5. Now drag the job sequence stages-->as per your business requirement.
veer.dwh
- Jul 20th, 2009
You can create job sequencer using designer client, if you click create new job like server or px job in Datastage, it will get open window there you can find to create the job sequencer.Job sequencer uses to run multiple jobs either server or px based on the dependencies.
-
Move data using DataStage
How to move data from operational and external environments to BI environment using datastage software?
Abhijain
- Oct 19th, 2009
Question is not clear.Are you talking about moving OLTP data to OLAP system?
-
Data Sets and File Sets
Expalin difference between Data Sets and File Sets? where each one is used and how they are used?What is the size limit?
Abhijain
- Sep 19th, 2008
The dataset and fileset both are file stage. Dataset can have single input link or single output link whereas, Fileset can have single input link or single output link and a single reject link.File se...
-
Use of Terminator Activity
What is the Use of Terminator Activity in Datastage server Jobs?
nikhilanshuman
- Mar 19th, 2010
The terminator activity is used to terminate/abort a job in particulat conditions.user can define his own flow to the terminator activity.
Abhijain
- Sep 19th, 2008
A terminator stage can be used in a job sequence to ensure that the sequence is stopped cleanly if certain situations arise. You can have multiple terminator activities and can place them anywhere in ...
-
BASIC Transformer and NORMAL Transformer
What is the Exact difference between BASIC Transformer and NORMAL Transformer?When we will go for BASIC Or NORMAL Transformer?
nikhilanshuman
- Mar 19th, 2010
Difference: - A Basic transformer compiles in "Basic Language" whereas a Normal Transformer compiles in "C++".- Basic transformer does not run on multiple nodes wheras a Normal Tra...
Abhijain
- Sep 19th, 2008
The basic transformer stage is similar in appearance and function to the Normal Transformer Stage. Basic transformer stage can only be used for SMP(Symmetric Multiprocessors) systems and not for MPP(Massively Parellel Processing) system or clusters systems.
-
Remove Duplicate Records
what is process to remove duplicate records using Copy Stage.
Abhijain
- Sep 26th, 2008
In the copy stage, there is an option to sort the input data where you can select the key on the basis of which you can perform the sort operation. There is an option named 'Unique'. Select th...
-
SCD Type2 in Enterprise Edition
How to implement Slowly changing dimesions Type2 in Parallel jobs . What are the stages we use and How to assign the key?
Abhijain
- Oct 19th, 2009
Datastage Px 8.0.1 is having SCD stage to perform the required operation. Or it can be achived by using lookup/change capture stage in between source and target database.
-
DataStage Transformer stage Server Jobs and Parallel Jobs
What is the difference between transformer stage in serverjobs and transformer stage in parallel job?
Abhijain
- Sep 19th, 2008
Transformer stage in server jobs vs Transformer stage in Parallel jobs In server jobs, support single input stream link and multiple input reference link where in parallel support only single input st...
-
Problems with Datastage - Date format & Null Handling of a Date field in a schema file
Hi,I have a .csv file as my source.I am reading the data using asequential file stage.Then I am validating the format of the data using a schema file.The date format of the incoming file is '%dd/%mm/%yyyy'.So the datecolumn has a fixed length 10.Now according to the provided incoming data set the date column shouldbe nullable.Can anybody please provide an idea how to handle a nullable datecolumn using...
Abhijain
- Oct 19th, 2009
Read the date field column as varchar and use transformer to check nullabiltiy and if null found assign some default value say '12-Dec-9999' and use the appropriate conversion function an...
Abhijain
- Oct 19th, 2009
Read date field from sequential file as varchar datatype with nullable yes. Use modify stage or transformer to convert the datatype and also check the nullability of the incoming data and if null foun...
-
Parameter file usage in Datastage
Can anyone tel me how to use a file to fetch the parameter values for a parallel job in datastage as i don't want it to be hard coded.The format for the file shall be (name,value) pair. please help me...Thanks,Deepa
Abhijain
- Oct 3rd, 2008
In Datastage sequence, there is a stage named "UserVariable_Activity", this can use to fetch the parameter. Create a new user variable in the uservariable_activity stage and for the expression part of it, you can simply give your parameter file path.
-
Is Hashed file an Active or Passive Stage? When will be it useful?
vasanthsolai
- Apr 17th, 2008
Hash file is passive stage,it wil be used in lookup,the hash file using hahing algorithm and reterive the data faster...
wahi80
- Feb 20th, 2008
Has files is a passive stage. In DS Server edition hash files are used in jobs where lookups are required. Hash files are generally used in intermediate jobs in DS, where there is a need tostore data in anintermediate table format
-
How can we increment the surrogate key value for every insert in to target database
-
Are there any ways of passing parameters or values across parallel jobs in a sequencer? Scenario: Job 'A' would execute and based on the result of the Job we want either Job 'B' or Job 'C' to execute. Hence the result of Job 'A' would determine the sequence of operation.
Abhijain
- Jul 29th, 2008
Not clear from your question, what do you mean by the result of the job. what I got is- you want to perform the conditional run of the jobs. It can be possible through sequencer.In sequence, You can c...
subrahmanyam sanka
- Aug 2nd, 2007
Please eloborate your question "based on result of job", one techinque is to use the parameter file and set other session based on event wait.
-
How can i call a stored procedure only once instead of calling for each and every row?
Abhijain
- Sep 23rd, 2008
There is a stage named Stored Procedure available in Datastage palette under Database category. You can use that stage to call your procedure in Datastage jobs.
-
what is quality stage and profile stage?
vasanthsolai
- Apr 14th, 2008
Quality stage is used for check the quality..profle stage is used to anaylse the data and their relationship
Abhijain
- Feb 20th, 2008
Quality stage is a data integration tool from ascential which is used to stadardize/integrate the data from different sources.
-
in datastage how we can do for this type or requirement:The sales data will be extracted in 2 flat files.Here is the codification suggested: SALE_HEADER_XXXXX_YYYYMMDD.PSVSALE_LINE_XXXXX_YYYYMMDD.PSVXXXXX = LVM sequence to ensure unicity and continuity of file exchangesCaution, there will an increment to implement.YYYYMMDD = LVM date of file creation COMPRESSION AND DELIVERY TO: SALE_HEADER_XXXXX_YYYYMMDD.ZIP AND SALE_LINE_XXXXX_YYYYMMDD.ZIPif suppose we run first time means the job names are sale_header_1_systemcurrentdate & sale_line_1_systemcurrentdate.if we run next time means the file name are sale_header_2_systemcurrentdate & sale_line_2_systemcurrentdate.if we run next time means the file names aresale_header_3_systemcurrentdate & sale_line_3_systemcurrentdate.we want one increment in that xxxxx place .can any one give suggestion on this issue.?
Abhijain
- Jul 29th, 2008
I am not sure will this work or not, I've not tried, but you can check with the looping stage from a sequence.Call a job activity in a job sequence where you invoke a job ...
-
How I can convert Server Jobs into Parallel Jobs?
veer.dwh
- Oct 1st, 2009
Hi,I have worked on server to px migration project. you can't directly convert a server job to PX job. the only way is, you have to redevelop the px job using px environment.Regards,Veeru.
Abhijain
- Feb 20th, 2008
On a job level- to convert server jobs into a parellel job is not possible.The mechnism of server jobs is different then that of parellel jobs.You have to re-build the job.
