GeekInterview.com
  I am new, Sign me up!
 
GeekInterview.com  >  Interview Questions  >  Data Warehousing  >  DataStage
Go To First  |  Previous Question  |  Next Question 
 DataStage  |  Question 380 of 390    Print  
Dataset and Transformers Performance
How can you say that performance will be improve if we make use of a dataset?
Why does the performance degrade when we use 4-5 transformers in a single job?



  
Total Answers and Comments: 2 Last Update: January 17, 2009     Asked by: sundeepksk 
  
 Sponsored Links

 
 Best Rated Answer
Submitted by: ashokmadduri
 
Dataset are referring to control file due to this dataset will give fast performance while processing the data, if you use transformers in job, it should compile the C++ backend due to this datastage engine will get more pressure to handle transformer stage, if you use more number of transformers in a job


Above answer was rated as good by the following members:
aaron102, kumar_ch19
December 06, 2008 06:38:19   #1  
anurangevk Member Since: December 2008   Contribution: 1    

RE: Dataset and Transformers Performance

1. Using Dataset - The storage method is internal to datastage hence performance increases as less time is required to read from or write to a dataset
2. Transformers are very bulky with lot of functions inbuilt them so usage of more transformers slows down the speed at which job executes


 
Is this answer useful? Yes | NoAnswer is useful 1   Answer is not useful 0Overall Rating: +1    
January 17, 2009 00:35:35   #2  
ashokmadduri Member Since: January 2009   Contribution: 1    

RE: Dataset and Transformers Performance
Dataset are referring to control file due to this dataset will give fast performance while processing the data if you use transformers in job it should compile the C++ backend due to this datastage engine will get more pressure to handle transformer stage if you use more number of transformers in a job

 
Is this answer useful? Yes | NoAnswer is useful 1   Answer is not useful 1Overall Rating: -N/A-    

 Related Questions

ODBC : a) Poor Performance. b) Can be used for Variety of Databases. c) Can handle Stored Procedures. Plug-In: a) Good Performance. b) Database specific.(Only one database) c) Cannot handle Stored Procedures.  

Latest Answer : Partition the table if there is huge data. This will enhance performance statistics. ...

Used for Look-ups. It is like a reference table. It is also used in-place of ODBC, OCI tables for better performance.     
Latest Answer : We can also use the Hash File stage to avoid / remove dupilcate rowsby specifying the hash key on a particular fileld ...

What are other Performance tunings you have done in your last project to increase the performance of slowly running jobs?
Staged the data coming from ODBC/OCI/DB2UDB stages or any database on the server using Hash/Sequential files for optimum performance also for data recovery in case job aborts.Tuned the OCI stage for 'Array 

Most of the times the data was sent to us in the form of flat files. The data is dumped and sent to us. In some cases were we need to connect to DB2 for look-ups as an instance then we used ODBC drivers 

Latest Answer : hi,i am learnining datastage server job, but i dont have project to analyze, if u have any projects plz send it       gyvedamurthy@yahoo.co.in vedamurthy ...

Scenario based Question ........... Suppose that 4 job control by the sequencer like (job 1, job 2, job 3, job 4 )if job 1 have 10,000 row ,after run the job only 5000 data has been loaded in target table remaining are not loaded and your job going to be aborted then.. How can short out the problem.
Suppose job sequencer synchronies or control 4 job but job 1 have problem, in this condition should go director and check it what type of problem showing either data type problem, warning massage, job 
View Question | Asked by : Mukesh Kumar Madhav

Does Enterprise Edition only add the parallel processing for better performance?Are any stages/transformations available in the enterprise edition only?
Read Answers (2) | Asked by : stanis

1.What about System variables? 2.How can we create Containers? 3.How can we improve the performance of DataStage? 4.what are the Job parameters? 5.what is the difference between routine and transform and function? 6.What are all the third party tools used in DataStage? 7.How can we implement Lookup in DataStage Server jobs? 8.How can we implement Slowly Changing Dimensions in DataStage?. 9.How can we join one Oracle source and Sequential file?. 10.What is iconv and oconv functions? 11.Difference
Read Answers (5) | Asked by : sdfsdf

Latest Answer : DataSet supports parallelism but sequential file doesn't ...


 Sponsored Links

 
Related Articles

Business Intelligence Key Performance Indicators

Business Intelligence Key Performance Indicators What are Key Performance Indicators Key Performance Indicators are also known as Key Success Indicators they help an organization to better define and measure their progress toward professional goals Once an organization has clearly identified its nee
 

Breaking up XML into Relational Data

Breaking up XML into Relational Data While the preceding example shows how to construct an XML representation over relational data the example in this section illustrates how you can shred XML data back into relational data This reverse operation can be useful if your application works with relation
 

Querying Data with Oracle XQuery

Querying Data with Oracle XQuery Starting with Oracle Database 10g Release 2 you can take advantage of a full featured native XQuery engine integrated with the database With Oracle XQuery you can accomplish various tasks involved in developing PHP Oracle XML applications operating on any kind of dat
 

Retrieving XML Data

Retrieving XML DataTo retrieve XML data from an XMLType table you can use a SELECT SQL statement just as you would if you had to query a relational table For example to select the employee with the id set to 100 from the employees XMLType table discussed in the preceding section you might issue the
 

Using XMLType for Handling XML Data in the Database

Using XMLType for Handling XML Data in the Database Being an object type XMLType can not only be used to store XML data in the database but also to operate on that data via its built in methods Regardless of the storage model you choose XMLType provides a set of XML specific methods to operate on XM
 

Using Oracle Database for Storing, Modifying, and Retrieving XML Data

Using Oracle Database for Storing Modifying and Retrieving XML Data With Oracle XML DB you have various XML storage and XML processing options allowing you to achieve the required level of performance and scalability One of the most interesting things about Oracle XML DB is that it allows you to per
 

Business Performance Management

Business Performance Management What is Business Performance Management Business Performance Management is most commonly described as a set of processes that help companies or organizations optimize their business performance It is specifically designed to organize automate and analyze business meth
 

ODP.NET - Techniques to Improve Performance while Retrieving Data

ODP NET Techniques to Improve Performance while Retrieving Data Performance tuning is a great subject in Oracle Volumes of books would not be enough to cover every aspect of performance tuning in Oracle However in this section we will only discuss the fundamental performance techniques while working
 

ODP.NET - Presenting Master-Detail Information Using a Dataset

ODP NET Presenting Master Detail Information Using a Dataset As mentioned before a DataSet object can have its own relations between data tables existing in it We can add these relations dynamically at the client side within an application to represent master detail or hierarchical information The f
 

ODP.NET - Populating a Dataset with a Single Data Table

ODP NET Populating a Dataset with a Single Data Table A dataset is simply a group of data tables These data tables can be identified with their own unique names within a dataset You can also add relations between data tables available in a dataset mosgoogle The following code gives you the details o
 

About Us -  Privacy Policy -  Terms and Conditions -  Contact -  Ask Question -  Propose Category -  Site Updates 

Copyright © 2005 - 2009 GeekInterview.com. All Rights Reserved

Page copy protected against web site content infringement by Copyscape