GeekInterview.com
   Home |  Tech FAQ  |   Interview Questions |  Placement Papers |  Tech Articles |  Learn |  Freelance Projects |  Online Testing |  Geeks Talk |  Job Postings |  Knowledge Base | Site Search |  Add/Ask Question

GeekInterview.com  >  Interview Questions  >  Data Warehousing  >  Abinitio
Go To First  |  Previous Question  |  Next Question 
 Abinitio  |  Question 97 of 193    Print  
How to Improve Performance of graphs in Ab initio?
Give some examples or tips.
thanks,

  
Total Answers and Comments: 4 Last Update: July 06, 2006     Asked by: windows 
  
 Sponsored Links

 
 Best Rated Answer

No best answer available. Please pick the good answer available or submit your answer.
June 13, 2006 13:23:20   #1  
pavani        

RE: How to Improve Performance of graphs in Ab initio?...

There are somany ways to improve the performance of the graphs in Abinitio.

I have few points from my side.

1.Use MFS system using Partion by Round by robin.

2.If needed use lookup local than lookup when there is a large data.

3.Takeout unnecessary components like filter by exp instead provide them in reformat/Join/Rollup.

4.Use gather instead of concatenate.

5.Tune Max_core for Optional performance.

6.Try to avoid more phases.


 
Is this answer useful? Yes | No
June 22, 2006 01:25:21   #2  
satish kumar        

RE: How to Improve Performance of graphs in Ab initio?...

hi,

to improve the perfomance of the graph,

  1. Go Parallel as soon as possible using Ab Initio Partitioning technique.
  2. Once Data Is partitioned do not bring to serial , then back to parallel. Repartition instead.
  3. For Small processing jobs serial may be better than parallel.
  4. Do not access large files across NFS, Use FTP component
  5. Use Ad Hoc MFS to read many serial files in parallel and use concat coponenet.

 

1.      Using Phase breaks let you allocate more memory to individual component and make your graph run faster

2.      Use Checkpoint after the sort than land data on to disk

3.      Use Join and rollup in-memory feature

4.      Best performance will be gained when components can work with in memory by MAX-CORE.

5.      MAR-CORE for SORT  is calculated by finding size of input data file.

6.      For In-memory join memory needed is equal to non-driving data size + overhead.

7.      If in-memory join cannot fir its non-driving inputs in the provided MAX-CORE then it will drop all the inputs to disk and in-memory does not make sence.

8.      Use rollup and Filter by EX as soon as possible to reduce number of records.

9.      When joining very small dataset to a very large dataset, it is more efficient to broadcast the small dataset to MFS using broadcast component or use the small file as lookup.

 

 

cheers

satish kumar


 
Is this answer useful? Yes | No
July 05, 2006 06:09:38   #3  
Prathiba        

RE: How to Improve Performance of graphs in Ab initio?...

1. Use MFS, use Round robin partition or load balance if you are not joining or rollup

2. Filter the data in the beginning of the graph.

3.Take out unnecessary components like filter by expression instead use select expression in join, rollup, reformat etc

4. Use lookups instead of joins if you are joining small tale to large table.

5. Take out old components use new components like join instead of math merge .

6. Use gather instead of  concat

7. Use Phasing if you have too many components

8. Tune the max core for optimal performance

9.Avoid sorting data by using in memory for smaller datasets join

10.Use Ab Initio layout instead of database default to achieve parallel loads

11. Change AB_REPORT parameter to increased monitoring duration ( )

12. Use catalogs for reusability

 


 
Is this answer useful? Yes | No
July 06, 2006 18:02:46   #4  
       

RE: How to Improve Performance of graphs in Ab initio?...

The performance can be improved in several ways, I put some of them what I remembered...

1. Use sort after partition component instead of before.

2. Partition the data as early as possible and departition the data as late as possible.

3. Filter unwanted fields/records as early as possible.

4. Try to avoid the usage of join with db component.


 
Is this answer useful? Yes | No


 
Go To Top


 Sponsored Links

 
Sponsored Links

 




About Us  |   Privacy Policy  |   Terms and Conditions  |   Contact  |   Site Map  |   Add Question  |   Propose Category  |   RSS Feeds  |   Articles Sitemap  |   Site Updates  |   Add Resource

Copyright © 2005 - 2008 GeekInterview.com. All Rights Reserved
Page copy protected against web site content infringement by Copyscape