Geeks Talk

Prepare for your Next Interview


Welcome to the Geeks Talk forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact contact us.

How to do the performance tuning at various levels

This is a discussion on How to do the performance tuning at various levels within the Data Warehousing forums, part of the Databases category; Can any one tell me how to do the performance tuning at Source level, Target level, Mapping level and Session Thanks Dev...

Go Back   Geeks Talk > Databases > Data Warehousing
Register Blogs FAQ Tag Cloud Calendar Mark Forums Read

Data Warehousing Data Warehousing

Reply

 

LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 04-14-2007
Junior Member
 
Join Date: Oct 2006
Location: India
Posts: 1
Thanks: 0
Thanked 0 Times in 0 Posts
praveenb6 is on a distinguished road
How to do the performance tuning at various levels

Can any one tell me how to do the performance tuning at Source level, Target level, Mapping level and Session

Thanks
Dev
Reply With Quote
Sponsored Links
  #2 (permalink)  
Old 04-17-2007
Junior Member
 
Join Date: Apr 2007
Location: La
Posts: 5
Thanks: 0
Thanked 1 Time in 1 Post
jagadishwar is on a distinguished road
Re: How to do the performance tuning at various levels

You can improve performance at source leve using sqlquery and sorted input
and another way is to keep a filter transformation after sql transformation
Using partition type key range at source level.
Target level writing to file loads data faster than database. and use key range partition type at target level.
Tranasformations permformance can be improved using look up with dynamic cache and keeping erlier filter using Aggregator with sorted input ,remove unwanted ports from lookup,filter and other trasnformations
Session level Partioning helps u to improve performance.reading the session log details give where the bottleneck occured by cheking busy process and idle process. if the busy percntage is more than idle percentage it is a bottleneck.
I hope these are bottlenecks occured in informatica and using above technics improve performance
Reply With Quote
  #3 (permalink)  
Old 04-18-2007
Junior Member
 
Join Date: Feb 2007
Location: india
Posts: 5
Thanks: 0
Thanked 1 Time in 1 Post
ggk.krishna is on a distinguished road
Re: How to do the performance tuning at various levels


Hi Praveen,
First we have to identify the bottlenecks and then optimize.

1. Target : Load the data to a table and a flat file. If there is a time difference we can say that there is a target bottleneck.

Use target load type BULK.
Drop indexes and key constraints before loading and re-built them after the loading.

2. Source: For flat file sources mostly bottlenecks don't araise. If so increase the no. of bytes power center reads per line (default 1024 bytes) in the session properties.
If source is a table, we can identify using filter conditions and sql qery execution. Use filter transformation and set the condition as FALSE and observe the time.
Execute the sql query in the source database, observe the time taken for retrieving the rows.
Optimize the sql query in the SQL override and use conditional filters.
3.Mapping : We can identify the bottlenecks using conditional filters.
More lookups in the mapping reduces performance.
Avoid unnecessary data type conversions.
Remove unnecessary pipe lines and output ports.
4.Session: Use "Collect performance details" option in the session properties, so that we can get performance details log.In that any value other than zero for read to disk and write to disk, then there is a bottlneck.
Increase the commit intervals and cache size.
Set the tracing level Normal or Terse.
5.System : Using some tools like Task manager we can identify.
Improve the system configuration and network.

If any corrections needed give reply.


Thanks & Regards,
G Gopi Krishna.

Reply With Quote
Reply

  Geeks Talk > Databases > Data Warehousing

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Similar Threads

Thread Thread Starter Forum Replies Last Post
Performance of Database fred Database General 2 10-13-2007 07:08 AM
Performance of SQL over My SQL paluri MY SQL 2 05-11-2007 11:24 AM
Oracle Database Tuning Jim.Anderson Oracle 0 12-11-2006 08:22 PM
Types and Levels of Testing in Programming Lokesh M Testing Issues 1 10-14-2006 12:46 AM
Why are Levels defined like this GregMark MainFrame 0 10-01-2006 05:33 PM


All times are GMT -4. The time now is 08:50 PM.


Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO 3.3.1
Copyright © 2009 GeekInterview.com. All Rights Reserved