What is Data Transformation Manager?

After the load manager performs validations for the session, it creates the DTM process. The DTM process is the second process associated with the session run. The primary purpose of the DTM process is to create and manage threads that carry out the session tasks.


· The DTM allocates process memory for the session and divide it into buffers. This is also known as buffer memory. It creates the main thread, which is called the master thread. The master thread creates and manages all other threads.


· If we partition a session, the DTM creates a set of threads for each partition to allow concurrent processing.. When Informatica server writes messages to the session log it includes thread type and thread ID.


Following are the types of threads that DTM creates:

Master Thread - Main thread of the DTM process. Creates and manages all other threads.

Mapping Thread - One Thread to Each Session. Fetches Session and Mapping Information.

Pre and Post Session Thread - One Thread each to Perform Pre and Post Session Operations.

Reader Thread - One Thread for Each Partition for Each Source Pipeline.

Writer Thread - One Thread for Each Partition if target exist in the source pipeline write to the target.

Transformation Thread - One or More Transformation Thread For Each Partition.

Editorial / Best Answer

Goush  

  • Member Since May-2007 | May 15th, 2007


When the workflow reaches a session, the Integration Service process starts
the DTM process. The DTM is the process associated with the session and it
performs the following tasks:


1. Retrieves and validates session information from the repository.


2. Performs pushdown optimization when the session is configured for
pushdown optimization.


3. Adds partitions to the session when the session is configured for dynamic
partitioning.


4. Forms partition groups when the session is configured to run on a grid.


5. Expands the service process variables, session, and mapping variables and
parameters.


6. Creates the session log.


7. Validates source and target code pages.


8. Verifies connection object permissions.


9. Runs pre-session shell commands, stored procedures and SQL.


10. Sends a request to start worker DTM processes on other nodes when the
session is configured to run on a grid.


11. Creates and runs mapping, reader, writer, and transformation threads to
extract, transform, and load data.


12. Runs post-session stored procedures, SQL, and shell commands


13. Sends post-session email.

Showing Answers 1 - 12 of 12 Answers

Goush

  • May 15th, 2007
 

When the workflow reaches a session, the Integration Service process starts
the DTM process. The DTM is the process associated with the session and it
performs the following tasks:


1. Retrieves and validates session information from the repository.


2. Performs pushdown optimization when the session is configured for
pushdown optimization.


3. Adds partitions to the session when the session is configured for dynamic
partitioning.


4. Forms partition groups when the session is configured to run on a grid.


5. Expands the service process variables, session, and mapping variables and
parameters.


6. Creates the session log.


7. Validates source and target code pages.


8. Verifies connection object permissions.


9. Runs pre-session shell commands, stored procedures and SQL.


10. Sends a request to start worker DTM processes on other nodes when the
session is configured to run on a grid.


11. Creates and runs mapping, reader, writer, and transformation threads to
extract, transform, and load data.


12. Runs post-session stored procedures, SQL, and shell commands


13. Sends post-session email.

jaya krishna

  • Aug 10th, 2007
 

Load manager and DTM are not the process in Informatica Sever. These are the components in Informatica server. Dont call these are the processes.

  Was this answer useful?  Yes

chandrarekha

  • Sep 6th, 2007
 

Load manager and DTM are the components of Informatica server.  Load manager manages the load on the server by maintaining a queue of sessions and release the session based on first come and first serve. When the session is released from the load manager, it initializes the master process called DTM. DTM modifies the data according to the instructions coded in the session mapping.

load manager creates the DTM(data transformation manager)in the work flow manager by the informatica server ,here DTM creates two threads 1.reader thread
2.writer thread
DTM reads the data from  the reader buffer coming from the sources and moves the data from transformation to transformation on row by row basis amd writes or loads in to target after completing this activity the DTM comes out

  Was this answer useful?  Yes

Give your answer:

If you think the above answer is not correct, Please select a reason and add your answer below.

 

Related Answered Questions

 

Related Open Questions