You have 10 stages and each stage can be partitioned and run on 4 nodes which makes total number of processes generated are 40
Pavan
Apr 11th, 2007
It depends on the number of active stages on canvas and how they are linked as only active stages can create a process. for ex if there are 6 active stages (like transforms) linked by some passive stages, the total no of processes are 6x4=24
Srinivas
Aug 3rd, 2011
You have 10 stages and each stage can be partitioned and run on 4 nodes which makes total number of processes generated are 40
Kesava
Oct 25th, 2011
Use $APT_DUMP_SCORE ENV to know the number of OSH's produced for a job and set the ENV to true
Lucas
Oct 25th, 2011
Depends, for example:
Question
A job Design consists of a input sequential File , a modify stage , followed by a filter stage
and a output sequential file stage. The job run on an SMO machine with a configuration file defined with three nodes.
No environment variables were set for the job. How many osh process will this job create?
Answer: Sequential File count as server ( meaning 1 process) and a server stage always has a conductor , and a conductor generate one process. So far we have 1+1+1 = 3
Each Parallel stage must be multiplied by the number of nodes so (1+1)*2 = 6
ANSWER = Total of 9 processes . That one is for free. Good luck with your DS certification.
Lucas
Oct 26th, 2011
Correction
(1+1)*3 = 6
Modify + Filter * nodes(3)
jj
Nov 26th, 2012
1 conductor process
3 Section leader process
3 player process ( modify and filter are combined)
1 source sequential file
1 target sequential file
Total : 9
If your running 4 ways parallel and you have 10 stages on the canvas, how many processes does datastage create?
Questions by vishut
Related Answered Questions
Related Open Questions