Load 10 Input files into 10 Target tables at a time

I have the 10 input file like F1,F2...F10 then I need to load these 10 input files into 10 target Output tables like T1,T2...T10. Here is the scenario for 10 tables But in future If i will receive 100 input files then I need to load it into respective 100 target tables.
After loading the input files into target tables I need a confirmation in the respective target tables(By input File name)
Please suggest me here how can I design this job in right way.

Questions by Aloka   answers by Aloka

Showing Answers 1 - 2 of 2 Answers

lavanya

  • Dec 29th, 2016
 

We have many ways to achieve this one of them is
Create sequence job as

• Write a routine to count the no of files and read the individual filename

• Use looping activity --to perform no of iterations
No of iterations=count/5

• Next use 5 job activities by calling the same parallel job in all job activities with different parameter values

For example:
If source file folder has 10 files
No of iterations =10/5=2 iterations
the loop perform 2 iterations each time 5 instances total 10 files will be processed.
If source folder has 100 files
No of iterations=100/5=20 iterations
The loop performs 20 iterations to execute 100 instances by processing 100 files.

Routine passes the count to loop activity ex 20

  Was this answer useful?  Yes

Ram

  • Jan 10th, 2017
 

Hi Aloka,
we can achieve this if you know the shell scripting. First design a job Source -->Target. then write a shell script for dsjob command to run the job and pass the parameters using parameter file for Source,schema & target tables. and run the job in loop.

  Was this answer useful?  Yes

Give your answer:

If you think the above answer is not correct, Please select a reason and add your answer below.

Answer Question

Click here to Login / Register your free account


 
Send   Reset

 

Related Answered Questions

 

Related Open Questions