How to load 2 files data into a single file without using join stage

I have 2 files having different meta data and 2 files does not have any common key. How can I load the 2 files data into a single file without using Join stage?

Questions by Aloka   answers by Aloka

Showing Answers 1 - 7 of 7 Answers


  • Jun 30th, 2016

To load data from multiple files better use funnel stage.

  Was this answer useful?  Yes


  • Jul 4th, 2016

You can use cat command in UNIX.
Cat file1 file2>target file
But why you would do this? How will you deal with a file with two different types of metadata

  Was this answer useful?  Yes


  • Jul 4th, 2016

If meta data is different what to do

  Was this answer useful?  Yes


  • Jul 9th, 2016

You can read the entire row in a single column with SQL type as VarChar and funnel the two files

  Was this answer useful?  Yes

Pavan Kumar

  • Jul 11th, 2016

If Metadata is same then you can use "Funnel stage". If tables are different then, use column generator to create a common column for both the tables, then using join stage (Full outer join), join the two different tables.

  Was this answer useful?  Yes


  • Feb 9th, 2017

Can we use Merge?

  Was this answer useful?  Yes

Give your answer:

If you think the above answer is not correct, Please select a reason and add your answer below.


Related Answered Questions


Related Open Questions