Memory allocation while using lookup stage

Hi friends, i know while using lookup stage if the lookup table has huge amount of data we will go for sparse lookup or else will use normal lookup.
would anybody explain how the memory will be allocated for both type of lookups?

Questions by chandubmca   answers by chandubmca

Showing Answers 1 - 3 of 3 Answers

"Hi friends, i know while using lookup stage if the lookup table has huge amount of data we will go for sparse lookup or else will use normal lookup.
would anybody explain how the memory will be allocated for both type of lookups?"

 First of all, What you know is wrong.

" if the lookup table has huge amount of data we will go for sparse lookup"

 This assumption is completely wrong. The lookup type is not decided by the data on the reference link but by the amount of data on the input link.

If and only if your input link has few records, Then you can go for a Sparse Lookup. There is no memory allocation for this type of lookup, And a SQL where clause is directly fired on the reference link database for fetching the lookup key value.

In case of a Normal Lookup, The entire reference link data is read into the memory and then a lookup is done in the memory itself.

So memory comes into picture only for normal lookup's and not for Sparse lookup's.

This should clarify.......

Give your answer:

If you think the above answer is not correct, Please select a reason and add your answer below.

 

Related Answered Questions

 

Related Open Questions