What is Pipeline Look up? and What is the Use of Pipeline Look up?

A pipeline lookup is used do lookup upon an application source that is not a relational table or flat file.
A Source Qualifier has been used as a lookup table for Pipeline Lookup.
A Source Qualifier which has been used as a lookup table remains abandon in mapping.
Use of Pipeline Look up:
To improve performance when processing relational or flat file lookup sources, create a pipeline Lookup transformation instead of a relational or flat file Lookup Transformation. 
Pipeline Lookup can be created in Connected or Unconnected mode.
Follow The below Steps.
Step 1:
Drag and Drop your source twice and Target once.
Step 2:
Lookup
While creating Select Source Qualifier and Select check box Return all Values on Multiple Match (See Picture Below)

Connect Ins_ID, Premium_Year from Source qualifier (Upon which you are not doing Lookup) to Lookup Transformation.
Condition Tab
Ins_Id = Ins_Id 1
Step 3
Filter
Connect Ins_ID, Premium_Year (Column of Source) and Premium_Amount Column of Lookup from Lookup to Filter Transformation.
Filter Condition: NOT ISNULL(Premium_Amount)
Step 4
Connect Your Columns from Filter to Target.
Step 5:
Give the Source connection or Location/File_Name for both source qualifier.
No need to give Source connection or Location/File_Name for Lookup Table.
Note: Your Second Source and Source Qualifier upon which you are doing Pipeline Lookup will be abandon in mapping no need to do anything with them. Your mapping will look like Image below...
Note: You can also achieve this by doing Active Lookup directly  upon your source. Approach explained above is just a representation that how to create Pipeline Lookup.

Thanks

Ur's Hari

If you like this post, please share it by clicking on g+1 Button.