database lookup

More
8 years 10 months ago #12001 by orlandoc
database lookup was created by orlandoc
Greetings,

In my Transformation, after I performed some validation it goes to Transformation. Now in this transformation, I would like to perform database lookup to get value based on the parameter I am passing.
Let's say I have a variable that has a value of a file name, inside the transformation I will perform a database lookup with input parameter of variable file name and will return the fileID associated with that filename. How do I do that?

Please Log in or Create an account to join the conversation.

More
8 years 10 months ago #12003 by Peter.Jonson
Replied by Peter.Jonson on topic database lookup

Peter Jonson
ETL Developer

Please Log in or Create an account to join the conversation.

More
8 years 10 months ago #12011 by orlandoc
Replied by orlandoc on topic database lookup
I've seen the video but it didn't answer actually answer what I need.
If I have a stored procedure that accept one (1) input parameter like filename and it will return a customerID value, how do I do that in lookup?
Can lookup able to accept variable in the source data tab like ..
EXEC tps_getCustomerID '<CustomerName>'

As far as I understand, the lookup can able to fetch records but it need to map both the Input Fields & Output Fields.
The Input Fields is use by the Lookup to compare against the fetch record - and this is the limitation of the lookup because this stored procedure can only return one (1) value which is CustomerID (int). So what value you will assign to Input Fields to map?

Please Log in or Create an account to join the conversation.

More
8 years 10 months ago #12013 by Peter.Jonson
Replied by Peter.Jonson on topic database lookup
If I have a stored procedure that accept one (1) input parameter like filename and it will return a customerID value, how do I do that in lookup?

This functionality is not supported currently.

Although this sounds like a good idea imagine the following situation

Your source table has 2 millions records.
Exciting same procedure 2 milling times will be very slow.
It will put enormous pressure on the database.
Your DBA will be very unhappy.

Peter Jonson
ETL Developer

Please Log in or Create an account to join the conversation.

More
8 years 10 months ago #12015 by orlandoc
Replied by orlandoc on topic database lookup
This is very common in our business transformation where we perform database lookups simultaneously from another services and do data aggregation and composition in B2B.
Please consider this functionality in the future version.
Thank you.

Please Log in or Create an account to join the conversation.

More
8 years 10 months ago - 8 years 10 months ago #12020 by Peter.Jonson
Replied by Peter.Jonson on topic database lookup
I will speak with developers about that.

It would be intersting to know what are you trying to automate over there
Sounds like a exciting project :)

Peter Jonson
ETL Developer
Last edit: 8 years 10 months ago by Peter.Jonson.

Please Log in or Create an account to join the conversation.