- Posts: 290
- Thank you received: 1
database lookup
8 years 10 months ago #12001
by orlandoc
database lookup was created by orlandoc
Greetings,
In my Transformation, after I performed some validation it goes to Transformation. Now in this transformation, I would like to perform database lookup to get value based on the parameter I am passing.
Let's say I have a variable that has a value of a file name, inside the transformation I will perform a database lookup with input parameter of variable file name and will return the fileID associated with that filename. How do I do that?
In my Transformation, after I performed some validation it goes to Transformation. Now in this transformation, I would like to perform database lookup to get value based on the parameter I am passing.
Let's say I have a variable that has a value of a file name, inside the transformation I will perform a database lookup with input parameter of variable file name and will return the fileID associated with that filename. How do I do that?
Please Log in or Create an account to join the conversation.
- Peter.Jonson
-
- Offline
- Platinum Member
-
8 years 10 months ago #12003
by Peter.Jonson
Peter Jonson
ETL Developer
Replied by Peter.Jonson on topic database lookup
Peter Jonson
ETL Developer
Please Log in or Create an account to join the conversation.
8 years 10 months ago #12011
by orlandoc
Replied by orlandoc on topic database lookup
I've seen the video but it didn't answer actually answer what I need.
If I have a stored procedure that accept one (1) input parameter like filename and it will return a customerID value, how do I do that in lookup?
Can lookup able to accept variable in the source data tab like ..
EXEC tps_getCustomerID '<CustomerName>'
As far as I understand, the lookup can able to fetch records but it need to map both the Input Fields & Output Fields.
The Input Fields is use by the Lookup to compare against the fetch record - and this is the limitation of the lookup because this stored procedure can only return one (1) value which is CustomerID (int). So what value you will assign to Input Fields to map?
If I have a stored procedure that accept one (1) input parameter like filename and it will return a customerID value, how do I do that in lookup?
Can lookup able to accept variable in the source data tab like ..
EXEC tps_getCustomerID '<CustomerName>'
As far as I understand, the lookup can able to fetch records but it need to map both the Input Fields & Output Fields.
The Input Fields is use by the Lookup to compare against the fetch record - and this is the limitation of the lookup because this stored procedure can only return one (1) value which is CustomerID (int). So what value you will assign to Input Fields to map?
Please Log in or Create an account to join the conversation.
- Peter.Jonson
-
- Offline
- Platinum Member
-
8 years 10 months ago #12013
by Peter.Jonson
Peter Jonson
ETL Developer
Replied by Peter.Jonson on topic database lookup
If I have a stored procedure that accept one (1) input parameter like filename and it will return a customerID value, how do I do that in lookup?
This functionality is not supported currently.
Although this sounds like a good idea imagine the following situation
Your source table has 2 millions records.
Exciting same procedure 2 milling times will be very slow.
It will put enormous pressure on the database.
Your DBA will be very unhappy.
This functionality is not supported currently.
Although this sounds like a good idea imagine the following situation
Your source table has 2 millions records.
Exciting same procedure 2 milling times will be very slow.
It will put enormous pressure on the database.
Your DBA will be very unhappy.
Peter Jonson
ETL Developer
Please Log in or Create an account to join the conversation.
8 years 10 months ago #12015
by orlandoc
Replied by orlandoc on topic database lookup
This is very common in our business transformation where we perform database lookups simultaneously from another services and do data aggregation and composition in B2B.
Please consider this functionality in the future version.
Thank you.
Please consider this functionality in the future version.
Thank you.
Please Log in or Create an account to join the conversation.
- Peter.Jonson
-
- Offline
- Platinum Member
-
8 years 10 months ago - 8 years 10 months ago #12020
by Peter.Jonson
Peter Jonson
ETL Developer
Replied by Peter.Jonson on topic database lookup
I will speak with developers about that.
It would be intersting to know what are you trying to automate over there
Sounds like a exciting project
It would be intersting to know what are you trying to automate over there
Sounds like a exciting project

Peter Jonson
ETL Developer
Last edit: 8 years 10 months ago by Peter.Jonson.
Please Log in or Create an account to join the conversation.