[Bug] Adding columns messes joins

More
1 year 5 months ago #24871 by prashant
HI,
I am able to reproduce the same . 

I have RIGHT JOIN in a transformation. 

1. Input B now has 3 additional fields which are added , the join still works as earlier 
2. Open Joiner and ADD the 3 new fields into joiner falls down from earlier (8000 to only 3) , I tried saving opening re-opening , reproducible
3. If I were to delete this join and recreate it back again , the number goes up to 8000 (as earlier)

www.loom.com/share/097d313e819c4814a4074...22-957b-85c6700da494

This was very frustrating 
The following user(s) said Thank You: admin

Please Log in or Create an account to join the conversation.

More
1 year 5 months ago #24872 by admin
Yes this is very annoying... 
we will have a look at it for you.

Mike
ETL Architect
The following user(s) said Thank You: prashant

Please Log in or Create an account to join the conversation.

More
1 year 4 months ago #24886 by Peter.Jonson
We could not reproduce the problem.

Please provide us with transformation and data files so we can test it in the office.

Peter Jonson
ETL Developer

Please Log in or Create an account to join the conversation.

More
1 year 4 months ago #24890 by prashant
I have emailed at info@

Please Log in or Create an account to join the conversation.

More
1 year 4 months ago #24899 by admin
I think I have found the issue.

When you add new field to joiner you have to update all inked objects.

Also we found a bug and fixed it.

Basically if you delete the field but forget to delete it from joiner it will lead to AV


 

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
1 year 4 months ago - 1 year 4 months ago #24900 by prashant
Thanks for catching this bug.

I think Field Selector also require some tweaking or maybe we need a new mechanism if the number of fields are updated downstream. 

1. I made changes in transformers ,as recommended to ensure output to writer is fine.
2. When running transformation , it still fails saying Field Selector failed as number of fields have increased. 
3. Upon opening Field Selector I see no errors , all fields are already updated in Field Selector
4. I then proceeded to disconnect Field Selector , and suddenly transformation works again. 
5. I connect Field Selector again , and other downstream calculations work again. 

Cheers,
PM

 
Last edit: 1 year 4 months ago by prashant.

Please Log in or Create an account to join the conversation.

Cookies user preferences
We use cookies to ensure you to get the best experience on our website. If you decline the use of cookies, this website may not function as expected.
Accept all
Decline all
Read more
Marketing
Set of techniques which have for object the commercial strategy and in particular the market study.
Google
Accept
Decline
Analytics
Tools used to analyze the data to measure the effectiveness of a website and to understand how it works.
Google Analytics
Accept
Decline
Google Analytics
Accept
Decline
Functional
Tools used to give you more features when navigating on the website, this can include social sharing.
Advertisement
If you accept, the ads on the page will be adapted to your preferences.
Google Ad
Accept
Decline
Save