Deduplicator Concept

More
2 years 4 months ago - 2 years 4 months ago #23162 by prashant
Hellos,

I am confused with how DeDupe works in Advance ETL. I have a file with 3 columns with 110 rows , 43 duplicate removes , 67 unique items  
--> ID | Our Ref | Items  
Dedupe is to be removed with combination of Our Ref+Items

When I select DeDuplicator Object , I check two items OurRef+Items but then in output ID column is removed , how do I bring the column back ? I need to do a join?

See My Loom Video for Explanation
See my File for Input Data
See my file for expected output

 
Last edit: 2 years 4 months ago by prashant.
The following user(s) said Thank You: Peter.Jonson

Please Log in or Create an account to join the conversation.

More
2 years 4 months ago #23165 by Peter.Jonson
Replied by Peter.Jonson on topic Deduplicator Concept
Can you attache your transformation please

Peter Jonson
ETL Developer

Please Log in or Create an account to join the conversation.

More
2 years 4 months ago #23167 by prashant
Replied by prashant on topic Deduplicator Concept
Please see transformation attached as requested.
Attachments:

Please Log in or Create an account to join the conversation.

More
2 years 4 months ago #23170 by admin
Replied by admin on topic Deduplicator Concept
Please stop placing links to the files on your own web site

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
2 years 4 months ago #23171 by Peter.Jonson
Replied by Peter.Jonson on topic Deduplicator Concept
Hi.

I can see that you have duplicated ids.



I assume that you want to keep the first one

In this case grouper object is a more suitable option.

www.etl-tools.com/wiki/advanced-etl-proc...orming-data/grouper/

Peter Jonson
ETL Developer

Please Log in or Create an account to join the conversation.

More
2 years 4 months ago #23185 by prashant
Replied by prashant on topic Deduplicator Concept

Hi.

I can see that you have duplicated ids.



I assume that you want to keep the first one

In this case grouper object is a more suitable option.

www.etl-tools.com/wiki/advanced-etl-proc...orming-data/grouper/
Grouper Works !! Thank you
 

Please Log in or Create an account to join the conversation.

Cookies user preferences
We use cookies to ensure you to get the best experience on our website. If you decline the use of cookies, this website may not function as expected.
Accept all
Decline all
Read more
Marketing
Set of techniques which have for object the commercial strategy and in particular the market study.
Google
Accept
Decline
Analytics
Tools used to analyze the data to measure the effectiveness of a website and to understand how it works.
Google Analytics
Accept
Decline
Google Analytics
Accept
Decline
Functional
Tools used to give you more features when navigating on the website, this can include social sharing.
Advertisement
If you accept, the ads on the page will be adapted to your preferences.
Google Ad
Accept
Decline
Save