Deduplicator - how?

I need to deduplicate the resulting transformation just before it goes to the writer. I added it in between and set the one field that I needed to use to deduplicate the data. I am getting a large number of errors now. What is the best working way to deduplicate the results of the transformation prior to it getting written?

I belive you shoul sort the data first

Eg

Reader-> some transformation->sorter->deduplicator->transformation->Writer

Mike

Guess that is what I get for reading instructions: www.etl-tools.com/processing-data/data-deduplication.html

At the bottom:

Note:
There is no need to sort data before deduplication

So is it working now or not?

M