Avoiding Double Processing

I have a complex workflow that processes email attachments. Unfortunately, our clients occasionally send the same file twice, and we'd like to prevent duplicates.

Does anyone have advice on how to handle this?

Hi Sean.

What you need to do is to calculate file check sum (for example md5) and compare it with the value stored in the database.

At the moment it this can be done using script, which is not ideal.

Let me speak with the developers perhaps there is better way

Hi Sean.

We have added two new dynamic actions for you.

www.etl-tools.com/wiki/advanced-etl-proc...tring-to-crc-action/

www.etl-tools.com/wiki/advanced-etl-proc...ons/file-crc-action/  

this means, when we do work on a file 1st , we need to store the checksum id in a csv/sql and then recheck it again?

Nice !! 

Here is a video tutorial