Everyone who performs data transformation knows the importance of data quality and how much time is required to find what went wrong and correct the problem
In the latest version of Advanced ETL Processor, we introduced a new object called "Log"
The idea is very simple: to redirect log messages into different data flow so this data can be used later for reporting.
Plus compared to standard text log it provides much more information to the user.
It allows to answer the following questions:
What was wrong with the data?
Which actions were taken to correct the data?
An initial value of the field
Value after correction
And much more
We would like to thank Adrian Parker from Differentia Consulting Ltd for giving us useful feedback