Things to avoid while designing data transformations

1. Field Mismatch in Transformers and Data Writers

   • When a transformer is connected to the data writer, it inherits the field list from the data writer.
   • Ensure the field lists from both data writers are identical; otherwise, the transformation will fail.
     
     
     
     

2. Unnecessary Data Sorting

   • It is unnecessary to sort data before using the Joiner object.
     
     
     
     

3. Data Transformer Placement

   • The last object before the data writer must always be a Data Transformer.
     
     
     
     

4. Log Object Usage

   • When a Log Object is present in the transformation, all log messages pass through it.
   • Ensure that the “Write Message to Log File” and “Write Record to Rejected File” options are unchecked for all Validator and Transformer objects to avoid redundant logging.