I submitted this post last night but didn't realize I was in the wrong product category so I am reposting.
Hi,
We recently upgraded from a single user license to a site license. We also upgraded from Advanced ETL Processor Professional version 5.7.5.2 to Advanced ETL Processor Professional version 5.8.1.0, running on an oracle database.
Since the upgrade to version 5.8.1.0 we have had the following problems:
My first problem is related to creating an empty file from a client provided source file. The empty file must be the original source file name with some value appended to it. This will serve as our echo file.
We run a process where we are required to create an echo file that contains processed records. The name of the echo file must be the source file name with a specific extension. You created this functionality specifically for me from a previous request about 5 ½ years ago. This is accomplished via a transformation that reads the original source file. I am discarding all records and writing to a text file. I then append either good or bad records and send back to the client. The name of the file being created is derived utilizing the GetSystemVariable('SOURCE_FILE_NAME'). The below is taken directly from the writer within the transformation, which is writing to a text file:
"G:\itg\Business Intelligence\ETL\Load Files\Banorte\BBN - Transaction Files\Echo Files\Bad Records\ACK\{GetSystemVariable('SOURCE_FILE_NAME')+'.ACK.dat'}"
The transformation that reads the original source file and creates the empty echo file must be contained within a package for this to work. It works on my old version (5.7.5.2) but does not work in my new version (5.8.1.0).
Here is the log info for the transformation: Information 6/23/2015 8:34:15 AM Starting Transformation...
Information 6/23/2015 8:34:15 AM Map Name: Banorte CSN Create ACK Empty File_BAD Recs
Information 6/23/2015 8:34:15 AM Author:
Information 6/23/2015 8:34:15 AM Version:
Information 6/23/2015 8:34:15 AM Description:
Information 6/23/2015 8:34:15 AM Preparing Writers...
Information 6/23/2015 8:34:15 AM Writer: {Create Empty ACK File_BAD recs} Connection Type is: Text
Information 6/23/2015 8:34:15 AM Writer: {Create Empty ACK File_BAD recs} Writer { Create Empty ACK File_BAD recs } Is Ready
Information 6/23/2015 8:34:15 AM All Writers are Ready
Information 6/23/2015 8:34:15 AM Processing Data...
Information 6/23/2015 8:34:15 AM Reader:{Create Empty ACK File_BAD Recs} Connection Type is: Text
Information 6/23/2015 8:34:15 AM Reader:{Create Empty ACK File_BAD Recs} Path: G:\itg\Business Intelligence\ETL\Load Files\Banorte\CSN - Homologation Files\Load Files\
Information 6/23/2015 8:34:15 AM Reader:{Create Empty ACK File_BAD Recs} Mask: FB*.CSN
Information 6/23/2015 8:34:15 AM Reader:{Create Empty ACK File_BAD Recs} Found: 1 files to read
Information 6/23/2015 8:34:15 AM Reader:{Create Empty ACK File_BAD Recs} Reading first 1 files
Information 6/23/2015 8:34:15 AM Target file: G:\itg\Business Intelligence\ETL\Load Files\Banorte\CSN - Homologation Files\Echo Files\Bad Records\ACK\FB20150622.230615-055521.CSN.ACK.dat
Information 6/23/2015 8:34:15 AM Reader:{Create Empty ACK File_BAD Recs} Source File: G:\itg\Business Intelligence\ETL\Load Files\Banorte\CSN - Homologation Files\Load Files\FB20150622.230615-055521.CSN
Information 6/23/2015 8:34:15 AM 1 Reader:{Create Empty ACK File_BAD Recs} Read first 1 lines
Information 6/23/2015 8:34:15 AM Reader:{Create Empty ACK File_BAD Recs} Read 1 Line(s)
Information 6/23/2015 8:34:15 AM Reader:{Create Empty ACK File_BAD Recs} Read: 1 Records/Lines/Messages (in total)
Information 6/23/2015 8:34:15 AM Reader:{Create Empty ACK File_BAD Recs} Records/Lines/Messages per second: 62
Information 6/23/2015 8:34:15 AM Reader:{Create Empty ACK File_BAD Recs} Rejected: 0 Record(s)
Information 6/23/2015 8:34:15 AM Reader:{Create Empty ACK File_BAD Recs} Time Taken: 00:00:00
Information 6/23/2015 8:34:15 AM Writer: {Create Empty ACK File_BAD recs} Wrote : 0 Line(s)
Information 6/23/2015 8:34:15 AM Transformation Completed
My second problem is related to loading data to a staging table via a transformation. My transformation contains a deduplicator between the validator and the transformer. When I run the transformation within a package, I receive the following error:
Error 6/23/2015 4:50:30 PM 1 Transformation: mr load Execution Aborted: Table's Structure Has Changed (The Number of fields is different)
When I run the transformation by itself it works OK. If I remove the deduplicator and run the transformation within a package, the file loads.
The problem is somehow related to being run within a package.
Thanks in advance for your assistance,
Steve V
