Assign a name to Ouput fields in Validation and Transformation

More
11 years 10 months ago #4153 by CasperX
Dear Sir, Madame,

I am testing the Trial Version of ETL Processor Enterprise, to see the possiblities and how things work. In my current job i am familiar with MS SSIS and also PowerCenter, so ETL is my daily job.

Maybe this question/suggestion is already known, but i like to share this:

I created a test workflow with a Validation and Transformation Object.
Since the source file (a Text file) has no column names, the reader object assigns names to colums like F1, F2, F3 and so on. This is fine in the reader Object.

But: In the Validation Object and Tranformation Object i tried to Assign useful names to the Output Columns (via the Output Field Properties tag). After saving en re-opening, the Output field anmes are restored to the default values again (like F1...). Only in the Witer Object, the names are kept, since they are probably taken from the Writer Object (a SQL Server table in my test).

What i miss in creating these transformation workflows:

1) For readability it should be very welcome, if you can change the Output Field name in Validation and Transformation Object. This makes te code more readable, instead of working with fields like F1... specially with tables/sources with a lot > 25 fields. In the Validation or Transformation Object it would be nice to change the fieldnames already in the correct useful data element name, before sending it to the Writer Object.

2) At this moment IT LOOKS LIKE you can change the Output Name in Validation and Transformation Objects on the Properties tab of the Output Field, since it is a --changeable-- field (you can Edit de Field Name) and Press OK or Cancel and the column name changes on the screen. But in Practice, you cannot change it: After saving and re-opening, the default field names are restored again. This is very confusing: if you can NOT change a value, it should be read-only, that's basic rule at programming.

Besides this, the ETL Tool looks great for smaller businesses, i am thinking of buying it for my next job, and for now i am testing it private at home, to see if i can work with it.

Thanks and regards,
Casper

Please Log in or Create an account to join the conversation.

More
11 years 10 months ago #4154 by admin
Casper

Totally agree with you it is confusing for new users and we will make it simpler in one of our next releases

You see it depends on which object validator/transformer connected to.
If transformer is connected to datareader the list of output fields is taken from the data writer.
An you should change it within data writer.

Have a look at the attached word document.
Same apply to data reader and input fields

In situation "Transformer 1=>Transformer 2" you can change output fields in Transformer 1 and Transformer 2 will use them as input fields.

Mike



Mike

Mike
ETL Architect
Attachments:

Please Log in or Create an account to join the conversation.

More
11 years 10 months ago #4155 by admin
Also watch our on line tutorials

Peter

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
11 years 10 months ago #4159 by CasperX
Hello Peter, Thank you very much for your prompt reply and clear answers.

I will also take a look at the online tutorials

Thank you,
Casper

Please Log in or Create an account to join the conversation.