- Posts: 6
- Thank you received: 0
Assign a name to Ouput fields in Validation and Transformation
11 years 10 months ago #4153
by CasperX
Dear Sir, Madame,
I am testing the Trial Version of ETL Processor Enterprise, to see the possiblities and how things work. In my current job i am familiar with MS SSIS and also PowerCenter, so ETL is my daily job.
Maybe this question/suggestion is already known, but i like to share this:
I created a test workflow with a Validation and Transformation Object.
Since the source file (a Text file) has no column names, the reader object assigns names to colums like F1, F2, F3 and so on. This is fine in the reader Object.
But: In the Validation Object and Tranformation Object i tried to Assign useful names to the Output Columns (via the Output Field Properties tag). After saving en re-opening, the Output field anmes are restored to the default values again (like F1...). Only in the Witer Object, the names are kept, since they are probably taken from the Writer Object (a SQL Server table in my test).
What i miss in creating these transformation workflows:
1) For readability it should be very welcome, if you can change the Output Field name in Validation and Transformation Object. This makes te code more readable, instead of working with fields like F1... specially with tables/sources with a lot > 25 fields. In the Validation or Transformation Object it would be nice to change the fieldnames already in the correct useful data element name, before sending it to the Writer Object.
2) At this moment IT LOOKS LIKE you can change the Output Name in Validation and Transformation Objects on the Properties tab of the Output Field, since it is a --changeable-- field (you can Edit de Field Name) and Press OK or Cancel and the column name changes on the screen. But in Practice, you cannot change it: After saving and re-opening, the default field names are restored again. This is very confusing: if you can NOT change a value, it should be read-only, that's basic rule at programming.
Besides this, the ETL Tool looks great for smaller businesses, i am thinking of buying it for my next job, and for now i am testing it private at home, to see if i can work with it.
Thanks and regards,
Casper
I am testing the Trial Version of ETL Processor Enterprise, to see the possiblities and how things work. In my current job i am familiar with MS SSIS and also PowerCenter, so ETL is my daily job.
Maybe this question/suggestion is already known, but i like to share this:
I created a test workflow with a Validation and Transformation Object.
Since the source file (a Text file) has no column names, the reader object assigns names to colums like F1, F2, F3 and so on. This is fine in the reader Object.
But: In the Validation Object and Tranformation Object i tried to Assign useful names to the Output Columns (via the Output Field Properties tag). After saving en re-opening, the Output field anmes are restored to the default values again (like F1...). Only in the Witer Object, the names are kept, since they are probably taken from the Writer Object (a SQL Server table in my test).
What i miss in creating these transformation workflows:
1) For readability it should be very welcome, if you can change the Output Field name in Validation and Transformation Object. This makes te code more readable, instead of working with fields like F1... specially with tables/sources with a lot > 25 fields. In the Validation or Transformation Object it would be nice to change the fieldnames already in the correct useful data element name, before sending it to the Writer Object.
2) At this moment IT LOOKS LIKE you can change the Output Name in Validation and Transformation Objects on the Properties tab of the Output Field, since it is a --changeable-- field (you can Edit de Field Name) and Press OK or Cancel and the column name changes on the screen. But in Practice, you cannot change it: After saving and re-opening, the default field names are restored again. This is very confusing: if you can NOT change a value, it should be read-only, that's basic rule at programming.
Besides this, the ETL Tool looks great for smaller businesses, i am thinking of buying it for my next job, and for now i am testing it private at home, to see if i can work with it.
Thanks and regards,
Casper
Please Log in or Create an account to join the conversation.
11 years 10 months ago #4154
by admin
Mike
ETL Architect
Replied by admin on topic Re: Assign a name to Ouput fields in Validation and Transformation
Casper
Totally agree with you it is confusing for new users and we will make it simpler in one of our next releases
You see it depends on which object validator/transformer connected to.
If transformer is connected to datareader the list of output fields is taken from the data writer.
An you should change it within data writer.
Have a look at the attached word document.
Same apply to data reader and input fields
In situation "Transformer 1=>Transformer 2" you can change output fields in Transformer 1 and Transformer 2 will use them as input fields.
Mike
Mike
Totally agree with you it is confusing for new users and we will make it simpler in one of our next releases
You see it depends on which object validator/transformer connected to.
If transformer is connected to datareader the list of output fields is taken from the data writer.
An you should change it within data writer.
Have a look at the attached word document.
Same apply to data reader and input fields
In situation "Transformer 1=>Transformer 2" you can change output fields in Transformer 1 and Transformer 2 will use them as input fields.
Mike
Mike
Mike
ETL Architect
Please Log in or Create an account to join the conversation.
11 years 10 months ago #4155
by admin
Mike
ETL Architect
Replied by admin on topic Re: Assign a name to Ouput fields in Validation and Transformation
Also watch our on line tutorials
Peter
Peter
Mike
ETL Architect
Please Log in or Create an account to join the conversation.
11 years 10 months ago #4159
by CasperX
Replied by CasperX on topic Re: Assign a name to Ouput fields in Validation and Transformation
Hello Peter, Thank you very much for your prompt reply and clear answers.
I will also take a look at the online tutorials
Thank you,
Casper
I will also take a look at the online tutorials
Thank you,
Casper
Please Log in or Create an account to join the conversation.