Looping Around a List of Files to Perform a Transformation of the File Data

More
4 years 10 months ago - 1 year 2 months ago #21384 by Peter.Jonson
This is a rather silly question but have you actually saved the transformation before running it from the package?

Also, watch this video

www.etl-tools.com/advanced-etl-processor...-mapped-problem.html

Peter Jonson
ETL Developer
Last edit: 1 year 2 months ago by admin.
The following user(s) said Thank You: admin, ipitzey

Please Log in or Create an account to join the conversation.

More
4 years 10 months ago #21385 by Peter.Jonson
Doble click on all objects between reader and writer make sure that all of them are mapped

Peter Jonson
ETL Developer

Please Log in or Create an account to join the conversation.

More
4 years 10 months ago #21386 by ipitzey
Hi Peter,

Thanks for the response.
Yes the transformer was saved.

I watched the video you provided the link for and used the Auto Map feature. Originally I had mapped this individually manually.
Upon re-mapping the fields with the Auto Map, this then subsequently processed the files.

Therefore achieving the main principle of what I'm trying to do.

Thanks so much for your help.
Ian

Please Log in or Create an account to join the conversation.

More
4 years 10 months ago #21387 by ipitzey
Hi Peter,

The only question I have left is, when I loop through these files which currently get written to one file, how would I get the writer, to write out the files to the destination, as their original filenames? (eg. 10 input files, they go through the transform, then 10 files with the same name go into the destination directory?

Many thanks,
Ian

Please Log in or Create an account to join the conversation.

More
4 years 10 months ago #21388 by Peter.Jonson
There are multiple ways of doing it

For example, you can use calculations inside file names
Default repository has examples called Dynamic file names.


Or you can use calculations as described here
www.etl-tools.com/automation/0016-dynami...-on-field-value.html

Peter Jonson
ETL Developer
Attachments:
The following user(s) said Thank You: ipitzey

Please Log in or Create an account to join the conversation.

Cookies user preferences
We use cookies to ensure you to get the best experience on our website. If you decline the use of cookies, this website may not function as expected.
Accept all
Decline all
Read more
Marketing
Set of techniques which have for object the commercial strategy and in particular the market study.
Google
Accept
Decline
Analytics
Tools used to analyze the data to measure the effectiveness of a website and to understand how it works.
Google Analytics
Accept
Decline
Google Analytics
Accept
Decline
Functional
Tools used to give you more features when navigating on the website, this can include social sharing.
Advertisement
If you accept, the ads on the page will be adapted to your preferences.
Google Ad
Accept
Decline
Save