Advanced ETL Processor can process files one by one by using the Files Loop action. The action builds a list of matching files, assigns the current file name to the #LoopValue# variable, and lets the package run the next steps for each file.
What You Will Learn
- Configure a Files Loop action in a package.
- Filter which files should be processed.
- Use the #LoopValue# variable as the current file name.
- Check the loop execution log after the package runs.
Before You Start
Use a small test folder first. A file loop is very good at repeating your mistake across every matching file, which is impressive only after it happens to someone else.
Files Loop Action Docs
The Files Loop Dynamic Action documentation explains how the package loops through files and stores the current file name in #LoopValue#.
Use the Parameters tab to define the folder, file mask, and selection rules. The N Value parameter changes meaning depending on the selected file rule: days, file count, or bytes.
If the loop may be interrupted, review Resuming Loop Execution After Failure. It uses a loop position file so the package can continue from the saved position.
The Variables tab controls variables updated during execution. The Execution log tab shows what happened after the loop runs.
Need Advanced ETL Processor First?
Download the Advanced ETL Processor trial before following the tutorial, or review Enterprise if you need scheduled unattended execution.