022 Load Data When A New File Is Added To A Folder

Use Directory Monitor when file arrival should trigger ETL processing automatically.

Advanced ETL Processor
4.9 ★★★★★ Based on 16 reviews on Capterra See all reviews on Capterra →

Advanced ETL Processor can watch a folder and start ETL work when a new file arrives. That is useful for supplier uploads, exported reports, and the classic shared-folder process that somehow became business-critical.

What You Will Learn

  • Configure folder-based ETL execution with Directory Monitor.
  • Start processing when a new file is created in a monitored directory.
  • Use UNC paths for network shares instead of mapped drives.
  • Check service permissions before relying on unattended processing.

Before You Start

Test with a small folder first. A monitor will trigger exactly as configured, including on the wrong file mask if you rush it.

Directory Monitor Docs For File Arrival Automation

The Directory Monitor watches folders for file creation, removal, modification, or renaming. For this tutorial, the key use case is file creation: a new file arrives and the ETL process starts.

Before using it in production, review the Directory Monitor setup notes for service configuration, monitor status checks, and the available monitor variables. For network shares, use UNC paths rather than mapped drives. Windows services and mapped drives are not famous for being close friends.

If a batch drops many files at once, consider using a trigger file so the monitor fires once after the batch has finished copying. That keeps the automation predictable instead of launching a job for every half-arrived file.

Need Advanced ETL Processor First?

Download the Advanced ETL Processor trial before following the tutorial, or review Enterprise if you need scheduled unattended execution.