This tutorial shows how to split a large text file into smaller chunks with Advanced ETL Processor. Use it when a receiving system, upload limit, or downstream process cannot handle one very large file.
What You Will Learn
- Read the large text file as the source.
- Configure the workflow to split the source into smaller chunks.
- Write each chunk to a separate output file.
- Check the generated files before sending them to the next system.
Before You Start
Test with a copy of the source file first. Check the chunk size, output names, and row boundaries before processing the production file.
This Tutorial Answers A User Request
This tutorial was created in response to the user request Feature Request: Action to Split Large Text Files.
The requested workflow is useful when a large text file needs to be divided before upload, transfer, import, or processing by a system with file-size limits.
Split Text File Processing
A split text file workflow turns one large source into smaller files while keeping the output repeatable. Review the generated chunks for complete records, predictable names, and the expected number of rows before using them downstream.
For related file workflows, see transforming text files with ETL and processing files one by one.
Need Advanced ETL Processor First?
Download the Advanced ETL Processor trial before following the tutorial, or review Enterprise if you need scheduled unattended execution.