- Posts: 122
- Thank you received: 4
Extract files based on data in another file
6 years 5 months ago #16590
by mdspeirs
Extract files based on data in another file was created by mdspeirs
AETLE 5.9.4.2
Windows Server 2012 R2 on Azure VM
I have a large file that I need to create multiple sub files from based on a CODE column. for instance:
This could be hard coded into separate validators and writers, but there are 20+ sub files, so that's labor intensive to create and maintain. Suppose I have a "breakup file that specifies what code goes into what file:
One possibility would be to join the breakup file to the data file by code and then use the usual dynamic file naming mechanisms, but some codes (see row 4 and
should go into multiple files, so that won't work.
So I'm wondering if there's a way to lookup how to split up the file?
Windows Server 2012 R2 on Azure VM
I have a large file that I need to create multiple sub files from based on a CODE column. for instance:
This could be hard coded into separate validators and writers, but there are 20+ sub files, so that's labor intensive to create and maintain. Suppose I have a "breakup file that specifies what code goes into what file:
One possibility would be to join the breakup file to the data file by code and then use the usual dynamic file naming mechanisms, but some codes (see row 4 and

So I'm wondering if there's a way to lookup how to split up the file?
Please Log in or Create an account to join the conversation.
6 years 5 months ago #16591
by admin
Mike
ETL Architect
Replied by admin on topic Extract files based on data in another file
Sure it is possible.
Can you post your sample excel file here and we will create an example for you.
Can you post your sample excel file here and we will create an example for you.

Mike
ETL Architect
Please Log in or Create an account to join the conversation.
6 years 5 months ago #16592
by mdspeirs
Replied by mdspeirs on topic Extract files based on data in another file
sure attached tab delimited txt files
Please Log in or Create an account to join the conversation.
6 years 5 months ago #16593
by admin
Mike
ETL Architect
Replied by admin on topic Extract files based on data in another file
Mike
ETL Architect
Please Log in or Create an account to join the conversation.
6 years 5 months ago #16594
by admin
Mike
ETL Architect
Replied by admin on topic Extract files based on data in another file
And here is actual transformation
Thank you for your question.
This is a good example of what our software is capable of
Thank you for your question.
This is a good example of what our software is capable of
Mike
ETL Architect
Please Log in or Create an account to join the conversation.
6 years 4 months ago #16597
by mdspeirs
Replied by mdspeirs on topic Extract files based on data in another file
Great, Thanks.
One other question, when it does the join it's creating a temp file somewhere I imagine? Can the location for that be set somewhere? I'm joining a very large file and the C: drive is filling before it completes.
FWIW, I already changed the join to an inner join and removed the sort, as they weren't necessary for my application.
One other question, when it does the join it's creating a temp file somewhere I imagine? Can the location for that be set somewhere? I'm joining a very large file and the C: drive is filling before it completes.
FWIW, I already changed the join to an inner join and removed the sort, as they weren't necessary for my application.
Please Log in or Create an account to join the conversation.