Extract files based on data in another file

More
6 years 5 months ago #16590 by mdspeirs
AETLE 5.9.4.2
Windows Server 2012 R2 on Azure VM

I have a large file that I need to create multiple sub files from based on a CODE column. for instance:



This could be hard coded into separate validators and writers, but there are 20+ sub files, so that's labor intensive to create and maintain. Suppose I have a "breakup file that specifies what code goes into what file:




One possibility would be to join the breakup file to the data file by code and then use the usual dynamic file naming mechanisms, but some codes (see row 4 and 8) should go into multiple files, so that won't work.

So I'm wondering if there's a way to lookup how to split up the file?
Attachments:

Please Log in or Create an account to join the conversation.

More
6 years 5 months ago #16591 by admin
Sure it is possible.
Can you post your sample excel file here and we will create an example for you. :)

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
6 years 5 months ago #16592 by mdspeirs
sure attached tab delimited txt files
Attachments:

Please Log in or Create an account to join the conversation.

More
6 years 5 months ago #16593 by admin
Here are the screenshots












Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
6 years 5 months ago #16594 by admin
And here is actual transformation

Thank you for your question.

This is a good example of what our software is capable of

Mike
ETL Architect
Attachments:

Please Log in or Create an account to join the conversation.

More
6 years 4 months ago #16597 by mdspeirs
Great, Thanks.

One other question, when it does the join it's creating a temp file somewhere I imagine? Can the location for that be set somewhere? I'm joining a very large file and the C: drive is filling before it completes.

FWIW, I already changed the join to an inner join and removed the sort, as they weren't necessary for my application.

Please Log in or Create an account to join the conversation.