Maximum Size of file to process

Hi Sir,

What is maximum size of the Excel file that can processed by AETL. We are trying to process the excel file having more than 200000 records . It is taking lot of time to process it.

is there any limitations for number of records to be processed in AETL.

Kindly please advise any tips/measures while processing large files (more than 200000 records) to reduce the time consuming

Thanks ,
Prasanth Vattikonda

The limit is standard for Excel.

1 mln rows for eslx flle.

Transformation... what is that?

Are you extracting data from existing excel file?
Are you creating a brand new excel file?
Are you updating an existing excel file?
How do you define slow is it 10 hours or 30 minutes?

Hi Sir,

Please find the comments below.

Are you extracting data from existing excel file? - Yes
Are you creating a brand new excel file? - No
Are you updating an existing excel file? - Yes
How do you define slow is it 10 hours or 30 minutes? - 30 Minutes (that too not while running , when we are processing in between one of the components like Transformer/Validator)

Thank you for the clarification

So I assume when you click on 2 for example it takes 30 minutes to open?



This is too long.

Are you using Get Excel Value/Get Excel Value dynamic transformations?

www.etl-tools.com/wiki/advanced-etl-proc...et-excel-cell-value/

Hi Vatticonda.

Some good news
We have spent some time testing working with large excel and managed significantly improve transformation designer screen response time.

Can you please try the latest version?

Here is the full list of changes.

21/02/2020 - 6.3.7.12

+ Improved: transformation designer response time while working with very large files
+ Improved: removed excess data refreshes within transformation designer this resulted in overall screen performance improvement
+ Improved: underscore character can be seen in preview mode now
+ Improved: the software will make three attempts to publish tableau files before failing
- Fixed: Various tableau related bugs
- Fixed: Pause package action issues

Please let us know the outcome.