Maximum Size of file to process

  • Posts: 39
  • Thank you received: 1

Maximum Size of file to process was created by vattikonda

Hi Sir,

What is maximum size of the Excel file that can processed by AETL. We are trying to process the excel file having more than 200000 records . It is taking lot of time to process it.

is there any limitations for number of records to be processed in AETL.

Kindly please advise any tips/measures while processing large files (more than 200000 records) to reduce the time consuming

Thanks ,
Prasanth Vattikonda
1 month 4 weeks ago #20688

Please Log in or Create an account to join the conversation.

  • Posts: 8127
  • Karma: 33
  • Thank you received: 512

Replied by admin on topic Maximum Size of file to process

The limit is standard for Excel.

1 mln rows for eslx flle.

Transformation... what is that?

Are you extracting data from existing excel file?
Are you creating a brand new excel file?
Are you updating an existing excel file?
How do you define slow is it 10 hours or 30 minutes?
Mike
1 month 4 weeks ago #20689

Please Log in or Create an account to join the conversation.

  • Posts: 39
  • Thank you received: 1

Replied by vattikonda on topic Maximum Size of file to process

Hi Sir,

Please find the comments below.

Are you extracting data from existing excel file? - Yes
Are you creating a brand new excel file? - No
Are you updating an existing excel file? - Yes
How do you define slow is it 10 hours or 30 minutes? - 30 Minutes (that too not while running , when we are processing in between one of the components like Transformer/Validator)
1 month 3 weeks ago #20707

Please Log in or Create an account to join the conversation.

  • Posts: 1138
  • Karma: 3
  • Thank you received: 135

Replied by Peter.Jonson on topic Maximum Size of file to process

Thank you for the clarification

So I assume when you click on 2 for example it takes 30 minutes to open?



This is too long.

Are you using Get Excel Value/Get Excel Value dynamic transformations?

www.etl-tools.com/wiki/aetle/transformat...get_excel_cell_value
Peter Jonson
Support Analist
1 month 3 weeks ago #20708
Attachments:

Please Log in or Create an account to join the conversation.

  • Posts: 8127
  • Karma: 33
  • Thank you received: 512

Replied by admin on topic Maximum Size of file to process

Hi Vatticonda.

Some good news
We have spent some time testing working with large excel and managed significantly improve transformation designer screen response time.

Can you please try the latest version?

Here is the full list of changes.

21/02/2020 - 6.3.7.12

+ Improved: transformation designer response time while working with very large files
+ Improved: removed excess data refreshes within transformation designer this resulted in overall screen performance improvement
+ Improved: underscore character can be seen in preview mode now
+ Improved: the software will make three attempts to publish tableau files before failing
- Fixed: Various tableau related bugs
- Fixed: Pause package action issues

Please let us know the outcome.
Mike
1 month 3 weeks ago #20718

Please Log in or Create an account to join the conversation.

 

This site uses cookies. By continuing to browse the site, you are agreeing to our use of cookies