Execution Log Query TimeOut

AETLE: v6.5.32 x64

Hi, I think I have hit a performance barrier as one of my scheduled packages runs very frequently (every 5 mins) but has very little to do unless it finds a mail message to process (yes, I know you have a M365 Mbox monitor - but I had issues with that in earlier versions).

In any case there are > 70K log files in the log directory and even though I have set the Execution Log UI to only show 100 entries, I am now consistently getting Query Time Out error. The UI is also a bit laggy when opening packages etc. I am running a SQL Express instance just for AETLE.

Is there a way I can trim these log files and keep DB insync. I recall there may have been. They hold know retention value for me in this instance.

Thanks
 

I would be interested to see how your packages are structured.

We previously had a customer experiencing similar performance issues, and after restructuring their packages, everything started running much faster.

Just following up on your post:

1 You can automatically remove old log entries using the Clear Log Action:
www.etl-tools.com/wiki/advanced-etl-proc...ns/clear-log-action/

2 We once had a customer running around 20 packages, with each package checking the same mailbox every 10 minutes. This was very slow because repeatedly connecting to the same email server placed unnecessary load on both the application and the server.
We replaced this setup with a single package using an Email Loop. Since making that change, the process has run reliably without any failures.

You can see the screenshot here

www.etl-tools.com/email/processing-large...-email-messages.html

Hi Peter, hope you & Mike are well.

Thanks for the reply. Sorry have been sidetracked on a few other things.

I found the clear log action so have put that in to run once a day and that seems to have helped a lot. The performance Lag I experienced was more around viewing the Execution log. So, by limiting to last 100 and clearing the log once a day seems to have help a lot.

I have included a screenshot of the mailbox pickup phase in case there is a more efficient approach.