084 Learn How to Process Large Number of Email Messages

Follow this Advanced ETL Processor tutorial to process a large number of email messages.

Advanced ETL Processor
4.9 ★★★★★ Based on 16 reviews on Capterra See all reviews on Capterra →

This tutorial shows how to process a large number of email messages in Advanced ETL Processor using email loop actions. Use it when IMAP4 or Office 365 messages need to be downloaded and handled one at a time without leaning on the mail server like it owes you money.

What You Will Learn

  • Iterate through IMAP4 or Office 365 email messages one message at a time.
  • Use mailbox connection parameters for IMAP4 or Microsoft Graph API access.
  • Resume loop execution after a failure with a loop position file.
  • Review variables and execution logs while testing the workflow.

Before You Start

Use a test repository or safe sample data while following the tutorial. Production jobs are a poor place to experiment.

Email Loop Action Docs

This tutorial uses email loop actions to download messages one at a time. Use IMAP4 Email Loop for IMAP mailboxes and Office 365 Email Loop for Microsoft 365 mailboxes through the Microsoft Graph API. In practice, that keeps the load on the mail server lower than trying to grab the whole mailbox in one go. Mail servers are patient, but they are not saints.

The IMAP4 Email Loop documentation covers the parameters tab, IMAP4 connection parameter, resuming loop execution after failure, variables tab, and execution log tab.

The Office 365 Email Loop documentation covers the parameters tab, Office 365 connection parameter, resuming loop execution after failure, variables tab, and execution log tab.

Related package actions include IMAP4 Email Action, Office 365 Email Action, Extract Email Attachments Action, Check Email Message, Send Email, JSON Object Loop Action, and JSON Array Loop Action.

Need Advanced ETL Processor First?

Download the Advanced ETL Processor trial before following the tutorial, or review Enterprise if you need scheduled unattended execution.