When we initially developed our ETL Software, we made certain design decisions that we later reconsidered. One of these was the handling of variables. While variables provide flexibility, their unrestricted use can lead to unintended consequences, such as unnecessary value replacements.
Introduction of Dynamic Package Actions
To address this, we introduced Dynamic Actions last year. These actions feature four types of parameters: Static, Variable, EnvVariable, and Calculation. The values for these parameters are assigned or computed based on their type before the action is executed.
Additionally, we have redesigned complex "do-everything" actions, such as the FTP Action, by breaking them into simpler, more focused actions like FTP Upload and FTP Download. This approach has resulted in the creation of over 140 dynamic actions.
Note: We will continue supporting legacy actions as long as necessary. However, for new installations, legacy actions are hidden by default, and we strongly recommend using dynamic actions for all new projects.
Variable Actions
We have also created a set of actions specifically designed for working with variables:
- Load Variable Action
- Delete Variable Action
- Select Value Action
- Set Variables Action
- File to Variables Action
- File Line to Variables Action
- SQL Record to Variables Action
- SQL to Variables Action
More information: Working With Variables
Improvements to Loops
We have significantly improved loop handling, making it easier to iterate over files, file lines, database records, and even email messages. Variables are now assigned automatically based on file headers or field names, reducing manual setup.
Video Tutorial:077 Learn How to Rename all Excel Sheets in a Directory Automatically
Working with Emails
Frequent connection and disconnection from email servers can lead to server overload and throttling. To mitigate this, we introduced Email Loop Actions, which allow emails to be processed one by one efficiently.
We have also created separate actions for:
With these improvements, email messages can be retrieved using a loop action, validated through multiple actions, and processed dynamically based on their content. This results in better performance and efficiency.
Changes to Logging
Logging plays a critical role in workflow debugging and troubleshooting. When the Write Variables option is enabled, two additional log files are created:
- A log that captures variable values before action execution.
- A log that lists variables updated by the action.
These logs are accessible via the interface and can also be viewed in the Action Properties Log tab, which is particularly useful when an action is executed multiple times.
Additionally, when debugging an action, log files are now stored in a separate subfolder, making log file management much easier.
Data Browsers
There is no longer a need to use separate tools to browse data (e.g., FTP files). We have introduced several built-in data browsers to enhance usability:
- Database Browser
- FTP Browser
- Cloud Storage Browser
- Azure Blob Browser
- Amazon S3 Browser
These browsers allow users to view data, run scripts, and even upload/download files reliably.
HTTP Action
The new HTTP Dynamic Action enables users to execute HTTP requests similarly to Postman. This makes debugging HTTP requests much easier and improves integration with web services.
Examples and Use Cases
To help users get started more quickly, we have added many examples demonstrating various real-world scenarios. These include:
- Interacting with ChatGPT for AI-driven automation
- Efficient file handling and transformations using Dynamic Actions
- Making HTTP requests and integrating with APIs
- Automating database operations with enhanced SQL actions
These examples provide practical guidance on how to use the latest features to improve your workflows.