NOTE! This site uses cookies and similar technologies.

If you not change browser settings, you agree to it. Learn more

I understand

We did spend a lot of time optimizing our ETL software and here is what we were able to achieve so far:

Loading data into Oracle database via direct path loading from a textfile

Version 28000 rec/second

Version 46000 rec/second

Version 84000 rec/second

Version 94000 rec/second

Version 101000 rec/second

There a lot of ways to make our software better, we will continue working on improving performance and will publish our results here.

In latest version we have introduced support for Global Variables
They are stored in the registry, this allows to use different settings on different computers.

Here is very simple example: two computers sharing same repository using different server for transformations
Production  Development 


Please be very careful with this option it is very use to make mistake and run transformation agains wrong database

Today we have a reason to celebrate, our development team has managed to boost loading data from QVD files by 100 percent. Q-Eye version 3.1 can load 2.3 million records in just 16 seconds, that is 140k records per second



Advanced ETl Processor's "Is In list" validation function is used to check if value exists in the database or file.

Is In List

IfIn List

But In some situations it is not very efficient.

  • The list of values can be too big and it would not possible to fit it into the memory.
  • Pulling entire lookup may take to much time
  • We may want to process just 10 records but our lookup has 10 million records

In this case there is better alternative "Is value in database" and "If value in database" transformation functions

Is value in database

If value in database

The way it works is very simple: during execution <value> is replaced with actual value If number of records returned is more than zero it returns success otherwise failure

If value in database Prop

We soon realised that Visual Importer ETL was designed by people who use it everyday.

Mark Brown,
MIS Consultant

Our customers






Australian Rugby Union
Databases we work with