Performance Optimization Options

Hi All,

I am running an initial load for a sales header table – it is just under 8 million records. It has taken now 1 hour and 15 minutes to load 1,5 million records.

What options do I have to tweak performance?
The sales detail table has just under 20 million records, so at this rate, I will need a whole day to run the load.

This moved extremely faster when I am loading the data from a local copy of the database that was shared with me. Now I have connected to the live environment and the performance isn’t looking good – although to note, I am connected from my office, so not on the client’s network – using a public/remote IP.

I am using the 32-bit version of the software.

Any suggestions?

Mark

Can you tell us about the data source and target?

I am loading data from Interbase into MS SQL Server database.
About 350 records per second.

Good Evening

I think most likely the issue is a network.
350 records per second is very low usually it is 10k+.

Basically, the software is pulling the data over the public network and inserts it using the public network as well.

I assume that you are inserting the data and not updating it,

Hi Mike,

Yes, I am running an insert (into an empty table).
Okay, let me go to the client site and test performance there with the 18 million records – will give you feedback.

Kind Regards,
Mark

Hi Mike,

Confirmed – network/location. We did 18,5 million in just over an hour (at the client site)

Mark