Welcome, Guest
Username: Password: Remember me
  • Page:
  • 1

TOPIC: Importing records to Salesforce is very slow

Importing records to Salesforce is very slow 1 year 1 month ago #17856

  • cstaley
  • Topic Author
  • Offline
  • Junior Boarder
  • Junior Boarder
  • Posts: 36
  • Karma: 2
  • Thank you received: 2
I've always seen some performance degradation with Visual Importer when pushing records from MSSQL server to Salesforce. I need to push a large number of records which will take several hours. Are there any tuning parameter changes I can make to speed up this process?

Our production instance of Visual Importer is 8.4.4.5 x64. We are in the process of upgrading to 9.2.0.4 x64. I don't see any performance changes between the two instances. I am using the transformation type of 'add all records' to salesforce. The database server is on the same backbone as the VI client.

The only configuration option I see with the Salesforce connection is 'Use Bulk API' checkbox. I've tried this to see if anything changes. There is no noticeable difference. I don't know if there needs to be a configuration change on the source setup in conjunction with the bulk API option. However, there really aren't source options to configure.

Salesforce has a tool called Data Loader. I can import a CSV file very quickly with this tool. I'm sure Visual Importer should be able to run faster. I'm hoping you can point out what I'm doing wrong.

Attached are screenshots showing import configuration and job status.

Please Log in or Create an account to join the conversation.

Importing records to Salesforce is very slow 1 year 1 month ago #17858

  • admin
  • admin's Avatar
  • Offline
  • Moderator
  • Moderator
  • Deeds not Words
  • Posts: 7572
  • Karma: 33
  • Thank you received: 415
Hi Chris.

We will test it and get back you.
Mike

Please Log in or Create an account to join the conversation.

Importing records to Salesforce is very slow 1 year 1 month ago #17871

  • admin
  • admin's Avatar
  • Offline
  • Moderator
  • Moderator
  • Deeds not Words
  • Posts: 7572
  • Karma: 33
  • Thank you received: 415
Hi Chris

Can you try the latest version and let us know the outcome.
Please use Bulk API.

You would need to login into sales force and check bulk data load job status.

Working with sales force Bulk API can be confusing to the users.
To make the life of everyone easier, we will create a couple of WIKI articles and publish them on our website later.
Mike

Please Log in or Create an account to join the conversation.

Importing records to Salesforce is very slow 1 year 1 month ago #17899

  • cstaley
  • Topic Author
  • Offline
  • Junior Boarder
  • Junior Boarder
  • Posts: 36
  • Karma: 2
  • Thank you received: 2
Wonderful improvement. I am seeing batch running at 5K record each time.
I'm very pleased with the performance improvement.

Thank you.

Please Log in or Create an account to join the conversation.

Importing records to Salesforce is very slow 1 year 1 month ago #17901

  • admin
  • admin's Avatar
  • Offline
  • Moderator
  • Moderator
  • Deeds not Words
  • Posts: 7572
  • Karma: 33
  • Thank you received: 415
Please do not forget to validate it.
Login to salesforce and check "Bulk Data Load Jobs"
Mike

Please Log in or Create an account to join the conversation.

  • Page:
  • 1

We have 91 guests and no members online