- Posts: 40
- Thank you received: 2
Errors with 'Use Bulk API' for Salesforce connection
5 years 3 months ago #18116
by cstaley
Errors with 'Use Bulk API' for Salesforce connection was created by cstaley
I'm running Visual Importer Enterprise 9.2.2.4. You recently made changes so the utilization of the Bulk API was more efficient when importing data with a large number of records. I have a couple issues I'm seeing. The error messages don't tell me much. I'm hoping to get additional clarification regarding what they mean and what I may need to change.
Error 1 - Error encountered during CloseBatch: HTTP/1.1 400 Bad Request
I get this error when my target destination option for Salesforce is configured to 'Use Bulk API' AND my Transformation is set to 'Add New and Update Old Records'.
Error 2 - Error encountered during AddBatch: Socket Error # 10054
I get this error when sending large amounts of data to Salesforce. My target destination option for Salesforce is configured to 'Use Bulk API' AND my Transformation is set to 'Add New Records'.
I'm not sure how to deal with each error. The first I can get around by removing the Use Bulk API checkbox. The other seems to recover on it's own.
I attempted to attach two VI.log files. The largest of the two is 45KB. The system say's they exceed the allowed limit. I'm not sure if they will get stripped.
Error 1 - Error encountered during CloseBatch: HTTP/1.1 400 Bad Request
I get this error when my target destination option for Salesforce is configured to 'Use Bulk API' AND my Transformation is set to 'Add New and Update Old Records'.
Error 2 - Error encountered during AddBatch: Socket Error # 10054
I get this error when sending large amounts of data to Salesforce. My target destination option for Salesforce is configured to 'Use Bulk API' AND my Transformation is set to 'Add New Records'.
I'm not sure how to deal with each error. The first I can get around by removing the Use Bulk API checkbox. The other seems to recover on it's own.
I attempted to attach two VI.log files. The largest of the two is 45KB. The system say's they exceed the allowed limit. I'm not sure if they will get stripped.
Please Log in or Create an account to join the conversation.
5 years 3 months ago #18120
by Maria
Replied by Maria on topic Errors with 'Use Bulk API' for Salesforce connection
There are some limitations of Salesforce BULK API
developer.salesforce.com/docs/atlas.en-u..._concepts_limits.htm
Batches for data loads can consist of a single CSV, XML, or JSON file that is no larger than 10 MB.
A batch can contain a maximum of 10,000 records.
A batch can contain a maximum of 10,000,000 characters for all the data in a batch.
A field can contain a maximum of 32,000 characters.
A record can contain a maximum of 5,000 fields.
A record can contain a maximum of 400,000 characters for all its fields.
A batch must contain some content or an error occurs.
We are submitting data in 5000 records batches,
so if you have a very wide table you might hit the limit of 10mb per file or 10,000,000 characters for all the data in a batch.
"Add new" is not supported by Salesforce BULK API.
developer.salesforce.com/docs/atlas.en-u..._concepts_limits.htm
Batches for data loads can consist of a single CSV, XML, or JSON file that is no larger than 10 MB.
A batch can contain a maximum of 10,000 records.
A batch can contain a maximum of 10,000,000 characters for all the data in a batch.
A field can contain a maximum of 32,000 characters.
A record can contain a maximum of 5,000 fields.
A record can contain a maximum of 400,000 characters for all its fields.
A batch must contain some content or an error occurs.
We are submitting data in 5000 records batches,
so if you have a very wide table you might hit the limit of 10mb per file or 10,000,000 characters for all the data in a batch.
"Add new" is not supported by Salesforce BULK API.
Please Log in or Create an account to join the conversation.
- Peter.Jonson
-
- Offline
- Platinum Member
-
5 years 3 months ago #18127
by Peter.Jonson
Peter Jonson
ETL Developer
Replied by Peter.Jonson on topic Errors with 'Use Bulk API' for Salesforce connection
Hi.
We have made some minor tweaks which we hope will address the issues you reported.
1) When the user selects ADD ONLY bulk api is not used and a warning is written into the log
2) We added a check for the number of characters this should help with very wide tables
Please keep us posted on your progress
We have made some minor tweaks which we hope will address the issues you reported.
1) When the user selects ADD ONLY bulk api is not used and a warning is written into the log
2) We added a check for the number of characters this should help with very wide tables
Please keep us posted on your progress
Peter Jonson
ETL Developer
Please Log in or Create an account to join the conversation.