008 How to enable Apache Kafka connections

Enable Apache Kafka connection objects in the ETL repository with the required repository SQL update.

Repository Database Updates
4.9 ★★★★★ Based on 16 reviews on Capterra See all reviews on Capterra →

The Update procedure

This update adds Apache Kafka connection objects to the repository. Use it when Kafka support exists in the installed product but the repository tree has not caught up. Kafka moves messages quickly. Repository upgrades, naturally, prefer a written invitation.

It applies to repositories used by Advanced ETL Processor and Visual Importer ETL.

Before you run the SQL

  1. Create a repository backup.
  2. Stop schedulers and services that use the repository.
  3. Check the repository connection in the product settings.
  4. Run the update once and restart the application.

Run this SQL against the repository

Insert into OBJECT_TYPES
(OBJECT_TYPE,OBJECT_TYPE_NAME,OBJECT_TYPE_GROUP)
Values
(917,'Apache Kafka Connection',30000)

Insert into OBJECT_TYPES
(OBJECT_TYPE,OBJECT_TYPE_NAME,OBJECT_TYPE_GROUP)
Values
(918,'Apache Kafka Connections',30000)

INSERT INTO OBJECTS_TREE
(OBJECT_ID,
PARENT_ID,
NAME,
OBJECT_TYPE
)
Select
OBJECT_ID*-9 as OBJECT_ID,
PARENT_ID,
'Apache Kafka' as NAME,
917 as OBJECT_TYPE
From
OBJECTS_TREE
where
OBJECTS_TREE.OBJECT_TYPE=322

UPDATE OBJECT_TYPES
set OBJECT_TYPE_GROUP=30000
WHERE OBJECT_TYPE= '917'

UPDATE OBJECT_TYPES
set OBJECT_TYPE_GROUP=30000
WHERE OBJECT_TYPE= '918'

After the repository update

Open the connection tree and confirm that Apache Kafka is available. If the option is missing, confirm the product is using the same repository database you updated.

Note: If you are having problems upgrading our software please let us know and we will do our best to assist you.