Creating New Import

Creating an Import Script

To load data from a data source into a data target, it is necessary to define the data mapping between the target table and the data source.

The simplest way to create an Import Script is by using the Import Script Wizard.

Steps to Create an Import Script

1. Open the System Menu and select New → Import.
2. In the Description field, enter the name of the Import you are about to create.
3. Follow the step-by-step instructions provided by the wizard to define the data source, target, and mapping.

The wizard simplifies the process, ensuring accurate mapping and efficient data import setup.

Mapping Screen Overview

To access the mapping screen:

1. Open a Demo Import

   • Double-click on any demo Import script from the list.

2. View the Import Editor

   • The Import editor will appear, allowing you to configure and review the data mapping between the source and target.

The mapping screen is where the relationships between source fields and target fields are defined, ensuring accurate data transformation during the import process.

Main Toolbar

Toolbar Options

1. Data Target Options
   Configure options related to the target data destination.

2. Write Notes/Documentation
   Add or edit notes to document the Import Script.

3. Load Import Script from File
   Open and load an Import Script stored in a file.

4. Save Import Script to File
   Save the current Import Script to an external file.

5. Save As
   Save the Import Script under a new name or location.

6. Save Import to the Repository
   Commit the Import Script to the repository for centralized access.

7. Refresh Fields List from the Database
   Update the fields list by reloading metadata from the database.

8. Check Import for Mapping Errors
   Validate the Import Script to identify any mapping errors.

9. Data Preview
   View a sample of the data to verify the mapping configuration.

10. Clear Field Mapping
    Remove all field mappings in the current script.

11. Hide Mapping Panel
    Toggle the visibility of the mapping panel.

12. Data Import
    Execute the Import Script to load data into the target.

13. Manage Versions
    Access version management for the Import Script.

14. Add Version
    Save the current Import Script as a new version.

15. Revert to Previous Version
    Roll back the Import Script to an earlier version.

16. Make Import Read-Only
    Lock the Import Script to prevent further modifications.

17. Schedule for Execution
    Add the Import Script to the execution schedule.

18. View Execution Log
    Access logs for past executions of the Import Script.

Source Toolbar

Source Toolbar

Toolbar Options

1. Data Source Options
   Configure settings for the source data, such as file format or database connection details.

2. Refresh Source Data
   Reload the data from the source to reflect any updates or changes.

3. Add New Column
   Add a new column to the source field mapping.

4. Delete Last Column
   Remove the last column from the source field mapping.

5. Auto Map Fields
   Automatically map source fields to the corresponding target fields based on matching names.

6. Filter
   Apply filters to the source data to limit or refine the dataset being imported.

7. Open Source File/Directory
   Open the file or directory containing the source data for review or editing.

8. Records to Show
   Specify the number of records to display in the preview or editor.

9. Source File/Table Name
   Displays the name of the source file or database table being used.

Mapping panel

The Mapping Panel displays all relevant information for mapping a specific field. It allows precise configuration of how data flows from the source to the target.

Mapping Methods

1. Direct Mapping
   Map fields directly from the source to the target without modification.

2. Mapping Through Calculations
   Use calculated expressions or functions to transform data before mapping it to the target field.

Alternate Mapping Option

If preferred, the Mapping Panel can be hidden, and the mapping can be performed directly in the grid interface for a more streamlined approach.

SQL Statements

SQL statements can be executed both before and after the data import process to perform preparatory or cleanup tasks.

Key Details

• Executing Multiple Statements
  To execute multiple SQL statements, a SQL delimiter must be specified.

• Target Connection
  All SQL statements are executed against the target database connection.

• Restrictions
  SELECT statements are not allowed in this context.

This functionality ensures smooth integration and enables efficient management of data workflows.

Template tab

Transformation Log Tab

Rejected Records Tab

Posted on January 15, 2025 • 4 min read • 739 words