Working with Validator

Advanced ETL Processor Data Validator guarantees to your business that every data value is correct and accurate. It checks the data against a set of user-defined rules and constraints and identifies any errors or inconsistencies that may be present. This helps organizations avoid problems such as incorrect data being loaded into their systems, or data being lost or corrupted during the ETL process

What is Data Validation

Data validation is the process of ensuring that data meets certain criteria or rules. It helps identify inaccuracies, inconsistencies, or anomalies within datasets. Here are some common ways to validate data:

1. Data Type Validation: Verifies that data is in the expected format and adheres to predefined data types. For example, ensuring that a field intended for numerical data only contains numbers.
2. Range and Boundary Validation: Checks if data falls within predetermined ranges or boundaries. It helps detect outliers or invalid values. For instance, validating that a temperature reading is within a specific range.
3. Format and Pattern Validation: Ensures that data conforms to a specified format or pattern. This is particularly useful when dealing with data such as email addresses, phone numbers, or postal codes.
4. Consistency Validation: Compares data across multiple sources or fields to identify discrepancies or conflicts. It helps maintain data integrity by ensuring consistency within datasets.
5. Referential Integrity Validation: Verifies that relationships between different data elements are maintained. For example, confirming that foreign key values in a database table exist in the referenced primary key column.

It does not matter which business you are in sooner or later you will discover that there is something wrong with the data and it has to be validated. Here when Advanced ETL Processor validator can help.

Note:

• Records can also be rejected by the Server.
• If there are several validation rules and one of them rejects the record and another discards it, the record will be discarded

Validator Screen

To change Validator properties double click on it

Tip:

If no data is present in the grid check the previous step execution log.

About input and output fields:

• List of Output fields is always the same as Inputs.
• List of Input fields is taken from the previous object

Validator Toolbar

1. Properties
2. Create new tab
3. Cut
4. Copy
5. Paste
6. Delete
7. Redo
8. Undo
9. Align Left
10. Arrange Vertically
11. Align Right
12. Align Bottom
13. Arrange Horizontally
14. Align Top
15. Space Horizontally
16. Space Vertically
17. Snap to grid/show grid
18. Prints Mapping
19. Print Preview Mapping
20. Automap data
21. Delete All objects
22. Delete All Links
23. Search Objects
24. Process Data
25. First Record
26. Previous Record
27. Next Record
28. Last Record
29. Show Objects Panel
30. Zoom In
31. Zoom Out
32. Zoom back to 100%

Note:

We recommend giving the Validator name, it makes it easier to identify problems later.

Debugging Validation

To start debugging validation press the Process Data button

. To test data edit it in the Data grid.

To Change Validation Rule properties double click on it (or right click and select properties)

Note:

Use <value> to include actual value into default value

To add a new Validation rule drag and drop it from the Validation rules panel

It is also possible to apply several validation rules to the Input field by joining them

Validation Rules

• Validating Strings
• Validating Numbers
• Validating Dates
• Validating Times
• Miscellaneous Validations
• Validating Data using Regular Expressions

Video Tutorial