Transforming Data

Below is list of Time Validation Functions supported by Advanced ETL Processor

ImageData Validation FunctionDescription
Is Time Checks if the data is a time value
Is Time Between Checks if the data is a time between two values
Is Time Less Than Checks if the data is a time less than value
Is Time More Than Checks if the data is a time more than value
Is Second Checks if data is a number between 0 and 59
Is Minute Checks if data is a number between 0 and 59
Is Hour 24 Checks if data is a number between 0 and 23
Is Hour 12 Checks if data is a number between 0 and 12
Is PM Checks if the data is a PM Date
Is AM Checks if the data is a AM Date

Below is a list of Date Validation Functions supported by Advanced ETL Processor

ImageData Validation FunctionDescription
Is Date Checks if the data is a Date
Is Date Between Checks if the data is a Date between two values
Is Date Less Than Checks if the data is a Date less than value
Is Date More Than Checks if the data is a Date more than value
Is Monday, Is Tuesday, Is Wednesday, Is Thursday, Is Friday, Is Saturday, Is Sunday, Is Today, Is Yesterday, Is Tomorrow, Is Weekend, Is Weekday Checks if the data is a Date value which belongs to specific day of week
Is January, Is February, Is March, Is April, Is May, Is June, Is July, Is August, Is September, Is October, Is November, Is December, Is Current Month, Is Last Month, Is Next Month Checks if the data is a Date value which belongs to specific month of a year
Is 1st Quarter, Is 2nd Quarter, Is 3rd Quarter, Is 4th Quarter, Is Current Quarter,Is Last Quarter, Is Next Quarter Checks if the data is a Date value which belongs to specific quarter of a year
Is Leap Year, Is Current Year, Is Last Year, Is Next Year Checks if the data is a Date value which belongs to specific year
Is Current Week, Is Last Week, Is Next Week Checks if the data is a Date value which belongs to specific week
Is Within Past Minutes, Is Within Past Hours, Is Within Past Days, Is Within Past Weeks, Is Within Past Months Checks if the data is a Date value within in past minutes etc.

Transforming data using regular expressions

 Advanced ETL Processor is able to check any data, for example date formats, post codes, phone numbers etc. It is also possible to write your own Regular expressions

 

Checking File format

Checking source data

 

What are the regular expressions?

Regular expression is a string that is used to describe or match a set of strings, according to certain syntax rules. Regular expressions are used by many text editors, utilities, and programming languages to search and manipulate text based on patterns. For example, Perl and Tcl have a powerful regular expression engine built directly into their syntax. Several utilities provided by Unix distributions—including the editor ed and the filter grep—were the first to popularize the concept of regular expressions.
"Regular expression" is often shortened to regex or regexp (singular), or regexes, regexps, or regexen (plural). Some authors distinguish between regular expression and abbreviated forms such as regex, restricting the former to true regular expressions, which describe regular languages, while using the latter for any regular expression-like pattern, including those that describe languages that are not regular. As only some authors observe this distinction, it is not safe to rely upon it. As an example of the syntax, the regular expression \bex can be used to search for all instances of the string "ex" that occur at word boundaries (signified by the \b). Thus in the string, "Texts for experts," \bex matches the "ex" in "experts," but not in "Texts" (because the "ex" occurs inside the word there and not immediately after a word boundary).

Source: wikipedia.

Below is the list of String Transformations supported by Advanced ETL Processor

ImageData Transformation FunctionDescription
Upper Case Converts all characters of a string to Upper Case My String => MYSTRING
Lower Case Converts all characters of a string to Lower Case My String => my string
Proper Case Converts first character of all words within a string to Upper Case and the rest to the lower case my strinG => My String
First Up Converts first character a string to Upper Case and the rest to the lower case my strinG => My string
Delete Spaces Makes sure that there is only one space between words My string => My string
Trim Removes Leading and Trailing Spaces from a string
Left Trim Removes Leading Spaces from a string
Right Trim Removes Trailing Spaces from a string
Sub String Returns part of a string.
Replace Replaces a one or more characters from the data with zero or more new characters.
Ensure Prefix Check string for prefix and if it is missing adds it
Ensure Suffix Check string for suffix and if it is missing adds it
Ensure No Prefix Check string for prefix and if it is present removes it
Ensure No Suffix Check string for suffix and if it is present removes it
Left Pad Returns the string left-padded to the length with spaces or specified character.
Right Pad Returns the string right-padded to the length with spaces or specified character.
Escape String Replaces special characters such as TAB, CR, LF,NULL,BEL,BS,ESC,HT,FF,VT with there C-Style escape equivalents.
UnEscape String Opposite to Escape String, Replaces C-Style escape characters with special characters such as TAB, CR, LF,NULL,BEL,BS,ESC,HT,FF,VT.
Delete Deletes part of a string.
Left Returns left part of a string.
Right Returns right part of a string
Left Delete Deletes left part of a string
Right Delete Deletes right part of a string

 

Below is list of Number Transformations supported by Advanced ETL Processor

ImageData Transformation FunctionDescription
Round Rounding is the process of reducing the number of significant digits in a number. The result of rounding is a "shorter" number having fewer non-zero digits yet similar in magnitude. The result is less precise but easier to use.For example: 73 rounded to the nearest ten is 70, because 73 is closer to 70 than to 80.
Abs Returns absolute value of a number. Absolute value is always positive. For example -2 will give 2
Sign Returns Sign of numeric value -1 for negative values, 1 for positive values and 0 for 0
Add Transformation Function Add  Adds values together
Substract Transformation Function Substract  Substracts values from each other
Divide Transformation Function Divide  Devides values
Multiply Transformation Function Multiply  Multiplies values
Max Transformation Function Max  Calculates max value
Min Transformation Function Min  Calculates min value
If Integer Data Transformation Function If Integer Checks if the data is an Integer Value, if it is passes Success value to the next step otherwise passes Failure value
If Number Data Transformation Function If Number Checks if the data is an Numeric Value, if it is passes Success value to the next step otherwise passes Failure value
If Negative Data Transformation Function If Negative Checks if the data is a Negative Value, if it is passes Success value to the next step otherwise passes Failure value
If Positive Data Transformation Function If Positive Checks if the data is a Positive Value, if it is passes Success value to the next step otherwise passes Failure value
If Number Between Data Transformation Function If Number Between Checks if the data is a Numeric Value between two numbers, if it is passes Success value to the next step otherwise passes Failure value
If Number Less Than Data Transformation Function If Number Less Than Checks if the data is a Numeric Value less than specified Number, if it is passes Success value to the next step otherwise passes Failure value
If Number More Than Data Transformation Function If Number More Than Checks if the data is a Numeric Value more than specified Number, if it is passes Success value to the next step otherwise passes Failure value

Advanced ETL Processor Standard

Recommended product for desktop users who require advanced data transformation

From only 340$ per license

Read More

 


Advanced ETL Processor Professional

Recommended product for development environment

From only 480$ per license

Read More

 


Advanced ETL Processor Enterprise

Recommended product for complex enterprise environment

From only 690$ per license

Read More