- Posts: 11
- Thank you received: 1
Excluding rows : based on defined values held in another data source or by using 'not equal to'
9 years 4 months ago #10254
by scoobster
Excluding rows : based on defined values held in another data source or by using 'not equal to' was created by scoobster
Using Advanced ETL Processor Pro - trial version : version 5.7.7.23
I would need to be able to exclude rows using a variety of methods. I'd need to exclude any rows where the product description contains '*obs* or *del* or *invalid*', for example. I can use the 'is equal to' but don't see any 'is not equal to' option to select. Ideally I'd like to read these keywords from a file / sheet and build the exclude clause from that. Can it be done?
Also, I would need to be able to exclude any rows where a status field is not equal to one of many values. I could turn this around and use the 'is equal to' clause but I'm curious to know how / if I can exclude rows using this approach?
Finally, can I include a combination of 'equal to' and 'not equal to' within one go?
Thanks for any tips you could offer on this.
I would need to be able to exclude rows using a variety of methods. I'd need to exclude any rows where the product description contains '*obs* or *del* or *invalid*', for example. I can use the 'is equal to' but don't see any 'is not equal to' option to select. Ideally I'd like to read these keywords from a file / sheet and build the exclude clause from that. Can it be done?
Also, I would need to be able to exclude any rows where a status field is not equal to one of many values. I could turn this around and use the 'is equal to' clause but I'm curious to know how / if I can exclude rows using this approach?
Finally, can I include a combination of 'equal to' and 'not equal to' within one go?
Thanks for any tips you could offer on this.
Please Log in or Create an account to join the conversation.
9 years 4 months ago #10255
by admin
Mike
ETL Architect
Replied by admin on topic Excluding rows : based on defined values held in another data source or by using 'not equal to'
I would need to be able to exclude rows using a variety of methods. I'd need to exclude any rows where the product description contains '*obs* or *del* or *invalid*', for example. I can use the 'is equal to' but don't see any 'is not equal to' option to select. Ideally I'd like to read these keywords from a file / sheet and build the exclude clause from that. Can it be done?
>>> Sure Just double click on it
Also, I would need to be able to exclude any rows where a status field is not equal to one of many values. I could turn this around and use the 'is equal to' clause but I'm curious to know how / if I can exclude rows using this approach?
>>> Use "In list" function
Finally, can I include a combination of 'equal to' and 'not equal to' within one go?
Yes, it s possible just put them one after another
I hope you know how to use data preview function
Mike
>>> Sure Just double click on it
Also, I would need to be able to exclude any rows where a status field is not equal to one of many values. I could turn this around and use the 'is equal to' clause but I'm curious to know how / if I can exclude rows using this approach?
>>> Use "In list" function
Finally, can I include a combination of 'equal to' and 'not equal to' within one go?
Yes, it s possible just put them one after another
I hope you know how to use data preview function

Mike
Mike
ETL Architect
The following user(s) said Thank You: scoobster
Please Log in or Create an account to join the conversation.
9 years 4 months ago #10259
by scoobster
Replied by scoobster on topic Excluding rows : based on defined values held in another data source or by using 'not equal to'
Many thanks, Mike. This is great. Most of that is now working as I want it to work. One open point is around wildcard characters. If I have an Excel worksheet with a list of partial strings that I want to use to exclude rows in my main data, is that possible? I have tried wrapping my list of partial strings in '*' and '%' but I only get a match by using the entire string.
My partial string list is like below;
*obso*
*atsto*
*bik*
So a field containing any of these partial strings should be excluded. I couldn't see any 'like' or 'soundex' function to use.
Hope it's possible.
Thanks again. Great support and excellent application.
My partial string list is like below;
*obso*
*atsto*
*bik*
So a field containing any of these partial strings should be excluded. I couldn't see any 'like' or 'soundex' function to use.
Hope it's possible.
Thanks again. Great support and excellent application.
Please Log in or Create an account to join the conversation.
9 years 4 months ago #10260
by admin
Mike
ETL Architect
Replied by admin on topic Excluding rows : based on defined values held in another data source or by using 'not equal to'
There is is another function called "Contains" that is what you need.
We probably need to rename it to avoid confusion :huh:
Peter
We probably need to rename it to avoid confusion :huh:
Peter
Mike
ETL Architect
Please Log in or Create an account to join the conversation.
9 years 4 months ago #10264
by scoobster
Replied by scoobster on topic Excluding rows : based on defined values held in another data source or by using 'not equal to'
Thanks a lot. That works. Ideally I would like the user to be able to maintain the list of phrases and then just look up these. But 'CONTAINS' is a single value only. There could 30+ values that we need to exclude value with. Is there a wildcard / pattern matching function that can look in Excel or Access? Or is there an even better way to achieve the same using existing functions?
Please Log in or Create an account to join the conversation.
9 years 4 months ago #10265
by admin
Mike
ETL Architect
Replied by admin on topic Excluding rows : based on defined values held in another data source or by using 'not equal to'
You can also use regular expression and use multiple patterns
Mike
Mike
Mike
ETL Architect
The following user(s) said Thank You: scoobster
Please Log in or Create an account to join the conversation.