Excluding rows : based on defined values held in another data source or by using 'not equal to'

More
9 years 4 months ago #10254 by scoobster
Using Advanced ETL Processor Pro - trial version : version 5.7.7.23

I would need to be able to exclude rows using a variety of methods. I'd need to exclude any rows where the product description contains '*obs* or *del* or *invalid*', for example. I can use the 'is equal to' but don't see any 'is not equal to' option to select. Ideally I'd like to read these keywords from a file / sheet and build the exclude clause from that. Can it be done?

Also, I would need to be able to exclude any rows where a status field is not equal to one of many values. I could turn this around and use the 'is equal to' clause but I'm curious to know how / if I can exclude rows using this approach?

Finally, can I include a combination of 'equal to' and 'not equal to' within one go?

Thanks for any tips you could offer on this.

Please Log in or Create an account to join the conversation.

More
9 years 4 months ago #10255 by admin
I would need to be able to exclude rows using a variety of methods. I'd need to exclude any rows where the product description contains '*obs* or *del* or *invalid*', for example. I can use the 'is equal to' but don't see any 'is not equal to' option to select. Ideally I'd like to read these keywords from a file / sheet and build the exclude clause from that. Can it be done?

>>> Sure Just double click on it





Also, I would need to be able to exclude any rows where a status field is not equal to one of many values. I could turn this around and use the 'is equal to' clause but I'm curious to know how / if I can exclude rows using this approach?

>>> Use "In list" function

Finally, can I include a combination of 'equal to' and 'not equal to' within one go?

Yes, it s possible just put them one after another

I hope you know how to use data preview function ;-)

Mike

Mike
ETL Architect
Attachments:
The following user(s) said Thank You: scoobster

Please Log in or Create an account to join the conversation.

More
9 years 4 months ago #10259 by scoobster
Many thanks, Mike. This is great. Most of that is now working as I want it to work. One open point is around wildcard characters. If I have an Excel worksheet with a list of partial strings that I want to use to exclude rows in my main data, is that possible? I have tried wrapping my list of partial strings in '*' and '%' but I only get a match by using the entire string.

My partial string list is like below;
*obso*
*atsto*
*bik*

So a field containing any of these partial strings should be excluded. I couldn't see any 'like' or 'soundex' function to use.

Hope it's possible.

Thanks again. Great support and excellent application.

Please Log in or Create an account to join the conversation.

More
9 years 4 months ago #10260 by admin
There is is another function called "Contains" that is what you need.

We probably need to rename it to avoid confusion :huh:

Peter

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
9 years 4 months ago #10264 by scoobster
Thanks a lot. That works. Ideally I would like the user to be able to maintain the list of phrases and then just look up these. But 'CONTAINS' is a single value only. There could 30+ values that we need to exclude value with. Is there a wildcard / pattern matching function that can look in Excel or Access? Or is there an even better way to achieve the same using existing functions?

Please Log in or Create an account to join the conversation.

More
9 years 4 months ago #10265 by admin
You can also use regular expression and use multiple patterns

Mike

Mike
ETL Architect
The following user(s) said Thank You: scoobster

Please Log in or Create an account to join the conversation.