Event Monitor - File System Changes

More
2 years 5 months ago #23470 by admin
No execution when files are modified , renamed

This is very tricky

When we looked it it we noticed that a lot of software create temporary file first and copy it to the folder alter.

So the modification action never happen.

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
2 years 5 months ago #23472 by prashant

No execution when files are modified , renamed

This is very tricky

When we looked it it we noticed that a lot of software create temporary file first and copy it to the folder alter.

So the modification action never happen.
Currently , even if a newer version of the qualifying file is  overwritten, it never triggers 

Please Log in or Create an account to join the conversation.

More
2 years 5 months ago #23474 by admin
Overwritten = delete file + create new file  
Modify = Open exiting file, add new data to the end, close the file

We will check everything again 

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
2 years 5 months ago #23475 by prashant

Overwritten = delete file + create new file  
 
OK , good to know , I assume Window auto deletes the file. So I have observed , over write doesn't trigger the monitor. 

But Thank you again for looking into it

Please Log in or Create an account to join the conversation.

More
2 years 5 months ago - 2 years 5 months ago #23478 by admin
Having thought about it we have decided to add "Log Events" option to the latest release.

I hope you will find it useful, The log can grow a lot so please do not use it in production



Log example



 

Mike
ETL Architect
Last edit: 2 years 5 months ago by admin.

Please Log in or Create an account to join the conversation.

More
2 years 5 months ago - 2 years 4 months ago #23483 by prashant
Thank you for the Logs . It shows that ETL is able to detect the changes when the files are modified. Great to see if the regex has been successful
(PS Your standard transformation window regex options, where user can test if regex matched or not will be great for newbies to test immediately here)




0. As per the original request , I can now act upon specific subdirectory, specific files via regular expression. Thank you 
1. Currently it's still not able to act on the modifications to the file although LOGS can detect it.
2. In my case , I talked with support of AutoSQL who've provided a way for me to delete the files ,essentially providing a new file which ETL very happily acts upon 

Cheers,
PM 
Last edit: 2 years 4 months ago by prashant.

Please Log in or Create an account to join the conversation.

Cookies user preferences
We use cookies to ensure you to get the best experience on our website. If you decline the use of cookies, this website may not function as expected.
Accept all
Decline all
Read more
Marketing
Set of techniques which have for object the commercial strategy and in particular the market study.
Google
Accept
Decline
Analytics
Tools used to analyze the data to measure the effectiveness of a website and to understand how it works.
Google Analytics
Accept
Decline
Google Analytics
Accept
Decline
Functional
Tools used to give you more features when navigating on the website, this can include social sharing.
Advertisement
If you accept, the ads on the page will be adapted to your preferences.
Google Ad
Accept
Decline
Save