URL Logger how to trigger ETL

I'm having trouble understanding how to trigger an ETL transformation once URL Logger receives a request and posts it in default SQLite or my chosen SQL database. Could you please advise on the process for initiating the ETL transformation after receiving the request?

It was not designed for that.

Please use AETL scheduler to process web hook data.

Thank you

A followup question , what exactly is URL logger supposed to do ? I understand it allows for all webhook and JSON body to go into a structured db.

Then it's always through ETL scheduler ?

If I do want it quickly , then I can technically do a "trigger" in sql which runs ETL from command line? Any issues with this approach ?

>>> A followup question , what exactly is URL logger supposed to do ? I understand it allows for all webhook and JSON body to go into a structured db.

Correct, all it does writes webhook data into the database.

Having thought about it, we cad add the ability to execute code after after webhook data is recieved.

That is not that dificult to implemenet and will benefit a lot of users,

>>> If I do want it quickly , then I can technically do a "trigger" in sql which runs ETL from command line? Any issues with this approach ?

ETL takes time to start so if you have a lot of requests it might stall

Do you know how many requests you might get?
 

I am sure it will benefit others as well.

My requests are sporadic . 30-40 in whole day maximum but frequency can change. At upper end I am looking at 4-5 in a minute sometimes.

If the requests are queued and are processed 1 by 1 sequentially , I think it's good payoff instead of doing it parallely