Email receipt package scheduling

More
10 years 2 months ago #7572 by JHeinz
We are using receive email object to automatically send reports based on sender and report name in subject. We have gotten this to work but must schedule package every minute to look for email and respond in timely fashion. We have several packages running every minute which causing excessive processing. Is there a way to trigger a package to run based on sender and subject only when an email is received instead of looking every minute for every package?

Please Log in or Create an account to join the conversation.

More
10 years 2 months ago #7575 by admin
Is there a way to trigger a package to run based on sender and subject only when an email is received instead of looking every minute for every package?

I do not think it is possiible.

But maybe there is another way of doing it... or optimizing it

looking every minute for every package...

What do you mean by "for every package"?

excessive processing...

where this exessive processing is happenning?
Is it email server problem or the server where our etl software is run?

Mike

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
10 years 2 months ago #7576 by JHeinz
Each package represents a report type, they may email with subject "buyline" for a buyline report or "fill rate" for that report. Each of these must poll the e-mail dbase looking for matching subject request to execute the respective report. We want to respond to each request in a maximum of 1 minute so must poll every minute to executue. We are cloud based and charged based on server processing. Each time a report package polls the email dbase some processing occurs. There may be only one request for that report a week, but we don't know when that will be so report package must poll email dbase 2400 times (480 min/day x 5 days week)to execute that one request. The charges aren't prohibitive, but the monitor is clogged with these email polling transactions and it just seems there should be a more efficient way to execute. My suggestion is an email object which triggers execution when an e-mail is received. This object could be the first for each package so the package is triggered to look at subject and determine execution only when an email is received. This would eliminate most if not all the scheduling.

Another awesome potential enhancement would be a java or other web based language object which generates a code snippet that could be embedded into an existing web page. This would generate a menu allowing users to execute packages via the web. Just a thought.

Thanks,

Jeff

Please Log in or Create an account to join the conversation.

More
10 years 2 months ago - 10 years 2 months ago #7578 by admin
1. My suggestion is an email object which triggers execution when an e-mail is received. This object could be the first for each package so the package is triggered to look at subject and determine execution only when an email is received. This would eliminate most if not all the scheduling.

What you are askinng is called PUSH email notifications, although it is techically possible to implement it there us no garantie that it will work in your case

read this
en.wikipedia.org/wiki/Push_email
www.isode.com/whitepapers/imap-idle.html

Are you ising pop3 or imap4 connection?
IMAP4 is a better option, once email is processed you cam move it into different folder so you can avoid double processing.

You said that for every "subject" you have a separate package.
Does it mean that every package has POP3/IMAP4 object which pools the data?
If it is the case better option would be to load messages into the database table and loop through the table instead of pulling messages several times.
(perhaps you can email us your reposotroy so we can have a look)


2.

Another awesome potential enhancement would be a java or other web based language object which generates a code snippet that could be embedded into an existing web page. This would generate a menu allowing users to execute packages via the web. Just a thought.

If your server is windows based you should be able to do it now.

Mike

Mike
ETL Architect
Last edit: 10 years 2 months ago by admin.

Please Log in or Create an account to join the conversation.

More
10 years 2 months ago #7581 by JHeinz
We do have Windows server. How would the ETL package and the web server be linked? Any documentation you could provide would be great.

Thanks!

Please Log in or Create an account to join the conversation.

More
10 years 2 months ago #7582 by admin
We have command line utility which can be used to execute packages

There are some examples in the documentation explain how to call it

With that you should be able to do something like this

forums.asp.net/t/1193439.aspx/1

Mike

Mike
ETL Architect

Please Log in or Create an account to join the conversation.