ETL Enterprise 5.7.6.13 Invalid pointer opperation

More
9 years 10 months ago #9006 by mwarne
We upgraded from ETL pro to ETL Enterprise and have encounter some issues

the ETL repository resides in SQL server and as such was easily connected with the new install of ETL Ent. however some processes have failed to execute or are showing failure in the execution log

one such example error message below.

Error 11/25/2013 10:05:18 AM Change of H Queue Status failed
Error 11/25/2013 10:05:18 AM Invalid pointer operation

the refered to records in the ETL db are as follows.
QUEUE_ACTIONS_ID QUEUE_ID PARENT_ID ACTION_NAME ACTION_TYPE LINE_NO STARTED FINISHED STATUS ERRORS OBJECT_ID OBJECT_DATA LOG_DATA BAD_RECORDS_DATA LOG_FILE BAD_RECORDS_FILE
160867 23592 -1 Aston Hotels - Executive - Run All 3 1 2013-11-25 10:05:15.000 NULL R NULL NULL NULL NULL NULL NULL NULL
160868 23592 160867 Aston Hotels - Executive - guest 3 2 2013-11-25 10:05:15.000 2013-11-25 10:05:18.000 C 0 NULL NULL NULL NULL NULL NULL
160869 23592 160868 Check guest mail 10 3 2013-11-25 10:05:15.000 2013-11-25 10:05:17.000 C 0 NULL NULL NULL NULL F:\BatchProcess\ETLLogFiles\pop3_160869.log F:\BatchProcess\ETLLogFiles\pop3_160869.log
160870 23592 160868 check file 5 4 2013-11-25 10:05:17.000 2013-11-25 10:05:17.000 C 0 NULL NULL NULL NULL NULL NULL
160871 23592 160868 merge file into new 6 5 2013-11-25 10:05:17.000 2013-11-25 10:05:17.000 C 0 NULL NULL NULL NULL NULL NULL
160872 23592 160868 EXC_guests 0 6 2013-11-25 10:05:17.000 2013-11-25 10:05:18.000 C 0 NULL NULL NULL NULL F:\BatchProcess\ETLLogFiles\Tr_160872.log F:\BatchProcess\ETLLogFiles\Tr_160872.log
160873 23592 160868 move file 6 7 2013-11-25 10:05:18.000 2013-11-25 10:05:18.000 C 0 NULL NULL NULL NULL NULL NULL
160874 23592 160868 Del original file 6 8 2013-11-25 10:05:18.000 2013-11-25 10:05:18.000 C 0 NULL NULL NULL NULL NULL NULL
160875 23592 160867 Aston Hotels - Executive - transactions 3 9 2013-11-25 10:05:18.000 NULL R NULL NULL NULL NULL NULL NULL NULL
160876 23592 160875 check mail for transactions 10 10 2013-11-25 10:05:18.000 2013-11-25 10:05:18.000 C 0 NULL NULL NULL NULL F:\BatchProcess\ETLLogFiles\pop3_160876.log F:\BatchProcess\ETLLogFiles\pop3_160876.log
160877 23592 160875 check for file 5 11 2013-11-25 10:05:18.000 2013-11-25 10:05:18.000 C 0 NULL NULL NULL NULL NULL NULL
160878 23592 160875 merge file 6 12 2013-11-25 10:05:18.000 2013-11-25 10:05:18.000 C 0 NULL NULL NULL NULL NULL NULL
160879 23592 160875 EXC_transactions 0 13 2013-11-25 10:05:18.000 2013-11-25 10:05:18.000 C 0 NULL NULL NULL NULL F:\BatchProcess\ETLLogFiles\Tr_160879.log F:\BatchProcess\ETLLogFiles\Tr_160879.log
160880 23592 160875 move file 6 14 2013-11-25 10:05:18.000 2013-11-25 10:05:18.000 C 0 NULL NULL NULL NULL NULL NULL
160881 23592 160875 delete original file 6 15 2013-11-25 10:05:18.000 2013-11-25 10:05:18.000 C 0 NULL NULL NULL NULL NULL NULL



I believe the ETL ran as requested however the ETL application was unable to update the status in the log file after completion. as evident in the entire log txt file as seen below. is there anything that can be done to ensure this does not re-occur?


Information 11/25/2013 10:05:14 AM Preparing to execute: Aston Hotels - Executive - Run All
Information 11/25/2013 10:05:14 AM Started
Information 11/25/2013 10:05:14 AM Executing Package: Aston Hotels - Executive - guest
Information 11/25/2013 10:05:14 AM Retrieving Email: Check guest mail
Information 11/25/2013 10:05:17 AM There are : 1 Message(s) on the server
Information 11/25/2013 10:05:17 AM Message N: 1
Information 11/25/2013 10:05:17 AM Received Email from: res.exc@astonreservations.com
Information 11/25/2013 10:05:17 AM Subject: OR_Guests - or_guests
Information 11/25/2013 10:05:17 AM Date Sent: 25 Nov 2013 09:10:20
Information 11/25/2013 10:05:17 AM Message Body:
Information 11/25/2013 10:05:17 AM Requested report enclosed. Please see attachment.


The information contained in this e-mail message is
intended only for the personal and confidential use of the
recipient(s) named above. If you are not the intended
recipient, you are hereby notified that you have received
this document in error and that any review, dissemination,
distribution or copying of this message is strictly
prohibited. If you have received this communication in
error, please notify us immediately by e-mail and delete
the original message. Thank you.

Information 11/25/2013 10:05:17 AM Attachment: osr_landscape8122271.txt
Information 11/25/2013 10:05:17 AM Saved to: F:\ftpRoot\AstonHotels\ExecCentre\Guests\osr_landscape8122271.txt
Information 11/25/2013 10:05:17 AM Done!
Information 11/25/2013 10:05:17 AM Checking File(s): check file
Information 11/25/2013 10:05:17 AM File(s) : F:\ftpRoot\AstonHotels\ExecCentre\Guests\*.txt
Information 11/25/2013 10:05:17 AM File(s) exists: F:\ftpRoot\AstonHotels\ExecCentre\Guests\*.txt
Information 11/25/2013 10:05:17 AM Executing File Operation: merge file into new
Information 11/25/2013 10:05:17 AM Found: 1 File(s)
Information 11/25/2013 10:05:17 AM Path: F:\ftpRoot\AstonHotels\ExecCentre\Guests\
Information 11/25/2013 10:05:17 AM Mask: *.txt
Information 11/25/2013 10:05:17 AM Target File is: F:\ftpRoot\AstonHotels\ExecCentre\Guests\guest20131125100517.txt
Information 11/25/2013 10:05:17 AM File is Merged: F:\ftpRoot\AstonHotels\ExecCentre\Guests\osr_landscape8122271.txt
Information 11/25/2013 10:05:17 AM Executing Transformation: EXC_guests
Information 11/25/2013 10:05:17 AM Source File(s): F:\ftpRoot\AstonHotels\ExecCentre\Guests\
Information 11/25/2013 10:05:17 AM Processed: 66 Records
Information 11/25/2013 10:05:17 AM Errors: 0
Information 11/25/2013 10:05:17 AM Rejected: 0
Information 11/25/2013 10:05:17 AM Records per second: 4399.98
Information 11/25/2013 10:05:17 AM Execution of Transformation: EXC_guests has completed
Information 11/25/2013 10:05:17 AM Executing File Operation: move file
Information 11/25/2013 10:05:17 AM Found: 1 File(s)
Information 11/25/2013 10:05:17 AM Path: F:\ftpRoot\AstonHotels\ExecCentre\Guests\
Information 11/25/2013 10:05:17 AM Mask: guest*.txt
Information 11/25/2013 10:05:17 AM Moved file : F:\ftpRoot\AstonHotels\ExecCentre\Guests\guest20131125100517.txt into F:\ftpRoot\AstonHotels\ExecCentre\Guests\done
Information 11/25/2013 10:05:17 AM Executing File Operation: Del original file
Information 11/25/2013 10:05:17 AM Found: 1 File(s)
Information 11/25/2013 10:05:17 AM Path: F:\ftpRoot\AstonHotels\ExecCentre\Guests\
Information 11/25/2013 10:05:17 AM Mask: osr*.txt
Information 11/25/2013 10:05:17 AM File is deleted: F:\ftpRoot\AstonHotels\ExecCentre\Guests\osr_landscape8122271.txt
Information 11/25/2013 10:05:17 AM Executing Package: Aston Hotels - Executive - transactions
Information 11/25/2013 10:05:17 AM Retrieving Email: check mail for transactions
Information 11/25/2013 10:05:17 AM There are : 1 Message(s) on the server
Information 11/25/2013 10:05:17 AM Message N: 1
Information 11/25/2013 10:05:17 AM Received Email from: res.exc@astonreservations.com
Information 11/25/2013 10:05:17 AM Subject: OR_Transactions - or_transactions
Information 11/25/2013 10:05:17 AM Date Sent: 25 Nov 2013 09:15:25
Information 11/25/2013 10:05:17 AM Message Body:
Information 11/25/2013 10:05:17 AM Requested report enclosed. Please see attachment.


The information contained in this e-mail message is
intended only for the personal and confidential use of the
recipient(s) named above. If you are not the intended
recipient, you are hereby notified that you have received
this document in error and that any review, dissemination,
distribution or copying of this message is strictly
prohibited. If you have received this communication in
error, please notify us immediately by e-mail and delete
the original message. Thank you.

Information 11/25/2013 10:05:17 AM Attachment: osr_landscape8122559.txt
Information 11/25/2013 10:05:17 AM Saved to: F:\ftpRoot\AstonHotels\ExecCentre\Transactions\osr_landscape8122559.txt
Information 11/25/2013 10:05:17 AM Done!
Information 11/25/2013 10:05:17 AM Checking File(s): check for file
Information 11/25/2013 10:05:17 AM File(s) : F:\ftpRoot\AstonHotels\ExecCentre\Transactions\*.txt
Information 11/25/2013 10:05:17 AM File(s) exists: F:\ftpRoot\AstonHotels\ExecCentre\Transactions\*.txt
Information 11/25/2013 10:05:17 AM Executing File Operation: merge file
Information 11/25/2013 10:05:17 AM Found: 1 File(s)
Information 11/25/2013 10:05:17 AM Path: F:\ftpRoot\AstonHotels\ExecCentre\Transactions\
Information 11/25/2013 10:05:17 AM Mask: *.txt
Information 11/25/2013 10:05:17 AM Target File is: F:\ftpRoot\AstonHotels\ExecCentre\Transactions\tran20131125100517.txt
Information 11/25/2013 10:05:17 AM File is Merged: F:\ftpRoot\AstonHotels\ExecCentre\Transactions\osr_landscape8122559.txt
Information 11/25/2013 10:05:17 AM Executing Transformation: EXC_transactions
Information 11/25/2013 10:05:17 AM Source File(s): F:\ftpRoot\AstonHotels\ExecCentre\Transactions\tran20130811110517.txt
Information 11/25/2013 10:05:17 AM Processed: 43 Records
Information 11/25/2013 10:05:17 AM Errors: 0
Information 11/25/2013 10:05:17 AM Rejected: 0
Information 11/25/2013 10:05:17 AM Records per second: 1
Information 11/25/2013 10:05:17 AM Execution of Transformation: EXC_transactions has completed
Information 11/25/2013 10:05:17 AM Executing File Operation: move file
Information 11/25/2013 10:05:17 AM Found: 1 File(s)
Information 11/25/2013 10:05:17 AM Path: F:\ftpRoot\AstonHotels\ExecCentre\Transactions\
Information 11/25/2013 10:05:17 AM Mask: tran*.txt
Information 11/25/2013 10:05:18 AM Moved file : F:\ftpRoot\AstonHotels\ExecCentre\Transactions\tran20131125100517.txt into F:\ftpRoot\AstonHotels\ExecCentre\Transactions\done
Information 11/25/2013 10:05:18 AM Executing File Operation: delete original file
Information 11/25/2013 10:05:18 AM Found: 1 File(s)
Information 11/25/2013 10:05:18 AM Path: F:\ftpRoot\AstonHotels\ExecCentre\Transactions\
Information 11/25/2013 10:05:18 AM Mask: osr*.txt
Information 11/25/2013 10:05:18 AM File is deleted: F:\ftpRoot\AstonHotels\ExecCentre\Transactions\osr_landscape8122559.txt
Error 11/25/2013 10:05:18 AM Change of H Queue Status failed
Error 11/25/2013 10:05:18 AM Invalid pointer operation




thanks

mike

Please Log in or Create an account to join the conversation.

More
9 years 10 months ago #9007 by admin
Can you try clearing the log

delete from QUEUE_ACTIONS
delete from QUEUE

Mike

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
9 years 10 months ago #9008 by mwarne
Mike:

we use the log files for online reporting and as such, cleaning the records from the db is not truly an option.


the log is located in sql server and should not be effected as such.


another instance occured in this entry.

Error 11/25/2013 10:27:30 AM Access violation at address 00408EFE in module 'aetlcl.exe'. Write of address 0092B388
Error 11/25/2013 10:27:30 AM Execution of Transformation has failed
Error 11/25/2013 10:27:30 AM Change of H Queue Status failed
Error 11/25/2013 10:27:30 AM Access violation at address 004070D0 in module 'aetlcl.exe'. Read of address FFFFFFFC


thanks

mike

Please Log in or Create an account to join the conversation.

More
9 years 10 months ago #9010 by admin
We had similar issues and it was because of PK violations.

The easiest way to address it to clear the log

Another way is to increase ID VAlue

update [ID_GENERATOR]
set ID=(select max(QUEUE_ID)+1 as id from QUEUE)
where ID_TYPE=2

Mike

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
9 years 10 months ago #9011 by mwarne
mike:

this is the data from the ID_Generator table. it looks to be corrupted or something, as wouldn't all the items have a generator_name?

please confirm:

ID_TYPE GENERATOR_NAME ID
1 NULL 5477
2 NULL 23639
3 NULL 161184
4 NULL 35
5 NULL 4
6 AGENT_STATUS 1007
7 USER 1007
8 GROUP 1007
9 MENUS_1 1007
10 SQL_EXECUTION_HISTORY 1007
11 MENUS_2 1007

Please Log in or Create an account to join the conversation.

More
9 years 10 months ago #9012 by admin
These names are not being used anywhere so it is not that important





Mike

Mike
ETL Architect
Attachments:

Please Log in or Create an account to join the conversation.