- Posts: 17
- Thank you received: 1
Advanced ETL processor freezes when Oracle query takes long.
- eschnadower
- Topic Author
- Offline
- New Member
-
Less
More
8 years 2 months ago #13290
by eschnadower
Hello, I am evaluating Advanced ETL Processor and for my company to decide to buy it we need this to be fixed.
The issue here is that I am connecting to an Oracle database and some queries take a long time (up to 2 hours)
And when I add a reader object inside a transformation that accesses those kind of queries, the program freezes for apparently the time it takes the query to run.
Once the reader object is there, the program freezes whenever I open the transformation, run the package or open the reader object.
That is a dealbreaker here as it could take forever for me to develop my processes, and I have liked the software so far.
Is there anything wrong I am doing? Is there any setup to avoid this?
I am attaching a word document with further information.
The issue here is that I am connecting to an Oracle database and some queries take a long time (up to 2 hours)
And when I add a reader object inside a transformation that accesses those kind of queries, the program freezes for apparently the time it takes the query to run.
Once the reader object is there, the program freezes whenever I open the transformation, run the package or open the reader object.
That is a dealbreaker here as it could take forever for me to develop my processes, and I have liked the software so far.
Is there anything wrong I am doing? Is there any setup to avoid this?
I am attaching a word document with further information.
Please Log in or Create an account to join the conversation.
8 years 2 months ago #13291
by admin
Mike
ETL Architect
Replied by admin on topic Advanced ETL processor freezes when Oracle query takes long.
You can use global variables to tweak the sql
For example this sql will return just one record
SELECT customerid
,orderno
,orderdate
,amount
FROM [DEMO].[dbo].[orders]
where ([orderno] = 1 or 'ALL'='ONE RECORD')
This one will return all records
SELECT customerid
,orderno
,orderdate
,amount
FROM [DEMO].[dbo].[orders]
where ([orderno] = 1 or 'ALL'='ALL')
SQL example with variable
SELECT customerid
,orderno
,orderdate
,amount
FROM [DEMO].[dbo].[orders]
where ([orderno] = 1 or 'ALL'='<variable>')
Please read those articles about variables:
www.etl-tools.com/wiki/tag:variables?do=showtag&tag=Variables
For example this sql will return just one record
SELECT customerid
,orderno
,orderdate
,amount
FROM [DEMO].[dbo].[orders]
where ([orderno] = 1 or 'ALL'='ONE RECORD')
This one will return all records
SELECT customerid
,orderno
,orderdate
,amount
FROM [DEMO].[dbo].[orders]
where ([orderno] = 1 or 'ALL'='ALL')
SQL example with variable
SELECT customerid
,orderno
,orderdate
,amount
FROM [DEMO].[dbo].[orders]
where ([orderno] = 1 or 'ALL'='<variable>')
Please read those articles about variables:
www.etl-tools.com/wiki/tag:variables?do=showtag&tag=Variables
Mike
ETL Architect
Please Log in or Create an account to join the conversation.