Avoiding common problems when working with ETL

Introduction.

First of all, we do have documentation and recommended settings are described in the documentation, plus we have online tutorials.

Getting help fast.

The most important thing is to follow the rules and provide all necessary information first time.

Bad support request example:

Hi,
We have just downloaded your software and we have an error message.
Please help it is urgent

Which software? Which Error?

Read more...

Editing resident tables in QlikView

Release of Q-Eye allows QlikView users view and even edit residential tables.

Here are some examples:

1. Viewing Data

SUB INSPECT (T)
 LET LocalAppDataPath = GetRegistryString('HKEY_LOCAL_MACHINE\Software\Microsoft\Windows\CurrentVersion', 'ProgramFilesDir');
 LET QViewerPath = '$(LocalAppDataPath)\DB Software Laboratory\Q-Eye\QEye.exe';
 STORE $(T) into [$(QvWorkPath)\~$(T).qvd] (qvd);
 EXECUTE "$(QViewerPath)" "$(QvWorkPath)\~$(T).qvd";
 EXECUTE cmd /c del "$(QvWorkPath)\~$(T).qvd";
ENDSUB

2. Editing Data

SUB EDIT (T)
 LET LocalAppDataPath = GetRegistryString('HKEY_LOCAL_MACHINE\Software\Microsoft\Windows\CurrentVersion', 'ProgramFilesDir');
 LET QViewerPath = '$(LocalAppDataPath)\DB Software Laboratory\Q-Eye\QEye.exe';
 STORE $(T) into [$(QvWorkPath)\~$(T).qvd] (qvd);
 EXECUTE "$(QViewerPath)" "$(QvWorkPath)\~$(T).qvd";
 DROP TABLE $(T);
 LOAD * FROM [$(QvWorkPath)\~$(T).qvd] (qvd);
 EXECUTE cmd /c del "$(QvWorkPath)\~$(T).qvd";
ENDSUB


If we want to edit the table we just

CALL EDIT('Log');

Or if we want to view the table we use this code

CALL INSPECT('Log');

Note: By default Q-Eye uses partial load, to avoid problems load entire QVD file before editing it 


This example is based on:
http://bi-review.blogspot.co.uk/2012/12/how-to-look-inside-resident-tables-at.html

ETL and XSLT

Here is More XML example

XML With Attributes

To load it all we need to do is to set data source type to XML and select appropriate XML tags for "Table Tag" and "Record Tag"

Data reader settings :
XML with Attributes Datareader

Note: "Ignore Tags" is checked

There is no data in the grid, because we have to transform XML into more readable format first, using XSLT.
XML With Attributes Data

About XSLT:

XSLT (Extensible Stylesheet Language Transformations) is a language for transforming XML documents into other XML documents, or other objects such as HTML for web pages, plain text or into XSL Formatting Objects which can then be converted to PDF, PostScript and PNG.

Typically, input documents are XML files, but anything from which the processor can build an XQuery and XPath Data Model can be used, for example relational database tables, or geographical information systems.

Source: Wikipedia

XSLT:

XSLT Transformation

Note: To get to this dialog: open data reader properties, click XML file, check transform XML and click Magnifying glass button

Here is the result of the XSLT transformation:
XSLT transformation Result

Note: 

More information about XSLT can be found here: 
http://www.w3schools.com/xsl/xsl_transformation.asp

Transforming XML Data

Here is Simple XML example

Simple XML Example

To load it all we need to do, is to set data source type to XML and select appropriate XML tags for "Table Tag" and "Record Tag"

Data reader settings :
Simple XML Data Reader Settings

Note: "Ignore Tags" is checked

Here is our data in the grid:
Simple XML Data

More complex XML example:

Read more...

More Articles...

"We used Advanced ETL Processor to give us more flexibility with business automation. And better yet, we always felt that the DBSL support team is a true partner in every sense of the word, assisting us when we needed help"

Carlos Tantis,
Marketing Manager

Our customers

BP

BBC

HSBC

Orange

CAT

SEPA
emc
NHS
Australian Rugby Union
Databases we work with