Export Data

  • 36 Exporting All Database Tables

    Exporting All Database Tables

    Following formats are supported: Delimited Text, XML, Insert Script, QlikView QVX Files, QlikView QVD Files, Excel.

    All our ETL tools have no limitations, that means you can load your data today and solve all the data quality problems right now.

    Our WIKI has more detailed information if you are stuck post your question on our support forum and we will do our best to assist you

  • Exporting all tables into text files

    This article describes how you can export all tables from any database into text files

     The first step is to download and install Advanced ETL Processor Professional

    Then we need to create an ETL  package. Let call it Export Package.

    Export Package
     Double click on Export Data Object and select the appropriate connection type
    Mass Export into csv files
     Next step is to specify tables to export. It also possible to use the mask as a filter
    Mass Export into csv files
     If necessary, the user can restrict the number of records tables to export
    Mass Export into csv files
     And the last step is to select the output file format. The user can export all data into one file or into separate files.
    Mass Export into csv files

    Let's run the Package

    Information 12/08/2018 19:15:57 Preparing to execute: Export Package
    Information 12/08/2018 19:15:57 Started
    Information 12/08/2018 19:15:57 Executing:Export Package
    Information 12/08/2018 19:15:57 Executing Export: Export Data
    Information 12/08/2018 19:15:57 Executing:Export Data
    Information 12/08/2018 19:15:57 Connection Name: SQL
    Information 12/08/2018 19:15:57 Connection Type is: MS Sql Server
    Information 12/08/2018 19:15:57 Source MS Sql Server: DBSLCOMPUTER\SQLEXPRESS2014
    Information 12/08/2018 19:15:57 Connection Name: SQL
    Information 12/08/2018 19:15:57 Connection Type is: MS Sql Server
    Information 12/08/2018 19:15:57 Source MS Sql Server: DBSLCOMPUTER\SQLEXPRESS2014
    Information 12/08/2018 19:15:57 Connection Type is: MS Sql Server
    Information 12/08/2018 19:15:57 Reading all specified Table(s)
    Information 12/08/2018 19:15:57 Source Table: [AOB].[dbo].[ExtentionCountHistory]
    Information 12/08/2018 19:15:57 Using Bulk Fetch
    Information 12/08/2018 19:15:57 Path: C:\tmp\Export\
    Information 12/08/2018 19:15:57 Mask: AOB.dbo.ExtentionCountHistory.csv
    Information 12/08/2018 19:15:57 Path Is Valid: True
    Information 12/08/2018 19:15:57 Include Directory: False
    Information 12/08/2018 19:15:57 In Sub Folders: False
    Information 12/08/2018 19:15:57 Attributes: ReadOnly
    Information 12/08/2018 19:15:57 Attribute: Hidden
    Information 12/08/2018 19:15:57 Attribute: SysFile
    Information 12/08/2018 19:15:57 Attribute: aArchive
    Information 12/08/2018 19:15:57 File Age: 0
    Information 12/08/2018 19:15:57 Which File: 0
    Information 12/08/2018 19:15:57 Export File : C:\tmp\Export\AOB.dbo.ExtentionCountHistory.csv
    Information 12/08/2018 19:16:44 Read: 7,019,847 Records/Lines/Messages (in total)
    Information 12/08/2018 19:16:44 Records/Lines/Messages per second: 147,964
    Information 12/08/2018 19:16:44 Time Taken: 00:00:47
    Information 12/08/2018 19:16:44 Done!
    Information 12/08/2018 19:16:44 Finished
    Direct link, no registration required.
  • Generating Insert Statements

    This article explains how to generate INSERT statements from any data source

    This solution is not database specific

    Most databases can generate DDL for any object but not a lot of them allow generation of INSERT statements for the table data.
    The workaround is to use ETL Tools for transferring data across servers. However, there exists a need to generate INSERT statements from the tables for porting data.
    The simplest example is when a small or large amount of data needs to be taken out on a removable storage media and copied to a remote location, INSERT VALUES statements come in handy.

    There is a number of scripts available to perform this data transformation task. The problem with those scripts that all of them are database specific and they do not work with textiles

    Advanced ETL Processor gives you a universal solution for creating Insert statements. It works with any database or file.

    Benefits and advantages
    • Data from both tables and views can be scripted
    • Support for text files
    • Table names and column names with spaces are handled
    • All data types are handled
    • NULLs are gracefully handled
    • Timestamp columns are handled
    • Identity columns are handled
    • Very flexible and configurable
    • Computed columns are handled
    • You can filter the rows/lines for which you want to generate INSERT's

    Advanced ETL Processor generating insert statements

    Generating Insert Statements

     

    We were very impressed when we bought this ETL tool. But now, we are even more impressed, because the company constantly adding new useful ETL features.
    You guys have got imagination and vision of how things work in real life.


    Tim Jonson,
    Project Manager 
    Direct link, no registration required.
  • Transform SQLite data faster

    We are constantly working on optimizing the performance of our ETL software. The typical ETL process is very similar to a river. Narrow parts prevent water from flowing freely. But if there is no water widening narrows parts will not help. The data flow starts with the data reader. So it is important to make it very fast. It is so important to measure performance correctly.  We always use the same table structure and the same file format for testing.  We did spend a lot of time optimizing SQLite data reader and manage to make two times faster

    Latest version Advanced ETL Processor extracts data from SQLite more than 2 times faster

    etl sqlite 

    Advanced ETL Processor Enterprise version 6.3.4.2 does 123,000 records per second and extracts 14mln records in 1 minute and 53 seconds

    transform sqlite data up to two times faster

    Advanced ETL Processor Enterprise version 6.3.4.6 does 364,000 records per second and extracts 14mln records in 38 seconds.

    Direct link, no registration required.

This site uses cookies. By continuing to browse the site, you are agreeing to our use of cookies