Great news Visual Importer ETL works now directly with PostgreSQL databases. The direct connection gives it a massive performance boost so you can load more than 10000 records per second.
Here is the Proof
Information 08/08/2009 13:43:14 Starting...
Information 08/08/2009 13:43:14 Target Table: test
Information 08/08/2009 13:43:14 Transformation Type: ADD Records
Information 08/08/2009 13:43:14 truncate table test
GO
Information 08/08/2009 13:43:14 Path: C:\Source Files\
Information 08/08/2009 13:43:14 Mask: test_data_delimited_large.csv
Information 08/08/2009 13:43:14 Found: 1 File(s) to read
Information 08/08/2009 13:43:14 Source File: C:\Source Files\test_data_delimited_large.csv
Information 08/08/2009 13:43:43 Read 352031 Line(s)
Information 08/08/2009 13:43:43 Processed : 352031 Record(s)
Information 08/08/2009 13:43:43 Records per second : 12321.7
Information 08/08/2009 13:43:43 Rejected : 0 Record(s)
Information 08/08/2009 13:43:43 Inserted : 352031 Record(s)
Information 08/08/2009 13:43:43 Updated : 0 Record(s)
Information 08/08/2009 13:43:43 Deleted : 0 Record(s)
Information 08/08/2009 13:43:43 Filtered : 0 Record(s)
Information 08/08/2009 13:43:43 Time Taken : 00:00:28
Information 08/08/2009 13:43:43 Transformation is finished
And here is what our customers think about it:
I just transferred
10,000,000 million records from the main SQL Anywhere database over the network into a
Postgres database without a hitch.
Thank you
Thank you
Thank you
George…
!!!!! You guys rock!!!!!!!!