ETL tool

More
12 years 2 months ago #3264 by Emile
ETL tool was created by Emile
Hi

I am having a couple of issues with your ETL tool

The first is that Im struggling to get a transformation to work from within a package. The transformation works perfectly when run on it’s own but fails within the package. It is supposes to append every file in a folder into an oracle table. As mentioned above, run on it’s own it does this, however when I call it in a package it only looks at the first file it comes across then stops.

My second issue is to do with file operations. I cannot seem to get the tool to rename, move or copy .txt files all these functions work perfectly for xls files but just fail if I try to do anything with a txt

Hope you can help

Many thanks

Emile

Please Log in or Create an account to join the conversation.

More
12 years 2 months ago #3265 by admin
Replied by admin on topic Re: ETL tool
1 Using latest version

Here is the log for package "Import from multiple files" (example provided by us)

Information 16/07/2011 18:18:19 Starting Transformation...
Information 16/07/2011 18:18:19 Preparing Writers...
Information 16/07/2011 18:18:19 Writer: {Orders Table}, Writer { Orders Table } Is Ready
Information 16/07/2011 18:18:19 All Writers are Ready
Information 16/07/2011 18:18:19 Processing Data...
Information 16/07/2011 18:18:19 Reader:{List of Customer's orders} Path: C:\Program Files\DB Software Laboratory\Demo\Buffer\
Information 16/07/2011 18:18:19 Reader:{List of Customer's orders} Mask: Ord*.csv
Information 16/07/2011 18:18:19 Reader:{List of Customer's orders} Found: 4 File(s) to read
Information 16/07/2011 18:18:19 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Ord1.csv
Information 16/07/2011 18:18:20 Reader:{List of Customer's orders} Read 924 Line(s)
Information 16/07/2011 18:18:20 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Ord2.csv
Information 16/07/2011 18:18:21 Reader:{List of Customer's orders} Read 924 Line(s)
Information 16/07/2011 18:18:21 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Ord3.csv
Information 16/07/2011 18:18:24 Reader:{List of Customer's orders} Read 3152 Line(s)
Information 16/07/2011 18:18:24 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Orders.csv
Information 16/07/2011 18:18:31 Reader:{List of Customer's orders} Read 5000 Line(s)
Information 16/07/2011 18:18:31 Reader:{List of Customer's orders} Processed : 10000 Record(s)
Information 16/07/2011 18:18:31 Reader:{List of Customer's orders} Records per second : 1506.47
Information 16/07/2011 18:18:31 Reader:{List of Customer's orders} Rejected : 0 Record(s)
Information 16/07/2011 18:18:31 Reader:{List of Customer's orders} Time Taken : 00:00:06
Information 16/07/2011 18:18:31 Writer: {Orders Table},
Inserted : 10000 Record(s)
Information 16/07/2011 18:18:31 Writer: {Orders Table},
Updated : 0 Record(s)
Information 16/07/2011 18:18:31 Writer: {Orders Table},
Deleted : 0 Record(s)
Information 16/07/2011 18:18:31 Writer: {Orders Table},
Errors : 0
Information 16/07/2011 18:18:31 Transformation Completed

Is there any errors in your log?

2 Can you try removing double quotes around file names

Mike

Mike
ETL Architect

Please Log in or Create an account to join the conversation.