Read/transform/Import master/detail tables data from one server to the other

More
3 years 11 months ago #21928 by erosolmi
Dear support,

I'm still not a customer but I'm very interested in Advanced ETL Processor.
Reading documentation I didn't find any help about transferring master/details data from one source DB to a destination DB making some transformations and keeping link between master and details.

Example:
transferring sales orders from one external source (in my case MS SQL Server) into an internal destination (in our case again MS SQL server) making some transformation.
Every sale order have a record in table SaleOrders.
Every sale order has 1 or may records in table SaleOrder_Details (up to 1200 lines in some cases).
We need to get one single sale order, then all its lines (plus few other slave data some are 1 to 1 some other 1 to many related)
Make some transformations and check both in master and details data
Keep track if any error occur into a single master/details ... and mark master as error status in source table.
If OK, mark source sale order as transferred and go on
Process other master/details (if any) without stopping till the next run

We have many of such master/details situations for sales order, delivery notes, invoices, good entering into warehouse, ...

Do you have some indication on how to do it?
Or some example even simple just to have a look?

Thanks a lot
Eros Olmi

Please Log in or Create an account to join the conversation.

More
3 years 11 months ago #21929 by admin
Thank you for the question.

So basically you have two tables and you want to copy them from one database to another and do some transformations and validations

Five minutes job to be honest.

If you do not have a lot of data the easiest option is to copy all data in one go
If you have a lot of data and the order number is sectional you can calculate "select max(orderno) from target" and process new orders only
Transferring orders one can be also done but it would be very slow

Please start by watching our online videos
www.etl-tools.com/advanced-etl-processor...-mysql-database.html

If you want us to help you with complex transformation provide us with more information
Here is an example
www.etl-tools.com/forum/advanced-etl-pro...readers.html?start=0

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

Cookies user preferences
We use cookies to ensure you to get the best experience on our website. If you decline the use of cookies, this website may not function as expected.
Accept all
Decline all
Read more
Marketing
Set of techniques which have for object the commercial strategy and in particular the market study.
Google
Accept
Decline
Analytics
Tools used to analyze the data to measure the effectiveness of a website and to understand how it works.
Google Analytics
Accept
Decline
Google Analytics
Accept
Decline
Functional
Tools used to give you more features when navigating on the website, this can include social sharing.
Advertisement
If you accept, the ads on the page will be adapted to your preferences.
Google Ad
Accept
Decline
Save