Auto-populate the rows with data from the preceding line

More
12 years 2 months ago #3088 by Vincent
Mike,

if the data that is being loaded via the reader (a text file for example) has a carriage return incorrectly inserted into the middle of a data line ….the tool attempts to auto-populate the rows with data from the preceding line. Or if the extract that is being read has fewer columns than what is expected, it attempts to auto-populate those “missing” columns as well. Is this intentional and, if it is, is there a way to turn it off? I looked through the settings but didn’t see any options related to this.

Thanks,
Vincent

Please Log in or Create an account to join the conversation.

More
12 years 2 months ago #3089 by admin
Vincent

I am trying to reproduce the problem

So I created two files one with 4 columns another with 3

File with 4 columns loaded first

when second file is loaded forth field in the database is populated with nulls

Which is as it should be I believe?

Perhaps you can create for us a simple example using files on drive c:?

Mike

Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
12 years 2 months ago #3090 by Vincent
Mike,

Here is an example of the issue I was describing. The extracts that I am trying to validate have an EOL column that contains just the value ‘X’. There is a validation done on that column to verify the value of ‘X’ in that last column. If the value did not equal x then reject the record.

If you look at the example extract you will see that there were a couple of carriage returns inserted into the data. Often when I receive data, the client that sends me data accidentally inserts carriage returns into the data. I was hoping that the EOL validation would capture this. Browsing this data though shows that, instead of blank fields where the CR were inserted, it appears that the data is populating based on what was in the prior rows.

Does this make sense? If you need more information from me, please let me know.

Thanks,
Vincent

Please Log in or Create an account to join the conversation.

More
12 years 2 months ago #3091 by admin
OK

Thank you for the file we will check it and get back to you

Mike

Mike
ETL Architect

Please Log in or Create an account to join the conversation.