File Loop - CSV parsing bug

More
5 months 3 weeks ago - 5 months 2 weeks ago #25942 by prashant
I am using File LOOP which is  configured for double quotes as Qualifier and comma as delimiter


The file is slightly complex but is read properly in other CSV editor including excel 
 

File Attachment:

File Name: abc.csv.zip
File Size:1 KB


When I try to display a field from inside say #field_mapping# ,
1. I get only a part of string back  - {''s3_url'': ''7"
2. While I should get the entire message - {"s3_url": "7", "record_id": "8", "doc_type": "12"}
Same issue if I try to show case #item_data#
1. I get "record_id": "8" (which is from earlier string #field_mapping#
2. While I should get {"doc_type": "main"}

I have attached the CSV file for your reference , I am unable to attach any jpg here for some reason
 

File Attachment:

File Name: abc_2026-02-02.txt
File Size:2 KB
Last edit: 5 months 2 weeks ago by prashant.
The following user(s) said Thank You: Peter.Jonson

Please Log in or Create an account to join the conversation.

More
5 months 3 weeks ago #25948 by Peter.Jonson
Looking at it now

Peter Jonson
ETL Developer

Please Log in or Create an account to join the conversation.

More
5 months 3 weeks ago #25953 by prashant
may I request for another two variable in file loop package ? 

1. All headers , this contains a list of all headers , so we can verify what columns it's reading
2. Within a loop is it possible to have entire row data inside a variable , so we know whatever is being read.

 
The following user(s) said Thank You: Peter.Jonson

Please Log in or Create an account to join the conversation.

More
5 months 3 weeks ago #25955 by Peter.Jonson
We will have a look at it as well

Peter Jonson
ETL Developer

Please Log in or Create an account to join the conversation.

More
5 months 2 weeks ago #25971 by Peter.Jonson
Can you trey latest version please.

The variables are yet to be added

Peter Jonson
ETL Developer
The following user(s) said Thank You: prashant

Please Log in or Create an account to join the conversation.

More
5 months 2 weeks ago #25972 by prashant

Can you trey latest version please.
 
It's not working.  When I try to loads this CSV file below , I get a weird output of 5687:7 instead of "doc_type": "srf"

record_id    source_tableid    dest_tableid    field_id    url    delete_url    filename    save_path    s3_bucket    s3_region    s3_endpoint    s3_object_name    s3_url    save_path_t    s3_object_name_t    s3_url_t    field_mapping    item_data
5687    btb5pz7ke    bvi68jxxy    335    <URL_1>    <URL_2>    Innovation_Icon_Tracker.jpg    C:\invoice\asp\329b05f8-12a0-4a9e-8f64-e82562c2f612.jpg    seafile    us-central-1    <ENDPOINT_1>    329b05f8-12a0-4a9e-8f64-e82562c2f612.jpg    <URL_3>    C:\invoice\asp\329b05f8-12a0-4a9e-8f64-e82562c2f612_t.jpg    329b05f8-12a0-4a9e-8f64-e82562c2f612_t.jpg    <URL_4>    {"s3_url": "7", "record_id": "8", "doc_type": "12"}    {"doc_type": "srf"}
 

Please Log in or Create an account to join the conversation.

Cookies user preferences
We use cookies to ensure you to get the best experience on our website. If you decline the use of cookies, this website may not function as expected.
Accept all
Decline all
Read more
Marketing
Set of techniques which have for object the commercial strategy and in particular the market study.
Google
Accept
Decline
Analytics
Tools used to analyze the data to measure the effectiveness of a website and to understand how it works.
Google Analytics
Accept
Decline
Google Analytics
Accept
Decline
Functional
Tools used to give you more features when navigating on the website, this can include social sharing.
Advertisement
If you accept, the ads on the page will be adapted to your preferences.
Google Ad
Accept
Decline
Save