Python Calculation SyntaxError: "unterminated string literal" when using [F001]

Hi,
I am trying to use a Python script in the "Calculation" transformation to remove duplicates from a column.
The Issue: When I hardcode the data into the script for testing, it works perfectly. However, when I replace the hardcoded data with the input variable [F001],
I get the following error: 
my script
When I manually type the string (e.g., raw_value = 32607,32607), it works fine.
When I use [F001], it fails immediately.
In the "Data Preview" or execution log, the result for this column comes back as NULL because the script is failing.
It seems like the data inside [F001] might contain characters (like newlines) that are breaking the Python string syntax during the substitution.
Could you advise on the correct way to handle [F001] variables in Python that might contain special characters or newlines?

 

 
 

Hi Onkar

1  When I use [F001], it fails immediately.

Parameters tab has a Test Value which you can use for testing and development





2 It seems like the data inside [F001] might contain characters (like newlines) that are breaking the Python string syntax during the substitution.

When [F001] is equal tp 1,2,3 the actual code executed is
raw_value  = str('1,2,3')

if [F001] has special characters the code will fail
This is expected python behavior, so what you need to do is to escape [F001] value
This can be done by using the following transformation
www.etl-tools.com/wiki/advanced-etl-proc...rings/escape-string/

Please keep us posted on your progress




 

Taking Mike's hunch , I asked Chatgpt & it gave me a single line to remove the delimiter,

raw_value = raw_value.replace('\r', '').replace('\n', '')

I tried a simple test and it worked at my end & it worked fine.