Data Warehousing and Data integration

Finding Fiscal Year

More
2 years 4 months ago - 2 years 4 months ago #23345 by prashant
Finding Fiscal Year was created by prashant
Context : In India , our fiscal year starts from April - March , so today 8th March 2024 is  FY 2023-24. Assuming I have 10 years worth of data

Questions
1. I tried using if date between ,which can give me answer for 1 year , by using literal , but if it fails how do I check for other years?See photo attached ?  
2. I create a date master csv file for next 50 years and do lookup ?
3. I create a calculation ?

Cheers, 
PM
Last edit: 2 years 4 months ago by prashant.

Please Log in or Create an account to join the conversation.

More
2 years 4 months ago #23346 by prashant
Replied by prashant on topic Finding Fiscal Year
I can confirm that the lookup method is not feasible. I have a 100 year calendar, around 4.4 MB in size which simply brings ETL to it's knees and hangs forever at the mapping window 

 

I am also unable to attach the culprit calendar file

 

Please Log in or Create an account to join the conversation.

More
2 years 4 months ago - 2 years 4 months ago #23350 by Peter.Jonson
Replied by Peter.Jonson on topic Finding Fiscal Year
Instead of creating lookup for every date you can create a lookup for month



Please see attached example

 

Peter Jonson
ETL Developer
Attachments:
Last edit: 2 years 4 months ago by Peter.Jonson.

Please Log in or Create an account to join the conversation.

More
2 years 4 months ago #23353 by prashant
Replied by prashant on topic Finding Fiscal Year
 
The following user(s) said Thank You: admin

Please Log in or Create an account to join the conversation.

More
2 years 4 months ago #23355 by admin
Replied by admin on topic Finding Fiscal Year
 Can you have a look at the date wise lookup file & confirm , why ETL hangs with the 100 Year Calendar 

How to read a line from the file

Open file file
Look for the "end of line delimiter"
Read data until end of line delimiter

What if "end of line delimiter" is not found?
Than the entire file is threated as a single line
If file is delimited, it is split into chunks that requires a of lot resources  = software hungs

Any software will hung  if incorrect  "end of line delimiter" is used


Mike
ETL Architect

Please Log in or Create an account to join the conversation.

More
2 years 4 months ago #23356 by prashant
Replied by prashant on topic Finding Fiscal Year

 Can you have a look at the date wise lookup file & confirm , why ETL hangs with the 100 Year Calendar 

What if "end of line delimiter" is not found?
Than the entire file is threated as a single line
If file is delimited, it is split into chunks that requires a of lot resources  = software hungs

Any software will hung  if incorrect  "end of line delimiter" is used

My BAD , all my file are made on OSX , and then slowly move to Windows. Need to remember in Future

But after selecting the right delimiter , ETL goes BOOOOOM

Please Log in or Create an account to join the conversation.

Cookies user preferences
We use cookies to ensure you to get the best experience on our website. If you decline the use of cookies, this website may not function as expected.
Accept all
Decline all
Read more
Marketing
Set of techniques which have for object the commercial strategy and in particular the market study.
Google
Accept
Decline
Analytics
Tools used to analyze the data to measure the effectiveness of a website and to understand how it works.
Google Analytics
Accept
Decline
Google Analytics
Accept
Decline
Functional
Tools used to give you more features when navigating on the website, this can include social sharing.
Advertisement
If you accept, the ads on the page will be adapted to your preferences.
Google Ad
Accept
Decline
Save