Easily Listing all Script Objects in a Project : PCI and Code Review / Source Code

More
7 years 11 months ago #13916 by daniel.fung@xerox.com
Part of our PCI requirements, require us to "review" all custom codes written in ETL, this includes all code written in the Script Component as well as any SQL scripts

the process of gathering all snippets of code written in many many SCRIPT components, saving them with the original Script or SQL script component name is really tedious. And this is not a one time activity, every time a Script/SQL Script is changed, the script must undergo a new review before the entire project can be approved for production release.

is there an easy way to list out the Script and SQL Script components any of the following
1. a query at least 2 columns , the script name and the script content
2. a set of text files, 1 for each script object, containing the contents of the script.

is there any way to easily decode the OBJECT_DATA<N> columns in the OBJECTS table in the REPO>

the added complication of the review is that the script code/sql script code must be compared with the previous version. I dont envision doing this repeatedly in ETL but instead in our source code control system that we current use to manage our SDLC.

Please Log in or Create an account to join the conversation.

More
7 years 11 months ago #13917 by Peter.Jonson
By Script, do you mean Script Action within the package?

Peter Jonson
ETL Developer

Please Log in or Create an account to join the conversation.

More
7 years 11 months ago - 7 years 11 months ago #13918 by daniel.fung@xerox.com
Yes, generally speaking any kind of script

including the following
Script Action in a package
Script Written in a Calculation
SQL Script - even if they are as simple as exec stored-procedure call



Attachments:
Last edit: 7 years 11 months ago by daniel.fung@xerox.com.

Please Log in or Create an account to join the conversation.

More
7 years 11 months ago #13924 by Peter.Jonson
Daniel

Extracting SQL Script is easy task.
However Script Object source is much more complex task and it will take a lot of effort.

Peter Jonson
ETL Developer

Please Log in or Create an account to join the conversation.

More
7 years 11 months ago #13926 by daniel.fung@xerox.com
Ok, a compromise, give me a way to save all of the following objects in 1 step out to a folder eg.

for the current project, save the following types of objects/items out to text files named after the description and path of the objects

1. transformations,
2. sql scripts,
3. packages
4, lookups

so a transformation named AA in a node called BB will be named [BB] AA.TXT

I will then myself extract out the script contents/blocks and manage the version control for the PCI review process.

Please Log in or Create an account to join the conversation.

More
7 years 11 months ago #13930 by admin
Daniel

Thank you for your suggestion, that should not take a lot of time to implement

Mike
ETL Architect

Please Log in or Create an account to join the conversation.