data-prep-kit
Update KFP super pipeline for code
Update the KFP super-pipeline for code modules with the new code2parquet transform and license transforms.
@Bytes-Explorer , do you have a specific place where the license transformer should be put in the super pipeline?
It can go after malware. Can the super pipeline be automatically generated based on the order of transforms given as input? For eg, I may want to call the filter operation after every operation, if I have a lot of data.
there are two PRs with license-related transforms, and both are not merged. https://github.com/IBM/data-prep-kit/pull/332 https://github.com/IBM/data-prep-kit/pull/257
Both of these are separate transforms and both need to be added. Yes there is a dependency here. @Param-S @shivdeep-singh-ibm
