NIFI-15057 - Add Record Path like helper methods for Record Transform Python processors #10391
+296
−1
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
NIFI-15057 - Add Record Path like helper methods for Record Transform Python processors
As a follow-up of NIFI-13672, I wanted to put together a processor that transforms records using a reader and writer and realised that we don't have an easy way to go through the dict representing the NiFi Record... So I'm adding helper methods that are a lightweight implementation of NiFi Record Path in order to make it easier to manipulate records using Python processors.
I didn't directly use the NiFi Record Path dependency as this would require a lot of back and forth between Java and Python in terms of mapping between the Java objects for using NiFi Record Path and we have on the Python side.
While not offering as rich features as the NiFi Record Path implementation, this provides a good start for basic scanning of the records which should cover most of the use cases.
Tracking
Please complete the following tracking steps prior to pull request creation.
Issue Tracking
Pull Request Tracking
NIFI-00000
NIFI-00000
Pull Request Formatting
main
branchVerification
Please indicate the verification steps performed prior to pull request creation.
Build
./mvnw clean install -P contrib-check
Licensing
LICENSE
andNOTICE
filesDocumentation