Skip to content

Conversation

@przemekwitek
Copy link
Contributor

@przemekwitek przemekwitek commented Dec 4, 2023

TransportUpdateTransformAction is a TransportTasksAction which means that it fans out to individual tasks running on the nodes.
In order to find the appropriate tasks the match method must be implemented properly. For the _update action request the match implementation was missing which caused the action to fan out to all the transform persistent tasks causing unexpected changes in live (held in memory) transform settings.
This PR implements the match method so that the problem is fixed.

Closes #102933

@elasticsearchmachine elasticsearchmachine added the Team:ML Meta label for the ML team label Dec 4, 2023
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

@elasticsearchmachine
Copy link
Collaborator

Hi @przemekwitek, I've created a changelog YAML for you.

@droberts195
Copy link

As this is a very nasty bug I think the fix should be backported to the 8.11 and 7.17 branches.

Copy link

@droberts195 droberts195 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@przemekwitek przemekwitek changed the title [Transform] Filter persistent transform tasks that match the update request [Transform] Ensure transform updates only modify the expected transform task Dec 4, 2023
@przemekwitek przemekwitek merged commit 67ab4b4 into elastic:main Dec 4, 2023
@przemekwitek przemekwitek deleted the investigate_bad_dates branch December 4, 2023 18:02
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
8.11
7.17 Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 102934

@przemekwitek
Copy link
Contributor Author

💚 All backports created successfully

Status Branch Result
7.17

Questions ?

Please refer to the Backport tool documentation

przemekwitek added a commit to przemekwitek/elasticsearch that referenced this pull request Dec 4, 2023
…rm task (elastic#102934)

(cherry picked from commit 67ab4b4)

# Conflicts:
#	x-pack/plugin/core/src/test/java/org/elasticsearch/xpack/core/transform/action/UpdateTransformActionRequestTests.java
elasticsearchmachine pushed a commit that referenced this pull request Dec 4, 2023
…rm task (#102934) (#102941)

(cherry picked from commit 67ab4b4)

# Conflicts:
#	x-pack/plugin/core/src/test/java/org/elasticsearch/xpack/core/transform/action/UpdateTransformActionRequestTests.java
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Transform] Unexpected changes in transform configuration.

4 participants