Reconciliation happening nonstop even with no changes to manifests #3308
-
I recently hooked up the gitops connector https://github.com/Azure/gitops-connector so that I can see deployment status in github on the commits that contain manifest changes, and also so I can trigger the next step of my workflow once a deployment completes with the dispatch event that gitops connector sends out on successful deployment. When I got everything setup, I noticed I was getting the dispatch event in github once per reconcilliation period, regardless of changes happening or not to the manifests. I checked the logs for gitops connector and have messages like this coming in
And every reconciliation period another one comes in with a unique resourceVersion number. I am thinking flux is sending the notification repeatedly to gitops connector, even though nothing has changed in the manifests. I am forwarding events with the following
How can I figure out what is going on here? Should I expect to only get events from flux when something actually changes in the manifests? Or does it alert on every reconciliation and it's the gitops connector job to know if something changed somehow? |
Beta Was this translation helpful? Give feedback.
Replies: 3 comments 4 replies
-
@stefanprodan tagging you here for visibility of what I was using the diff command for. I ran the diff and there were no changes, yet for some reason I am seeing this issue still. Any ideas? |
Beta Was this translation helpful? Give feedback.
-
This is the expected behavior, at every reconciliation run an event is emitted. |
Beta Was this translation helpful? Give feedback.
-
I've stumbled upon this too, so will try exclusion list. I think for notifications, it would be great to see/examples of notifying 'whats changed', rather than 'flux is checking everything is the same'. Eg if the git commits new, Let me know about that, somethings changing in the infrastructure The solution might be exclusions (or inclusions), but https://fluxcd.io/flux/components/notification/alerts/#event-inclusion doesn't really provide how to find the list of what event kinds there are. It might be nice if that's somehow generated into the docs, even a list of what events are omitted would allow the tuning. At the moment it felt like my choices are 'only errors', or 'an everything's okay alarm', into the matrix room I setup to get alerts :)
doesn't seem to work for the Alert type, so I suspect it's some other syntax that's required. |
Beta Was this translation helpful? Give feedback.
This is the expected behavior, at every reconciliation run an event is emitted.