Triggerer stalling after a while

[uranusjr]

Body

Followup to #64882 (comment)

Original issue #64620

While the PR fixed the immediate issue about frame.id not matching, we observed the triggerer still could not pick up new triggers after this happens. The two things (frame.id not matching, and triggerer not picking up triggers) seem to happen together.

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[tirkarthi]

Just to add the triggerer stalls such that triggers already assigned to it are also not processed in addition to not picking up new triggers. With multiple triggerers new ones might be picked up by others but the ones in existing stalled trigger continue to be in deferred state till it restarts and the triggers get assigned to a healthy triggerer during restart.