We’re intermittently seeing these warnings from the EmbeddedEventStore in our prod environment: “An event processor fell behind the tail end of the event store cache. This usually indicates a badly performing event processor.”
This usually happens when there’s very little (or no!) activity in the system. I’ve been able to reproduce the warning locally by adding sleeps to event handlers, but not in a consistent manner.
The initial analysis indicates that this only seems to occur for EventConsumers where lastNode is null and lastToken is a tracking token with some gaps. The lastToken index is comfortably within the range of indexes cached by the EmbeddedEventStore, so I would not expect the tracker to need a private connection to the data store.
- Spring Boot 2.1.3
- Axon Framework 3.4.2
- JdbcEventStorageEngine, JdbcTokenStore, JdbcSagaStore on PostgreSQL
- Tracking processors for all views and sagas
Not sure if this is a bug, expected behaviour, or a misconfiguration on our part. Any pointers or ideas much appreciated.