Replay token sticks around after catching up

Are replay tokens suppose to stay around after catching up?
Axon framework 4.10 and all event processors are using Tracking Event Processors.

Oh, I understand.

The replay token is converted to a GapAwareTrackingToken (in my case) after it has caught up AND processed the next event.