After deleting a filtered annotation, all other annotations should be visible

Steps to reproduce:
User has a document with several annotations.
User clicks the Display only this annotation button on one annotation -> All other annotations are then hidden
User deletes the filtered annotation -> Annotation is deleted and all other annotations remain hidden

I expected the filter to be dropped as soon as the filtered annotation is deleted, but the user needs to actually turn it on and off on another annotation for them to be all visible again.