I have the same problem with the edit pen to.
The page permissions allow only the Administrator to edit the page and "all users" to view.
The announcement modul have only “Inherit View permissions from Page” and Administrators with edit permissions.
Still the pen appears for all users.
This behaviour occurs by random but often after an administrator previously has done a logon (not changing or adding anything in the module).