It's at the stern, even when going backwards (4)
I believe the answer is:
poop
I'm afraid I can't explain this answer.
Can you help me to learn more?
(Other definitions for poop that I've seen before include "Deck at stern of ship" , "raised structure" , "Fool" , "Whichever way you see them, the facts" , "Tony" .)