Annoyed with rubbish at end of game (3,2)
I believe the answer is:
got at
'annoyed' is the definition.
('get at' can be a synonym of 'annoy')
'rubbish at end of game' is the wordplay.
'rubbish' becomes 'tat' (low-quality items or material).
'at end of' means one lot of letters go next to another (some letters go at the end of others).
'game' becomes 'go game' (go is a board game).
'tat' after 'go' is 'GOT AT'.
'with' is the link.
(Other definitions for got at that I've seen before include "Criticised" , "Nobbled" , "Unfairly influenced" , "Attacked verbally" .)