Having to turn ourselves in and get rid of (4)
I believe the answer is:
oust
'get rid of' is the definition.
(I've seen this before)
'having to turn ourselves in' is the wordplay.
'having' becomes 'to' (I can't explain this - if you can you should believe this answer much more).
'to turn' is a reversal indicator.
'ourselves' becomes 'us'.
'in' indicates putting letters inside.
'to' written backwards gives 'ot'.
'ot' placed around 'us' is 'OUST'.
'and' is the link.
(Other definitions for oust that I've seen before include "Put out, say of office" , "Turn out" , "kick out" , "Send packing" , "Remove and replace" .)