Criminal's held by bishop (5)
I believe the answer is:
crook
I believe this clue is a double definition.
'criminal's' is the first definition.
('crook' can be a synonym of 'criminal')
'held by bishop' is the second definition.
(a crook is a bishop's staff)
(Other definitions for crook that I've seen before include "Criminal - taken in hand by bishop" , "Fence, perhaps" , "Shepherd's staff" , "Something kinky" , "Professional criminal" .)