Make oneself scarce, but really like the clothes hoist (4,2,3,5)
I believe the answer is:
take to the hills
'make oneself scarce but really' is the definition.
I can't tell whether this definition defines the answer.
'like the clothes hoist' is the wordplay.
'like' becomes 'take to' (take to can mean to like or grow fond of).
'clothes hoist' becomes 'hills' (I am not sure about this - if you are sure you should believe this answer much more).
'taketo'+'the'+'hills'='TAKE TO THE HILLS'
Can you help me to learn more?
(Another definition for take to the hills that I've seen is " fly away?".)