Holding nothing, having failed (5-6)

I believe the answer is:
empty-handed
'failed' is the definition.
Both the definition and answer are adjectives. Perhaps you can see a link between them that I can't see?
'holding nothing having' is the wordplay.
'holding nothing' becomes 'empty' (I've seen this in another clue).
'having' becomes 'handed' (I am not sure about this - if you are sure you should believe this answer much more).
'empty'+'handed'='EMPTY-HANDED'
Can you help me to learn more?
(Other definitions for empty-handed that I've seen before include "Without gifts" , "Bringing nothing" , "Having gained nothing" , "(Return) with nothing" .)
