A criminal's may be unbelievable
I believe the answer is:
alibi
(Other definitions for alibi that I've seen before include "Evidence one was not at crime scene" , "Proof of not being at crime site" , "Sort of explanation" , "Reason often given to exculpate someone" , "can offer a valid defence against most charges" .)