Welsh town north-east of Swansea housing a ruined castle (5)
I believe the answer is:
neath
(Other definitions for neath that I've seen before include "Welsh industrial town" , "River" , "town in South Wales" , "Town near Swansea" , "not on top" .)