Opposite of aye (3)
I believe the answer is:
nay
(Other definitions for nay that I've seen before include "Negative response" , "In point of fact - a parliamentary vote against" , "Archaic negative" , "No (dialect); or rather" , "telling a nicker from a pony?" .)