If one day you confront someone and there is no reaction, it doesn't mean that the person is a muggle, as they may simply not want to end up with you...