It is generally used in an argumentative situation, to make a point that could potentially be otherwise taken in a negative concept. Similar examples are "I'm not a sexist, but I don't feel women deserve equal pay when they are only truly useful 26 out of 29 days." The statement is often a precursor to "petitio principi" (Latin for "It is because I said so").