I don't know whether "I'm from $place, like I said. Are you calling me a liar?" would be educational or not. Or, rather, whether it would be the right sort of educational. ($place because while I'm not sure where you said you were from--Vermont?--or whether you might now say Albany instead.)