Keeping it confidental

Why is it that people are so eager to know who I voted for? To me it feels like they are trying to figure if I'm an enemy or an ally. Even before the election, when people asked me if I was going to vote, and I answered yes, they would immediately jump to the question of who I was voting for. I have taken great care to keep that answer a secret. I don't want anybody making judgments based on who I vote for, regardless of whether or not I voted for who they wanted me to vote for. All they need to know is that I cast my ballot. To me it's more important that I participate in the voting process.