I think it's easier for people to convert from religion to atheism/agnosticism and vice versa than to convert between religions. If you don't believe the stories with no concrete proof that your parents tell you, why would you believe stories that a stranger tells you?