I think an appropriate response to those acquaintances who are rude enough to judge this perfectly valid and respectable profession would be: "If you were unfortunate enough to be falsely accused of a crime, you would want the best defense attorney around. Here's my card."
...and then walk away!