I don't feel bad for answering no as they do receive a message that states "no thank you" (or something along those lines). It's not like we said "heck no!". However, I like having some conversation prior to just adding a random Pirate to my list.
"My Momma always said....Pirates is like a box of chocolates......you never know what you're gonna get..."