Instead of just inviting random people and booting them if they don't fit your needs, why don't you play with people first, and then invite them.

Not everyone levels fast, but that doesn't make them a good guild member. I'm not leveling as fast as others, but that's because I help others a lot, and chat probably too much