Do we actually pay for them, does it come out of taxes or somthing?

Yes, where does any money come from? If people are claiming money off the government and they shouldn't be then it's us who end up funding them!