No, everyone pays taxes, thereby supporting the very infrastructure that a business uses in the conduct of its business. Since all support the infrastructure, no one should be denied service due to the business owner's religious beliefs.

That's not how business works. Businesses are privately owned and reserve the right to deny a person business for almost any reason. I don't think people should be denied service because their personal choices conflict with the religious beliefs of the owners, but paying taxes doesn't guarantee access to private businesses. Paying taxes grants access to public services and the infrastructure itself, not everything build upon it.