Time not taken now becomes time & money taken next, under mandated arbitration. Also, the views of future challengers are colored by how they see you treating the current ones. You can expect respect when first you have shown it. Not every person understands or agrees with a governing decision, but shutting the door on discussion should be your second or third action, not your first.
By the same token, everyone (homeowners, Board members, and managers) should start from the assumption that there is some validity to each assertion. After thoughtful deliberation, you may discover that a person's expectations can't be reconciled with those of the community. That doesn't make his position wrong, only wrong for the community.