It's a very Western idea to unify so totally marriage and sexuality, but they're not always the same. Modern marriages are as much a partnership in money matters and the building of a household as they are about sex. Just because our culture puts so much emphasis on sex does not change what marriages have really been about for thousands of years. Arcaic as it may sound, marriages are about children.
I agree that consenting adults should get to tend to their sexual needs in private. However, marriage and family are big concerns for society; society supports the children of that union (public school, welfare if need be, loans from the government for college) and so has a vested interest in that child so they can repay the favor. Society also has a vested interest in a unified marriage, because two working parents have more assets to support childrearing.
With that in mind, I'm firmly in favor of gay marriage... not because it's so much the sexuality, but because it's about a two-person partnership supporting a child. Yeah, you're swapping the genders out, but two fathers or two mothers can still financially and emotionally support a child.
Once you start getting into taboo forms of sexuality and want to start assigning them the society stamp of marriage, you get into tricky waters. Polygamy, for example. Almost by design (and as the compound demonstrated), polygamy produces more children and more mouths to feed than one full partnership can sustain. That's why they need a whole compound and welfare fraud to maintain it.
Incest is a whole new ball of wax. Yes, maybe there are no strict biological effects in the first generation; what about the third or fourth? And if we marry brothers and sisters, why not fathers and daughters? Mothers and sons? Now we start getting into gray areas of sexual control and child abuse... did the father start hitting on the daughter when she was underage?
The more we try to "privatize" marriage, the more we have to ask uncomfortable and intrusive questions about the nature of the relationship, and the more public it becomes.
Sexuality is private. Marriage is not. You don't have sex in the front of a church, but traditionally, you marry in one. Marriage is a public, society contract that is regulated by the government and by the community; by wanting to make these taboo sexualities more "private" and legal, we are in fact making them more and more public. And especially in cases of incest, polygamy, beastality, etc., if we as a society support them, we are claiming that marriage is NOT a partnership or an institute for the benefit of children, but in fact ONLY about sexual gratification.