Agreed, Talia.
Most early cultural myths have the universe start with the mating of a primeval god and goddess--most often with an Earth goddess receiving a sky god. Some tales look back further than that, to a single deity who divides itself into male and female components, and THOSE mate to produce creation.
On an anthropological level, this is usually seen as a metaphor for the bountiful Earth being inseminated by the sky (rain) and bringing forth life. Myths are understood now, though, not as poorly-remembered history or as the stories made up by primitives to "explain" scientific fact, but as stories that reveal deeper truths and archtypical meaning in life. I, personally, like the idea of male and female being inherent in all of creation, expressing themselves through infinite variety and diversity.
Whether divinity seems best as male or female is likely entirely up to you; what do you relate best to? And what you are comfortable with will have a lot to do with how well you related to your mother and father, to the God presented in church when you were growing up, and to the attitudes and prejudices of the culture you live in.
Personally, I would find a genderless deity too . . . cerebral? Too much an artificial construct, like worshipping a computer instead of a living, breathing Person who has had the experience of loving, of giving birth, or creating, of being. Personally, I tend to associate the god with the YHWH of the Bible, Someone Who is called love and loving, but Who still represents law, judgement and condemnation on some level. That, I emphasize, is for ME, the way *I* feel things, not for anyone else on these boards.
As a Wiccan, I honor in ritual both the God and the Goddess as the male and female faces of creation. I feel closer to and work more with the Goddess energies, in large part because I feel traditional patriarchal mainstream religion has been brutally suppressive of women for at least the past 3000 years, and I find Goddess-centered worship to be incredibly and wonderfully liberating--both for women, and for those men who honor the principles of full equality between the sexes.
Again, these are my personal feelings, a glimpse into why I do what I do, and are in no way intended to proselytize!