Genetic comparisons yield insight into the evolution of enamel thickness during human evolution.
Enamel thickness varies substantially among extant hominoids and is a key trait with significance for interpreting dietary adaptation, life history trajectory, and phylogenetic relationships. There is a strong link in humans between enamel formation and mutations in the exons of the four genes that code for the enamel matrix proteins and the associated protease. The evolution of thick enamel in humans may have included changes in the regulation of these genes during tooth development. The cis-regulatory region in the 5' flank (upstream non-coding region) of MMP20, which codes for enamelysin, the predominant protease active during enamel secretion, has previously been shown to be under strong positive selection in the lineages leading to both humans and chimpanzees. Here we examine evidence for positive selection in the 5' flank and 3' flank of AMELX, AMBN, ENAM, and MMP20. We contrast the human sequence changes with other hominoids (chimpanzees, gorillas, orangutans, gibbons) and rhesus macaques (outgroup), a sample comprising a range of enamel thickness. We find no evidence for positive selection in the protein-coding regions of any of these genes. In contrast, we find strong evidence for positive selection in the 5' flank region of MMP20 and ENAM along the lineage leading to humans, and in both the 5' flank and 3' flank regions of MMP20 along the lineage leading to chimpanzees. We also identify putative transcription factor binding sites overlapping some of the species-specific nucleotide sites and we refine which sections of the up- and downstream putative regulatory regions are most likely to harbor important changes. These non-coding changes and their potential for differential regulation by transcription factors known to regulate tooth development may offer insight into the mechanisms that allow for rapid evolutionary changes in enamel thickness across closely-related species, and contribute to our understanding of the enamel phenotype in hominoids.