Gene duplication is considered a major force in gene family expansion and gene innovation. As gene copies assume novel functions, they must avoid periods of neutrality or be deleted from the genome. Current opinions state that copies avoid neutrality through gene dosage effects. These copies are therefore selected from an early stage. This study concentrates on the flow of copies from recent duplication to gene innovation. We have studied 21 microbial genomes using amino acid divergence to describe paralog evolution in the long-term perspective. Five of these were studied in closer detail using nucleotide divergence for a shorter perspective. It was found that rates of duplication and deletion are high, with only a small fraction of duplications retained and apparently selected. This leads to a steady accumulation of paralogs, which seems to be of a similar magnitude in most of the genomes. Furthermore, it is found that genes of high expression level, as measured by their codon bias, are strongly underrepresented among the most recent duplications. Based on these and other observations, it is suggested that gene innovation is driven by amplification of weak, ancillary functions rather than strong, established functions.