Same reason you never see baby squirrels or baby raccoons. Infants are kept sheltered, away from potential predators. Baby pigeons stay in the nest, out of sight, until they're ready to survive on their own. This is not the case among humans, where babies are taken to movies and restaurants and concerts. If only humans were like pigeons!