Momentum and K.E.

How can momentum always be conserved while kinetic energy is lost when the collision is inelastic? Since there is a loss of energy why does momentum before collision is still equal to momentum after collision?
Thanks