Because how a horcrux works is not that piece of soul residing in the body dies, but that it tethers them to life. Voldemort because just his soul when the curse rebounded, he said it himself he was less than a ghost. The killing curse didn't kill him because he couldn't be killed while the horcruxes existed. Only after they were destroyed could he have been destroyed.