The company (therefore remaining shareholders) no longer has that $1M that they spent on the buyback, meaning the total pie is actually smaller as well as having fewer shares/slices outstanding.