> Their cost per Max chip is probably $200-300 which beats the 4090 by a massive margin...
That's true. I was talking about end user pricing.
> ...each chip can do more than a 4090 because it also has a CPU onboard.
That's a strange thing to say. It has a CPU, correct. It makes the chip more versatile but for data center ML tasks it doesn't really matter. A 4090 chip also has much more ML relevant compute per chip. So apple's chips can't really "do more than a 4090" in any relevant way.
Of course apple pays less for their in house made chips vs external products. That comparison doesn't seem relevant to the context, e.g. they're not going to challenging CUDA with internal chips.
They might get more compute per watt though. My guess is that nvidias datacenter chips are competitive in that space, but that's another story.
That's true. I was talking about end user pricing.
> ...each chip can do more than a 4090 because it also has a CPU onboard.
That's a strange thing to say. It has a CPU, correct. It makes the chip more versatile but for data center ML tasks it doesn't really matter. A 4090 chip also has much more ML relevant compute per chip. So apple's chips can't really "do more than a 4090" in any relevant way.
Of course apple pays less for their in house made chips vs external products. That comparison doesn't seem relevant to the context, e.g. they're not going to challenging CUDA with internal chips.
They might get more compute per watt though. My guess is that nvidias datacenter chips are competitive in that space, but that's another story.