Supporting R or Typescript/JavaScript would be great and probably closer to the Microsoft ethos (R is already very well supported in SQL server and PowerBI).
Furthermore, fundamental things such as the fact CPU interconnects are in the 160+Gbps range compared to (in their example) 10gbps network prevents this from scaling as a single system would. Even in a single dual socket system it is not uncommon to pin (via numactl) processes to a single CPU in order to get full performance out of applications and prevent saturating this interconnect.
Accessing memory from a remote core over the network is seriously handicapped in this respect, and purpose built cluster systems such as infiniband rdma with bandwidth in the 100gbps realm still have issues with this latency. A single stick of previous-gen ddr3-1600 can exceed that bandwidth, with 15x faster access time.
To give an example, a very low latency (non Ethernet) network is around 1300μs, local dram (from the same socket) is 60ns. L3 cache on the same socket is 15ns.
You can be smart about pinning memory allocation to the local CPU core requesting it, and minimizing thread migration to another host, but there is no magic bullet to getting past these theoretical limits. Accessing packets arriving on a network card in host A from host B's core would halve the network bandwidth unless there is a dedicated network for the clustering.
That being said, virtualization isn't perfect either and the overhead can be substantial as we've seen when comparing to containers on bare metal.
I'd really like to take this for a test drive and benchmark it with some R jobs.
Even if it's slower, the value of not having to use cluster-aware toolkits is valuable to many, not to mention simplicity of operation.
I wish they would release an open source version before getting sucked up as a stop-loss by Intel.
It's a Ponzi scheme! They're promising you a 20% return as long as there are greater fools around that are willing to bet they're not the greatest fools. I love it.
The gamble is that you will not be the last idiot to invest (the last person/group is the loser). Basically the first people give their money to 1 address. The group that follows pays the first their 20% return (+ the operator's 5% fee it looks like).
Where in a regular (regulated) scenario, your investment would be paid back by the company's sales, profits, liquidity, assets, ect. The people who participate in this gamble that they are not the last to invest (and that the operator pays out), because the "return," is dependent on the next following "investor."
