Google have just (in the last hour) announced changes to the behaviour of speaker groups "due to a legal ruling".

https://www.googlenestcommunity.com/t5/Blog/Upcoming-Speaker...

It sounds like an absolute nightmare for users, and if I was affected I would be demanding a refund for every affected device, as they clearly are no longer functioning as expected at the time of purchase.