something new performs better cause its new

if you have a platform with lots pf returning users this one will hit you again and again.

so even if you have a winner after the test and make the change permanent, revisit it 2 months later and see if you are now really better of.

all changes of a/b tests in sum has a high chance to just get an average platform in the sum of all changes.