Your happiness goes to the baseline anyway. Even if something made you unhappy, unless it has permanent effects it usually only lasts so long.