When someone says a design is harder to use, you don't get to say "no it isn't because Fitts' Law". If it's harder for someone to use, those are the facts on the ground. You need to adjust your theories to fit the facts, not try to say the facts aren't true so they fit your theories.