Trying to add my piece of advice here with some interesting readings...
I'm French, not a parisian (yes, we do exist), working in south of France. So for my (strictly) personal point of view, I hope to never work in Paris as this is a "too intense" city (this is just my way of life). But, creating a startup there is almost mandatory : lot of VC living there, important infrastructures ( https://stationf.co/ for example, and many others).
As many people said it, administration is hell (but it's getting better over years, thanks you www). So to avoid your hr, legal, financial stuff, take an accountant so you can do your job... Maybe it's 200€/m, but 200/m is like what ? a 2 days budget/month ? trust me, you don't want to waste your time on this.
On the tax part, yes, there are a lot, and it's a better move for a french student to move to the US than an american student to move to France. Why? We don't have a 100k student credit to pay for (Very good public schools, and when I say public, it's between 500€ and 2500€ / yr).
But more and more, administrations and institutions help startup founders financially. Maybe you should look for someone to take care of public grants (even if they take a commission on it) so you don't have to take care of this? Health insurance included, etc. It's a lot in the end but... meh, we always need a reason to whine you know.
On the language part, yep. We are terrible. But in all the industries around my work, english is mandatory. In my comp, requirements are in english, project management tools are in english, etc. It's simple, it's mandatory to work in english in our techy fields, so we can't avoid that. But yes, going to the bakery and speaking in english might be hard first. But once you know how to pronounce "Croissant", you'll be okay.
Oh, and we have good food (but haven't found a good beer (yet) :).
Sincirely hope you will be more than pleased if you plan to come to France though...
