It depends on the reason for your ban (and on whether the French authorities accept your marriage as genuine, but let us assume that they do).
Under the freedom of movement directive, as the spouse of an EU citizen, you can only be denied entry to (or residence in) France if you are a threat to public safety, public health, or public policy. If your ban is based on one of these considerations, France could exclude you for the same reason.
On the other hand, if your ban was the result of an immigration violation, or even a criminal conviction that does not imply a threat to public safety, France cannot use the ban or the underlying reason to restrict your freedom of movement.