No, you do not have to. I believe in some configurations the E46 came with the same size tires all around. Having the same size tires all around would not cause a single tire to wear out, as I said that is likely an alignment problem. You didn't post the mileage but your rear trailing arm bushings could be bad.
My E46 M3 Rebuild Thread