The E46 has a much nicer interior. Especially black/alcantara along with CF trim features.
But the E36 IS WITHOUT A DOUBT a faster and more nimble car. This is of course assuming it has been maintained properly. I don't mind driving our E46 325 on the backroads. The feel it delivers is pretty solid but feel and reality are two different animals.