Used to have a black merc and the swirls were a pain in the ass. I literally worked my ass off to detail the car. Had to wax it every other week.
My next car, a titanium silver E46 gave me lesser problems with the swirls. Though nothing shines like a black car.