Personally, I would still have a look at it.
From what we know, the car used to have panel damage? Hence, sold for cheap. But what type of damage? Was there structural damage? Rust etc?
If it was simply some small cosmetic stuff, and if it has been all fixed correctly, then why not at least have a look at it?
For all we know, it could be a very nice example now that all the bits and pieces have been fixed up...and why can't he ask more since he has fixed it up to a high level?
I think a thorough inspection would be great if you were interested...