I would say get a specialist to look at it first (I use Gav at Unit 4 but PJS are also very good). They will tell you if any bushes and/or balljoints are knackered, plus your steering rack as they can knock. If any of those are faulty then replacing them will make the car less clonky/bangy.
New dampers might make a bit of difference but beware things like Nitrons have MUCH stiffer springs and make the car overall much harsher. They are great on track, obvs, and good on smooth roads and if you are driving really fast but on bumpy roads, in the wet, when you are driving slowly and sensibly,