Put some cloth between them... you can buy some heavy felt at a craft store. Wrap it around and between... if you've time and energy enough, taking it apart and putting the felt between, then just putting the nuts and bolts back would help a ton. But wrapping it around would at least mute it, and if you can force a bit down between, decrease it even further.