You are experiencing the onset of bracket failure like all the rest of us aftermarket sway bar guys have. The straps that go over the bushing (to hold the bushing to the subframe) slowly bend and allow the bar to move around, hence the clunk. Sooner or later the straps will pull out of the subframe, or there will be a catastrophic subframe failure.
Do a search on upgraded backing plates to learn more.