there isn't a way to stop the belt slapping unless you remove it or get the revised cover. The tensoner on the timing belt is a one time set, meaning the tension is set on install and then it doesn't change.
I would say if the miles are high enough then change the belt and that will also take care of it.
I am just not sure how good it might be to retension the old belt