I don't know if you can check the idler condition without removing the belt. Try (1) measuring to see if it's detectably off center, (2) trying to wobble it to see if its centerline can be deflected relative to the metal hub inside, (3) maybe listening to it while the engine's running...
