I think you can just leave the pulley on there, spinning freely. It seems light enough not to make any difference, and since it's not powering anything, no accessory loss.
John
'98 SVT - modded -15.01@91.8 '95 Suzuki GS500E -faster than the above ---wanting a Speed Triple or Superhawk badly