i gotta say, the speaker grill mesh from parts express will be so accoustically transparent that if you actually worry enough to take it off and on all the time, youd be a bit anal retentive. :p

if its a good match though colorwise, id think you could make it look pretty nice. maybe cut out most of the plastic grill leaving strips in to shape the cloth over?