Of our last 4 cats (two at a time) none have ever seemed to have taken an interest in speaker grills. I always leave them on so they don't get near the driver material.

They do however, like to hide toys in subwoofer ports. <insert angry emote here>

With great power comes Awesome irresponsibility.