Well, my preference is for speakers which either don't have grill covers at all (e.g. Epos), or which have been designed to be used without grills period, because IME there is no such thing as an acoustically transparent cloth material despite what some manufacturers claim about their covers.
ATC actually design the grill covers to be an acoustic part of most of their speakers; this is true for the models destined for the domestic market I'd guess rather than the ones which are going to be in-wall sofit mounted in studios. This I certainly found to be the case when I had the 50's. The image/stage was very diffuse and ill-defined without the grill, but put them back on and things would "snap back into focus" and become more coherent. True, removing the grills would bring about a more explicit quality to the treble, and also more punch and inner detail to bass textures. For me though, sitting quite close to the 50's in a medium sized room I found the top end to be a bit fatiguing at times - this would have been a different matter I'm sure in a bigger room sat at further distances.