Some coarse textures pose a snag hazard with certain types of clothing depending on the body type, clothing, gun and carry style. I would apply coarse grip tape on the front trap and back strap of your pistol and test it. If your clothes don't snag on that than likely even the most aggressive texture in those areas will be ok.
Side note: I find that there are plenty of exceptions to the whole premise that aggressive texturing is not suited to concealed carry. I carry AIWB against bare skin and have no issues with my Great Lakes Custom Works Glock frames. One is the Chaos - Aggressive pattern and the other is the Traditional - Aggressive. With that being said I tried out an Agency Arms Armor textured frame and that is totally unacceptable for carry against skin in my experience.