"...covered in lint" and "...significant layer" are subject to some definition, but I think you're probably over-thinking it. Got a picture? If you have a legitimate accumulation of lint, consider what you're washing your pants with, what your pocket lining is made of, or what holster you're using and adjust. Like Urban Redneck suggests, you can also turn the pocket inside out and brush or blow it off before putting the gun in.
Carry the gun for a few days, let the lint accumulate, then shoot it in that condition to test function. I bet you'll find that it's fine.
2012 National Zumba Endurance Champion
Hi Point 9mm, Lorcin .22, Bushmaster Carbon 15, Norinco SKS, Leapers 10x