That has never happened to me before

Although I do notice a slight quality drop, I Have never had it look that blurred unless I had MIP's on.
The only suggestion that I would make however, is to use DXT3 as the format you use for your textures rather than 8 bit. Because that is what I use, and I do not have that problem, even when I use multiple texture maps.
I hope it fixes your problem