Yes, they do fit in the bottle and the cap will still fit on. I found that the Aquafina and Dasani bottles worked fine. A couple of others I tried did not.
You can't get the last few ounces of water out of the bottle either, but all-in-all it's a minor inconvenience. The filters are wonderful!