Correct.
Plastic water bottles have their place, maybe, in a pinch. But we shouldn't need them for the most part, because there are great reusable water bottles available at so many stores.
If you are worried about chemicals in hard plastics, you can get stainless steel water bottles. They are generally well-insulated, too, so your water stays cold.
Still, if you have plastic water bottles, you should recycle them once they are empty. Either leave the lids on or throw them away, but don't put the lids in the recycle bin alone.
Other plastic drink bottles are recyclable as well. Examples are Gatorade bottles and soda bottles. You must rinse them out first and let them dry.
These will be recycled and may become drink bottles once again.
