Make a launchpad that holds the bottle with the neck downwards, lets you attach the pump and stand behind the bottle. One good method is to plant a spade or garden fork in the ground at a low angle ...

And most bottles aren't a great shape for smooth flight. There are many other, more advanced, rocket designs. Some people compete in national competitions. Explore the Internet for inspiration and ...