Unfortunately, getting your hand on the rocket launcher will take time ... then drop down through the hole at the far corner. In the room beneath, head northwest to find the room with the RPG ...