Do I have to pay if I don't plan on swimming in the pool

Yes, all patrons entering the pool area, swimming or not, are required to pay the entrance fee.