In addition to the other answers here, Wahweap (just southeast) has a large full-service campground and marina and no doubt has potable water.

There is water available there. I didn't use it. Others noted it was there. Likely on top with the vault toilets and showers.

There's a dump station with potable water at the campground, you'll see it on the left just after you pay at the entrance station. You don't have to camp on the lake in the sand, there is another area above the lake next to the dump station as well.

There's water and a dump station at the top of the hill when you enter the campground.

You will be on the lake. Don't know about potable...but there is a paid state campground probably a mile away...look at their website..Sheps Canyon or Angostura State Rec Area. BEWARE lots of ticks n biting flies. I pulled over 30 off dog...and flies still in van!