There's water and a dump station at the top of the hill when you enter the campground.

There's a dump station with potable water at the campground, you'll see it on the left just after you pay at the entrance station. You don't have to camp on the lake in the sand, there is another area above the lake next to the dump station as well.

Probably not helpful to you because it's a late answer, but maybe someone else might see this. I was there in Feb 2021 and the water was turned off for the season. But the Pilot gas station has a dump station and potable water for free. I have a YouTube video on it: https://youtu.be/6hqRPstunaM

You will be on the lake. Don't know about potable...but there is a paid state campground probably a mile away...look at their website..Sheps Canyon or Angostura State Rec Area. BEWARE lots of ticks n biting flies. I pulled over 30 off dog...and flies still in van!

In addition to the other answers here, Wahweap (just southeast) has a large full-service campground and marina and no doubt has potable water.

There is water available there. I didn't use it. Others noted it was there. Likely on top with the vault toilets and showers.