Officials say the Eikenhoff pump station has failed, and it will take about a week to repair.
The City is, meanwhile, using a second pump to supply water.
If that pump fails, certain areas around Johannesburg will be affected.
They include areas around Roodepoort, Randburg, Langlaagte, Southdale and Soweto.
Hospitals around the city will also be affected.