To sell or not to sell. That’s the question several New Jersey towns need to answer as they prepare to upgrade drinking-water systems.

However, the decision to privatize utilities might not receive taxpayer input, which has sparked a heated debate in The Garden State.

The...