The pressure is equal on both sides for a pressure balanced expansion joint. If the pressure difference is minor, it would not be a problem, but if the pressure thrust is high, then an imbalance of forces would occur and could result in forces being transmitted to adjacent equipment.
