Hardness of observing strong-to-weak symmetry breaking