High-entropy semiconductors are now an important class of materials widely investigated for thermoelectric applications. Understanding the impact of chemical and structural heterogeneity on transport properties in these compositionally complex systems is essential for thermoelectric design. In this work, we uncover the polar domain structures in the high-entropy PbGeSnSe1.5Te1.5 system and assess their impact on thermoelectric properties. We found that polar domains induced by crystal symmetry breaking give rise to well-structured alternating strain fields. These fields effectively disrupt phonon propagation and suppress the thermal conductivity. We demonstrate that the polar domain structures can be modulated by tuning crystal symmetry through entropy engineering in PbGeSnAgxSbxSe1.5+xTe1.5+x. Incremental increases in the entropy enhance the crystal symmetry of the system, which suppresses domain formation and loses its efficacy in suppressing phonon propagation. As a result, the room-temperature lattice thermal conductivity increases from κL = 0.63 Wm-1 K-1 (x = 0) to 0.79 Wm-1 K-1 (x = 0.10). In the meantime, the increase in crystal symmetry, however, leads to enhanced valley degeneracy and improves the weighted mobility from μw = 29.6 cm2 V-1 s-1 (x = 0) to 35.8 cm2 V-1 s-1 (x = 0.10). As such, optimal thermoelectric performance can be achieved through entropy engineering by balancing weighted mobility and lattice thermal conductivity. This work, for the first time, studies the impact of polar domain structures on thermoelectric properties, and the developed understanding of the intricate interplay between crystal symmetry, polar domains, and transport properties, along with the impact of entropy control, provides valuable insights into designing GeTe-based high-entropy thermoelectrics.