Symmetry in neural networks
Symmetry in neural networks refers to the presence of invariant structures or transformations within network architectures or functions that remain unchanged under specific operations. This concept is utilized to improve learning efficiency, generalization, and interpretability by embedding known invariances directly into network design or training.