  We introduce the notion of algebraic higher symmetry, which generalizes
higher symmetry and is beyond higher group. We show that an algebraic higher
symmetry in a bosonic system in $n$-dimensional space is characterized and
classified by a local fusion $n$-category. We find another way to describe
algebraic higher symmetry by restricting to symmetric sub Hilbert space where
symmetry transformations all become trivial. In this case, algebraic higher
symmetry can be fully characterized by a non-invertible gravitational anomaly
(i.e. an topological order in one higher dimension). Thus we also refer to
non-invertible gravitational anomaly as categorical symmetry to stress its
connection to symmetry. This provides a holographic and entanglement view of
symmetries. For a system with a categorical symmetry, its gapped state must
spontaneously break part (not all) of the symmetry, and the state with the full
symmetry must be gapless. Using such a holographic point of view, we obtain (1)
the gauging of the algebraic higher symmetry; (2) the classification of
anomalies for an algebraic higher symmetry; (3) the equivalence between classes
of systems, with different (potentially anomalous) algebraic higher symmetries
or different sets of low energy excitations, as long as they have the same
categorical symmetry; (4) the classification of gapped liquid phases for
bosonic/fermionic systems with a categorical symmetry, as gapped boundaries of
a topological order in one higher dimension (that corresponds to the
categorical symmetry). This classification includes symmetry protected trivial
(SPT) orders and symmetry enriched topological (SET) orders with an algebraic
higher symmetry.
