In mathematics, Cayley's Ω process, introduced by, is a relatively invariant differential operator on the general linear group, that is used to construct invariants of a group action. As a partial differential operator acting on functions of n2 variables xij, the omega operator is given by the determinant For binary forms f in x1, y1 and g in x2, y2 the Ω operator is. The r-fold Ω process Ωr(f, g) on two forms f and g in the variables x and y is then The result of the r-fold Ω process Ωr(f, g) on the two forms f and g is also called the r-th transvectant and is commonly written (f, g)r.

Applications

Cayley's Ω process appears in Capelli's identity, which used to find generators for the invariants of various classical groups acting on natural polynomial algebras. used Cayley's Ω process in his proof of finite generation of rings of invariants of the general linear group. His use of the Ω process gives an explicit formula for the Reynolds operator of the special linear group. Cayley's Ω process is used to define transvectants.