Abstract: This paper discusses the coupled wave equations and the coupled relationship between two dominant propagating modes,H11 even-mode andH 11 odd-mode in cylindrical waveguide which was full-filled with ferrite material under rotary quadrapole magnetized field.This paper also carries out the formulae of the polarization matrix and the off-diagonal elements of permeability tensor,which are proved by simulation resultants using ANSOFT-HFSS and 3D software in such waveguide.