The collisionless axisymmetric zonal flow residual calculation for a tokamak plasma is generalized to include electromagnetic perturbations. We formulate and solve the complete initial value zonal flow problem by retaining the fully self-consistent axisymmetric spatial perturbations in the electric and magnetic fields. Simple expressions for the electrostatic, shear and compressional magnetic residual responses are derived that provide a fully electromagnetic test of the zonal flow residual in gyrokinetic codes. Unlike the electrostatic potential, the parallel vector potential and the parallel magnetic field perturbations need not relax to flux functions for all possible initial conditions.