Hoover attended Poly High, where he did prep football, and Pasadena High School, where he played varsity track and high jumping. After graduating in 1956, then attended Pasadena City College, where he played as a receiver for the Lancers, and joined the Marines around the same time. Afterwards, he joined University of South California and started playing as left-end receiver for the Trojans in 1961. After playing defensive in the 1963 Rose Bowl, he left USC and joined the Orange County Rhinos that same year. By 1965, he had signed an additional contract for the Saskatchewan Roughriders, and served as a defensive halfback. By 1969, Hoover was coach for for the Valley All-Stars.