Trevor, the Australian Doctor, refers to "Horseback riding"
Australians and New Zealanders never need to specify whereabouts you ride a horse. As people don't tend to 'Horseneck" or 'Horsebutt' ride, we just refer to riding a horse as 'Horse riding'. (No need to get uppity, Aussie, it's just terminology)