(The). There is no such force. The Royal Marines are either artillery or infantry; there are no cavalry marines. To belong to the “Horse Marines” is a joke, meaning an awkward lubberly recruit.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Horse Marines from Fact Monster: