I was taken aback—I was greatly astonished—taken by surprise—startled. It is a sea term. A ship is “taken aback” when the sails are suddenly carried by the wind back against the mast, instantly staying the ship's progress—very dangerous in a strong gale.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Aback from Fact Monster: