Food and other things necessary for the comfort of the body. Man being supposed to consist of body and soul, the body is the creature, but the soul is the “vital spark of heavenly flame.”
“Mr. Squeers had been seeking in creature comforts [brandy and water] temporary forgetfulness of his unpleasant situation.” —Dickens: Nicholas Nickleby.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Creature-comforts from Fact Monster: