To take a rise out of one. Hotten says this is a metaphor from fly-fishing; the fish rise to the fly, and are caught.