(To). To fiddle about a thing means to “play” business. To fiddle with one's fingers is to move them about as a fiddler moves his fingers up and down the fiddle-strings.
“Mere trifling, or unprofitable fiddling about nothing.” —
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894