Goldberg was a famous abstract painter from the New York School with work in major museums and private collections. His work was influenced by Abstract Expressionist painters like Kline, Still, and de Kooning as well as the improvisational nature of jazz music, which he admired. Goldberg began art lesssons at 14 at the Art Students League. After a brief time in the army during World War II, Goldberg went back to painting. His first public showing was in 1951 at the Ninth Street Show. Tibor de Nagy Gallery gave him his first solo show in 1953. Goldberg and his wife taught at the School of Visual Arts and summered in Tuscany, Italy, outside of Siena.