He first recorded with the Blue Note label in 1956. His early albums with Blue Note sold very well, improving its financial viability and aiding the label's efforts to promote other artists. They include Home Cookin' , The Sermon!, Midnight Special, Prayer Meetin' , and Back at the Chicken Shack. Smith signed to Verve Records label in 1963. Smith's albums with Verve include: The Cat, The Boss, Root Down, Peter & The Wolf, Any Number Can Win, The Incredible..., Bashin' , Got My Mojo Workin' , Christmas Cookin' , and Organ Grinder Swing. It was in this period that he began a regular collaboration with Guitarist Wes Montgomery, with whom he recorded two albums: The Dynamic Duo with Wes Montgomery and Further Adventures Of Jimmy and Wes. Smith recorded with a full orchestra and worked with arrangers and conductors such as Lalo Schifrin and Oliver Nelson.