He was unsuccessful for election in 1874 to the Forty-fourth Congress.
He was subsequently elected as a Republican to the Forty-third Congress to fill the vacancy caused by the death of Alvah Crocker and served from January 27 to March 3, 1875.
He did not run for a full term, and continued his business interests. Stevens died in New York City on April 7, 1892. He was interred in Aspen Grove Cemetery, Ware, Massachusetts.