He served in the American Civil War along with two of his brothers, one of whom died during the conflict. His brother William Thomas Soule served as New Bedford's mayor in 1878.[4] Rufus Soule also served as Customs Collector and was the subject.of an editorial cartoon.[5] He owned the Soule Mills established in 1902.[4][6]
After the war, he got into the shoe business with a partner he served with in the war. He first served in the Massachusetts state legislature in 1878 and 1879 following time on the New Bedford Common Council including as president.[7]
He married Susan C. Nesmith on August 28, 1860, and they had three children, including Rufus Albertson Soule Jr.[2][8]