When the Conservatives returned to power under Churchill in 1951, Stuart was made Secretary of State for Scotland, with a seat in the cabinet.[1] He continued in this post until 1957, the last two years under the premiership of Sir Anthony Eden. He was appointed a Companion of Honour in 1957. On 20 November 1959 he was elevated to the peerage as Viscount Stuart of Findhorn, of Findhorn in the County of Moray.[10]
Hon. John Douglas Stuart (1925−1990), a Royal Navy lieutenant who married Cecile Margaret (née Barr) Tonge (former wife of George Maurice Tonge), daughter of Gerald Harrison Barr, in 1957. They divorced in 1958 and he married Lady Caroline (née Child-Villiers) Elliot-Murray-Kynynmound, former wife of Gilbert Elliot-Murray-Kynynmound, Viscount Melgund, and eldest daughter of the 9th Earl of Jersey, in 1969. They divorced in 1980.[12]
Hon. Jean Davina Stuart (b. 1932), who married John Reedham Erskine Berney, son of Maj. Sir Thomas Berney, 10th Baronet, in 1951. After his death in 1952, she married Percy William Jesson, son of Lt.-Col. Harold Jesson, in 1954. After his death, she married Michael Denison Ritchie in 1985.[12]
Stuart died at Salisbury Infirmary on 20 February 1971, aged 74, and was succeeded in the viscountcy by his elder son. His widow died in October 1977.[1]
Before his marriage, Stuart had been noted as a suitor of Lady Elizabeth Bowes-Lyon while serving as an equerry to her eventual husband Prince Albert, Duke of York (the future King George VI).[1]
Arms
Coat of arms of James Stuart, 1st Viscount Stuart of Findhorn
Crest
In a nest Vert a pelican feeding her young Or about her neck a collar engrailed Gules.
Escutcheon
Quarterly 1st Or a lion rampant within a double tressure flory counterflory Gules all within a bordure compony Azure and Argent (Stuart) 2nd Or a fess chequy Azure and Argent (Stewart of Downe) 3rd Or three cushions within a double tressure flory counterflory Gules (Randolph) 4th Gules a lion rampant within a bordure engrailed Argent (Gray) all within a bordure Or for difference.