El-Shibib was elected to the leadership of Arab Socialist Ba'ath Party, and was one of a triumvirate who planned the later coup against President Abdul Karim Qassim. He became foreign minister under the new regime in 1963.
Internal disagreements led him to go in exile. After the second coup in 1968, El-Shibib was given several ambassadorial posts. In 1976 he resigned from the post as Iraqi ambassador to Germany and went into exile again when disagreements arose between him and Saddam Hussein’s policies. He devoted the remainder of his life in exile while campaigning against Saddam and for a democratic Iraq.