PM dissatisfied with his party leadership for their disunity on political issues