PM withdraws foreign affairs portfolio from Tariq Fatemi