Councillors threaten to besiege CM’s House over shifting of office