Paying price for saying ‘absolutely not’: Imran Khan