Polls a prerogative of sitting govt: PM