We are struggling for effective accountability more than opponents: PM