No contact with PML-N leadership: Sarwar reiterates