Opposition no more threat to PM: Rashid