Hunt for caretaker CM begins