Faf du Plessis admits off-field dramas took toll on South Africa