Prince Harry thought about quitting royal life in his 20s