Diffusing the inflation time bomb