Castello Brown dates back to Roman times and was used as a military fortress before