The brothers are believed to have stayed there as well