A scout group has launched a petition following plans to build flats on the site of a historic hall in Erith.