Elizabeth Park is the oldest public rose garden in the country and is on the National Register of Historic Places