Originally, it was constructed in 1890 as naval officers housing. Important visitors have included extended stays by inventor Thomas Edison and scientist Edward Hayden and it has been used by six American presidents. Its most important usage was as the winter White House of Harry Truman who spent 175 days of his presidency here from 1946 through 1952.
The home of Capt. John H. Geiger, harbor pilot and master wrecker, was built between 1846 and 1849. Thirty-one of the original hand colored Antique engravings of the 22 birds J.J. Audubon painted in the Florida Keys during his 6 week visit in 1832 can be seen throughout the house.