Looming over Port Henry is Ledgetop, a Richardson Romanesque mansion built in 1880 by Walter Witherbee, owner of the Witherbee-Sherman Mining Company, the largest 19th century iron mining operation in the Adirondacks. In the 1870s underground mines near here produced close to ten percent of iron ore in the USA. The mansion, now empty and mostly gutted, was transformed over the years by subsequent owners, such as the American Legion and the Knights of Columbus.