The book's checklist
- Lower cost of livingEveryday prices run 8.4% below the U.S. average in the parts of Maine outside metro areas.
- More house for the moneyA typical home costs 7.2 years of the typical household's income here. Across the U.S. it's 4.1.
- A safer neighborhood1 violent crime was reported in 2025, about 0.5 per 1,000 people (U.S.: 3.3). Property crime: 5.3 per 1,000 (U.S.: 15.3).
- Schools in town2 public schools. No public high school in town: the nearest is Mt Desert Island High School, about 8 miles away.
- A hospital close byMount Desert Island Hospital in Bar Harbor, about 10 miles away, has the nearest emergency room.
- Within reach of a big cityBoston is about 190 miles away as the crow flies. The book suggests staying within about 60 miles if you'll miss big-city sports, concerts and theater.
A check means the town meets the book's rule of thumb; an empty box is something to weigh; a question mark means too little data.
Southwest Harbor meets 3 of the 6 rules of thumb we have data for. Frank and Dave's free book explains how to weigh the rest for your family.
Of the towns on this site, the nearest with 2,500 or more people and an emergency room in town is Bar Harbor, ME, about 10 miles away in a straight line. Its emergency room is at Mount Desert Island Hospital. A typical home there is valued at $538,400 (Census survey, 2020-2024). It has 2 public schools.
Sources: Medicare hospital data; Census Bureau American Community Survey, 2020-2024; NCES Common Core of Data, 2023-24.
What kind of town
Tourist town. About 44% of homes are vacation or seasonal homes, a sign of a visitor economy. More restaurants, shops and weekend events than locals alone could support, with the small-town basics intact.
The book sorts small towns into six types. These labels come only from the numbers; take the quiz to see which type fits your family.
For a lifetime
Homes and money
- Typical home value, as owners valued them in 2020-2024
- $428,500U.S.: $332,700; Maine: $296,600
- Home prices since then
- Up 28%Hancock County, 2022 to 2025
- Typical rent, with utilities
- $959 a monthU.S.: $1,413; Maine: $1,139
- Typical household income
- $59,205U.S.: $80,734; Maine: $74,733
- Homes owned by the people living in them
- 56%U.S.: 65%; Maine: 74%
- Typical property tax bill
- $3,479 a yearMaine: $3,036
- Homes built before 1940
- 19%U.S.: 12%; Maine: 23%
- Homes built since 2010
- 5%U.S.: 11%; Maine: 9%
- Typical year homes were built
- 1982U.S.: 1980; Maine: 1977
- Vacation and seasonal homes
- 44%U.S.: 3%; Maine: 15%
- Everyday prices
- 91.6U.S. average = 100 (the parts of Maine outside metro areas)
- Housing costs (U.S. average = 100)
- 61.4Rural Maine
County prices have moved up 28% since 2022. Check current listings before you budget.
Sources: Census Bureau American Community Survey, 2020-2024; FHFA county house price index; BEA Regional Price Parities, 2024.
Read next: How to buy a house in a small town
The people
- Population, 2025 estimate
- 1,8732020 estimate: 1,752
- People per square mile
- 139Mixes the 2025 estimate with 13.5 square miles of land (2025 Gazetteer)
- Median age
- 48.9 yearsU.S.: 38.9; Maine: 44.8
- Age 65 and older
- 27%U.S.: 17%; Maine: 22%
- Under 18
- 14%U.S.: 22%; Maine: 18%
- Adults with a bachelor's degree or more
- 35%U.S.: 36%; Maine: 36%
- Moved here from another county or state in the past year
- 3%U.S.: 6%; Maine: 6%
It grew every year from 2020 to 2025.
Sources: Census Bureau population estimates, 2025; Census Bureau American Community Survey, 2020-2024; Census Bureau Gazetteer, 2025.
Work
- Unemployment rate
- 4%U.S.: 5%; Maine: 4%
- Average commute
- 16 minutesU.S.: 26 minutes; Maine: 25 minutes
- Work from home
- 11%U.S.: 15%; Maine: 16%
- Below the poverty line
- 9%U.S.: 12%; Maine: 11%
Source: Census Bureau American Community Survey, 2020-2024.
Read next: How to keep working when you move to a small town
Health care
Nearest emergency room: Mount Desert Island Hospital, Bar Harbor, ME, about 10 miles away. It's a critical access hospital (a small rural hospital with 25 or fewer beds).
Nearest general hospital: Northern Light Maine Coast Hospital, Ellsworth, ME, about 21 miles away. Medicare gives it 3 of 5 stars.
Look up doctors, clinics and the hospitals themselves on Medicare's Care Compare. Ask where the most serious cases are sent.
Source: Medicare hospital data.
Read next: Retiring to a small town on a fixed income: a planning checklist
Schools
2 public schools in Southwest Harbor, run by Southwest Harbor Public Schools and Tremont Public Schools. The nearest public high school is Mt Desert Island High School, about 8 miles away.
See each school on the federal school search, then check test scores and graduation rates on Maine's school report card.
Source: NCES Common Core of Data, 2023-24.
Read next: How to choose a school when you move to a small town
Internet
- Homes with cable, fiber or DSL internet
- 75%U.S.: 76%; Maine: 77%
- Homes with any internet subscription
- 84%U.S.: 91%; Maine: 91%
Before you buy, look up the address on the FCC's National Broadband Map to see which providers serve it.
Weather
- January average low
- 15°F
- July average high
- 79°F
- Days 90°F or hotter
- 3 a year
- Nights at or below freezing
- 141 a year
- Rain and melted snow
- 55.5 inches a year
- Elevation
- 75 feet
Weather station: Acadia NP (8 miles away). Averages for 1991 to 2020.
Sources: NOAA climate normals, 1991-2020; USGS elevation data.
Getting around
Straight-line miles. The road is always longer, and as the book says, an interstate at 70 is a different trip from a farm road at 45. Check the real drive: Mount Desert Island Hospital, Portland, Boston.
Hancock County is outside any metro area, with fewer than 5,000 people in its towns, next to a metro area (USDA rural-urban code 8, on a scale where 1 is the biggest metro areas and 9 the most rural counties).
For a day
3 places on the National Register of Historic Places, including the Claremont Hotel, Edgecliff and Raventhorp.
National Park Service sites within about an hour:
- Acadia National Parkright here
Sources: National Register of Historic Places; National Park Service.
Read about Southwest Harbor's history on Wikipedia.
Know Southwest Harbor? Tell us what a visitor shouldn't miss: mainstreet@smalltownguide.com.
Nearby
Straight-line miles.
Small towns
- Cranberry Isles, ME160 people, 4 miles
- Mount Desert, ME2,210 people, 5 miles
- Tremont, ME1,550 people, 7 miles
- Frenchboro, ME31 people, 8 miles
- Bar Harbor, ME5,400 people, 10 miles
- Winter Harbor, ME481 people, 11 miles
- Swans Island, ME356 people, 11 miles
- Brooklin, ME827 people, 11 miles
Nearest bigger towns
- Bar Harbor, ME5,400 people, 10 miles
- Blue Hill, ME2,800 people, 15 miles
- Hancock, ME2,600 people, 19 miles
Other towns in Hancock County
- Ellsworth, ME8,900 people, 24 miles
- Bar Harbor, ME5,400 people, 10 miles
- Bucksport, ME5,100 people, 35 miles
- Blue Hill, ME2,800 people, 15 miles
- Hancock, ME2,600 people, 19 miles
- Orland, ME2,220 people, 28 miles
- Mount Desert, ME2,210 people, 5 miles
- Deer Isle, ME2,130 people, 24 miles
- Lamoine, ME1,810 people, 16 miles
- Gouldsboro, ME1,770 people, 17 miles
- Surry, ME1,690 people, 17 miles
- Dedham, ME1,670 people, 33 miles
See every town in Hancock County
Sources (13)
Show all 13 sources
- U.S. Census Bureau, Population Estimates (Vintage 2025)
- U.S. Census Bureau, American Community Survey 2020-2024 5-year estimates
- U.S. Bureau of Economic Analysis, Regional Price Parities, 2024
- FBI, Crime in the United States, Table 8 (offenses known to law enforcement by city)
- Centers for Medicare & Medicaid Services, Hospital General Information
- National Center for Education Statistics, Common Core of Data, 2023-24 (via the Urban Institute Education Data Portal)
- NOAA National Centers for Environmental Information, U.S. Climate Normals 1991-2020
- U.S. Geological Survey, 3D Elevation Program
- National Park Service, National Register of Historic Places listings
- National Park Service, park unit boundaries
- USDA Economic Research Service, Rural-Urban Continuum Codes, 2023
- Federal Housing Finance Agency, House Price Index for counties (all transactions)
- U.S. Census Bureau, 2025 Gazetteer files and 2020 urban areas
Census survey figures are estimates with a margin of error; we leave out any figure whose margin is too wide to be useful. Data last gathered November 19, 2026. See something wrong? Write to mainstreet@smalltownguide.com.