Small town that's not a resort on the coast?

Not sure exactly, but I think you should look at the South Carolina coast, a little bit away from Myrtle Beach, Charleston, and Hilton Head. Between those there are stretches that are pretty unpopulated.