Door County is amazing. I lived in Madison for about 6.5 years in my twenties and my wife and I would drive up to Door County every year, usually in late summer/early fall. Every town feels like you're in a quaint NE fishing village. Absolutely loved it and gutted that I moved away.