Does anyone know the best way to get rid of them?

I have a cabin up in the woods in Vermont. The bugs migrate through this time of year into the walls of the cabin. They crawl out through the outlets and other small holes. Not really a big deal. But now I have a baby and all of a sudden I'm freaked out about it. Is there a way to get rid of them entirely without tearing the walls down?