Anyone want to try to help with my carpenter ant problem?

Ever morning around 5:00 - 7:00 A.M. there are a ton of Carpenter Ants stuck between my windows in the window seal. I know there probably nesting in my walls and I'm working on getting some stuff to kill them out. But I was just wondering what would happen if I left inner window closed and the outer window opened. Would they eventually leave there highly probably nest in my walls to go outside? Should I just leave both windows closed and kind of lock them in between the windows? (This method looks as if its killing the winged ones but not the tiny worker ones.) I also can not drill holes in my walls to look for the nest so if there is an effective spray or what not please feel free to tell me. Help would be much appreciated.