Weatherstrip and caulk all cracks between the wall and the window trim, especially under the window sills. Replace broken glass and putty any loose window panes. Caulk around the moving parts of windows with a strip-away, non-permanent caulk during the winter. This type caulk can be removed easily in the spring.