I not sure now, but i think we had a script back in the old version of ASoIaF that made progressive invasions of Others if they werent kept in check (parties defeated) by the Night Watch (or anyone), they would spawn more and more into the south, i remember seeing them as far as White Harbor.