The primary purpose of investing in a castle while on the way to attacking the interior is to protect supply lines. For example, if you stage at Diathma with the intent to siege Rhotae , the most direct route would be through the Ataconian forest.
Currently, the invaders can waltz pass Ataconia...